2024-08-31T04:08:06.073 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T04:08:06.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T04:08:06.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} email: mchangir@redhat.com first_in_suite: false job_id: '7881276' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMw/ScXgTO4RGXzLF7Ye+AkCd1zjwz2E83qjh9xBeV0AhPlT//MZCcJT+5gR55zq4olEwEesZBZJn7u4xAEmVAs= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrx4cr7iUGkavbmLWB9oQf1kJGgFAueRUD7Hh0fZOK+nGsf43KVGtJatffZMIuQ9pALxkZPcy/rsSHPKkix/Qw= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBChcmyDBK7uyrc8n91G0D06HX5vWXxFNIxZacKCocC6JWLMc6Ip6ewwuNZDYKN4SrYL+AKm6Vf1nORr8LLdJtPg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T04:08:06.195 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T04:08:06.196 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T04:08:06.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T04:08:06.197 INFO:teuthology.task.internal:Checking packages... 2024-08-31T04:08:06.218 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T04:08:06.218 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T04:08:06.218 INFO:teuthology.packaging:ref: None 2024-08-31T04:08:06.218 INFO:teuthology.packaging:tag: None 2024-08-31T04:08:06.218 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:08:06.218 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:08:06.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:08:06.358 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T04:08:06.360 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T04:08:06.367 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T04:08:06.367 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T04:08:06.385 INFO:teuthology.task.internal:Saving configuration 2024-08-31T04:08:06.406 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T04:08:06.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T04:08:06.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 04:01:14.029895', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMw/ScXgTO4RGXzLF7Ye+AkCd1zjwz2E83qjh9xBeV0AhPlT//MZCcJT+5gR55zq4olEwEesZBZJn7u4xAEmVAs='} 2024-08-31T04:08:06.462 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 04:01:14.032728', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrx4cr7iUGkavbmLWB9oQf1kJGgFAueRUD7Hh0fZOK+nGsf43KVGtJatffZMIuQ9pALxkZPcy/rsSHPKkix/Qw='} 2024-08-31T04:08:06.485 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 04:01:14.031369', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBChcmyDBK7uyrc8n91G0D06HX5vWXxFNIxZacKCocC6JWLMc6Ip6ewwuNZDYKN4SrYL+AKm6Vf1nORr8LLdJtPg='} 2024-08-31T04:08:06.485 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T04:08:06.491 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T04:08:06.492 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T04:08:06.492 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T04:08:06.492 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T04:08:06.578 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f992cc17ac0>, signals=[15]) 2024-08-31T04:08:06.579 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T04:08:06.585 INFO:teuthology.task.internal:Opening connections... 2024-08-31T04:08:06.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:08:06.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:06.664 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-08-31T04:08:06.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:06.738 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-08-31T04:08:06.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:06.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T04:08:06.820 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-08-31T04:08:06.838 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-08-31T04:08:06.839 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-08-31T04:08:06.897 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:08:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:08:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:08:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:08:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:08:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:08:06.898 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-08-31T04:08:06.919 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-08-31T04:08:06.937 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-08-31T04:08:06.938 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:08:06.996 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:08:06.997 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:08:06.997 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-08-31T04:08:07.020 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-08-31T04:08:07.038 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-08-31T04:08:07.038 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:08:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:08:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:08:07.097 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-08-31T04:08:07.119 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T04:08:07.130 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T04:08:07.141 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T04:08:07.142 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:08:07.144 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:08:07.147 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:08:07.164 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T04:08:07.170 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T04:08:07.170 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:08:07.203 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:08:07.206 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:08:07.238 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T04:08:07.313 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T04:08:07.329 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-31T04:08:07.329 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-31T04:08:07.329 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-31T04:08:07.330 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:08:07.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:07.347 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-08-31T04:08:07.405 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-08-31T04:08:07.405 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-08-31T04:08:07.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-08-31T04:08:11.183 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-08-31T04:08:17.367 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:05 2024-08-31T04:08:22.159 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.6 MB 00:00 2024-08-31T04:08:23.618 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 18 kB 00:00 2024-08-31T04:08:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-31T04:08:30.120 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-31T04:08:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T04:08:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T04:08:32.283 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-31T04:08:32.284 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-08-31T04:08:32.284 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-31T04:08:32.373 DEBUG:teuthology.orchestra.run.smithi002:> echo no | sudo yum reinstall kernel || true 2024-08-31T04:08:32.925 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:02 ago on Sat 31 Aug 2024 04:08:30 AM UTC. 2024-08-31T04:08:33.075 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout:Reinstalling: 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.083 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:33.084 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 1.9 M 2024-08-31T04:08:33.084 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 0 2024-08-31T04:08:33.084 INFO:teuthology.orchestra.run.smithi002.stderr:Operation aborted. 2024-08-31T04:08:33.141 INFO:teuthology.orchestra.run.smithi002.stdout:Is this ok [y/N]: 2024-08-31T04:08:33.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum reinstall -y kernel || true 2024-08-31T04:08:33.684 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 04:08:30 AM UTC. 2024-08-31T04:08:33.816 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-31T04:08:33.817 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:Reinstalling: 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 1.9 M 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 0 2024-08-31T04:08:33.818 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-31T04:08:34.847 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-503.el9.x86_64.rpm 1.9 MB/s | 1.9 MB 00:00 2024-08-31T04:08:34.847 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:08:34.847 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2024-08-31T04:08:34.879 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-31T04:08:35.110 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-31T04:08:35.110 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-31T04:08:35.141 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-31T04:08:35.142 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-31T04:08:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-31T04:08:35.399 INFO:teuthology.orchestra.run.smithi002.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T04:08:35.399 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T04:08:36.102 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T04:08:36.102 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout:Reinstalled: 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:08:36.855 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-31T04:08:37.062 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T04:08:37.121 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T04:08:37.121 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T04:08:37.121 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T04:08:37.121 DEBUG:teuthology.parallel:result is None 2024-08-31T04:08:37.122 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T04:08:37.132 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T04:08:37.132 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:08:37.135 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:08:37.137 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:08:37.156 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T04:08:37.162 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T04:08:37.173 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T04:08:37.173 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:08:37.191 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:08:37.196 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:08:37.341 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T04:08:37.348 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T04:08:37.348 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:08:37.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:37.366 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:08:37.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:37.384 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:08:37.386 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:08:37.409 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:08:37.426 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.439 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.440 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.453 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.462 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.481 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:08:37.482 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T04:08:37.490 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T04:08:37.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:08:37.492 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:08:37.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:08:37.550 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T04:08:37.560 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T04:08:37.560 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:08:37.563 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:08:37.565 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:08:37.607 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:37.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:37.709 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:37.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:37.830 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:08:37.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:08:37.894 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:37.939 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:38.016 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:38.058 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:38.103 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:08:38.103 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:08:38.170 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:38.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:08:38.280 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:38.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:08:38.367 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:08:38.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:08:38.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-08-31T04:08:38.436 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-08-31T04:08:38.438 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-08-31T04:08:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:08:38.485 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:08:38.512 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:08:38.939 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T04:08:38.948 INFO:teuthology.task.internal:Starting timer... 2024-08-31T04:08:38.948 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T04:08:38.971 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T04:08:39.009 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T04:08:39.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-08-31T04:08:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-08-31T04:08:39.063 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-08-31T04:08:39.123 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-08-31T04:08:39.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-08-31T04:08:39.183 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-08-31T04:08:39.184 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T04:08:39.185 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-08-31T04:08:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-08-31T04:08:39.217 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-08-31T04:08:39.237 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-08-31T04:08:39.237 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-08-31T04:08:39.274 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-08-31T04:08:39.274 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2024-08-31T04:08:39.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:08:39.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:39.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:08:39.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:39.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:08:39.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:08:39.360 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T04:08:39.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:08:39.389 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:08:39.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:08:39.448 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T04:08:39.457 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T04:08:39.461 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T04:08:39.571 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T04:08:39.582 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T04:08:39.583 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi064.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T04:10:43.707 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-08-31T04:10:43.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-31T04:10:43.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:10:43.787 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-08-31T04:10:43.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-31T04:10:43.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-08-31T04:10:43.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:10:43.946 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-08-31T04:10:44.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-08-31T04:10:44.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-08-31T04:10:44.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:10:44.095 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-08-31T04:10:44.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-08-31T04:10:44.177 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T04:10:44.187 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T04:10:44.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:10:44.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:10:44.190 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:10:44.191 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:10:44.193 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:10:44.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:10:44.218 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:10:44.220 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:10:44.233 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:10:44.235 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:10:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:10:44.259 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-08-31T04:10:44.260 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-08-31T04:10:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:10:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-08-31T04:10:44.271 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-08-31T04:10:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:10:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-08-31T04:10:44.286 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:10:44.297 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-08-31T04:10:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:10:44.300 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:10:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:10:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:10:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-31T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.361 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.365 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.384 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:10:44.388 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:10:44.389 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-08-31T04:10:44.389 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.389 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.389 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.389 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:10:44.389 INFO:teuthology.run_tasks:Running task install... 2024-08-31T04:10:44.397 DEBUG:teuthology.task.install:project ceph 2024-08-31T04:10:44.397 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T04:10:44.397 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T04:10:44.397 INFO:teuthology.task.install:Using flavor: default 2024-08-31T04:10:44.402 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T04:10:44.402 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T04:10:44.403 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:10:44.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:44.405 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:10:44.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:44.406 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:10:44.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:44.549 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:10:44.550 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:10:44.553 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:10:44.553 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:10:44.561 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:10:44.562 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:10:44.659 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:10:44.660 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:10:44.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:10:44.667 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:10:44.668 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:10:44.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:10:44.676 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:10:44.676 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:10:44.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:10:44.685 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:10:44.685 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:10:44.693 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:10:44.694 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:10:44.702 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:10:44.702 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:10:44.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:10:44.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:10:44.767 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:10:44.824 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:10:44.834 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:10:44.841 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:10:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-08-31T04:10:44.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-08-31T04:10:44.897 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-08-31T04:10:44.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-08-31T04:10:44.904 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-08-31T04:10:44.906 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-08-31T04:10:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-08-31T04:10:45.125 INFO:teuthology.orchestra.run.smithi132.stdout:45 files removed 2024-08-31T04:10:45.136 INFO:teuthology.orchestra.run.smithi064.stdout:45 files removed 2024-08-31T04:10:45.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:10:45.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:10:45.163 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:10:45.692 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-08-31T04:10:45.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-08-31T04:10:45.715 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-08-31T04:10:45.984 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-31T04:10:46.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-08-31T04:10:46.007 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-08-31T04:10:46.268 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-31T04:10:46.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-08-31T04:10:46.274 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-08-31T04:10:46.741 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-08-31T04:10:46.780 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-08-31T04:10:47.168 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-08-31T04:10:50.025 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-08-31T04:10:51.264 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-08-31T04:10:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-08-31T04:10:55.584 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.6 MB 00:01 2024-08-31T04:10:56.703 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.6 MB 00:00 2024-08-31T04:10:56.973 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-31T04:10:57.385 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-31T04:10:58.181 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 34 MB/s | 22 MB 00:00 2024-08-31T04:10:58.471 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-08-31T04:10:58.498 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 18 kB 00:00 2024-08-31T04:10:59.411 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-31T04:10:59.516 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-31T04:11:03.712 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-08-31T04:11:04.959 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T04:11:05.031 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T04:11:06.064 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:06.065 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:06.077 INFO:teuthology.orchestra.run.smithi064.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:11:06.078 INFO:teuthology.orchestra.run.smithi064.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:11:06.079 INFO:teuthology.orchestra.run.smithi064.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:11:06.079 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:11:06.081 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:11:06.083 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:11:06.084 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:11:06.147 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-08-31T04:11:06.165 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-08-31T04:11:06.165 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-08-31T04:11:06.165 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:11:06.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:11:06.167 INFO:teuthology.orchestra.run.smithi064.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:11:06.168 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:11:06.169 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:11:06.170 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:11:06.171 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:11:06.172 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:11:06.173 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:11:06.174 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:11:06.176 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:11:06.177 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:11:06.178 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout:Install 148 Packages 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 2 Packages 2024-08-31T04:11:06.179 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:11:06.180 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 224 M 2024-08-31T04:11:06.180 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-08-31T04:11:06.988 INFO:teuthology.orchestra.run.smithi064.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-08-31T04:11:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 3.0 MB/s | 874 kB 00:00 2024-08-31T04:11:07.347 INFO:teuthology.orchestra.run.smithi064.stdout:(3/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T04:11:07.372 INFO:teuthology.orchestra.run.smithi064.stdout:(4/150): ceph-immutable-object-cache-19.3.0-456 1.4 MB/s | 148 kB 00:00 2024-08-31T04:11:07.388 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.389 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.392 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.392 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.403 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:11:07.404 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:11:07.405 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.406 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:11:07.407 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:11:07.407 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:11:07.407 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.408 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:11:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:11:07.410 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.411 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.412 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:11:07.472 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-08-31T04:11:07.474 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-31T04:11:07.481 INFO:teuthology.orchestra.run.smithi064.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 2.3 MB 00:00 2024-08-31T04:11:07.483 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-31T04:11:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:11:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:11:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:11:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:11:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:11:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:11:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:11:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:11:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:11:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:11:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:11:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:11:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:11:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:07.497 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-31T04:11:07.497 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-31T04:11:07.497 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-08-31T04:11:07.497 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-08-31T04:11:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 224 M 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-08-31T04:11:07.498 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:11:07.499 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:11:07.500 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:11:07.501 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:11:07.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:11:07.504 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:11:07.505 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:11:07.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:11:07.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:11:07.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:11:07.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:11:07.510 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:11:07.511 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:Install 148 Packages 2024-08-31T04:11:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 2 Packages 2024-08-31T04:11:07.513 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:11:07.513 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 224 M 2024-08-31T04:11:07.513 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-08-31T04:11:07.739 INFO:teuthology.orchestra.run.smithi064.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 4.1 MB/s | 1.5 MB 00:00 2024-08-31T04:11:07.806 INFO:teuthology.orchestra.run.smithi064.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-31T04:11:07.998 INFO:teuthology.orchestra.run.smithi064.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T04:11:08.040 INFO:teuthology.orchestra.run.smithi064.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 608 kB/s | 25 kB 00:00 2024-08-31T04:11:08.085 INFO:teuthology.orchestra.run.smithi002.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-08-31T04:11:08.274 INFO:teuthology.orchestra.run.smithi132.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-08-31T04:11:08.332 INFO:teuthology.orchestra.run.smithi064.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 20 MB/s | 10 MB 00:00 2024-08-31T04:11:08.391 INFO:teuthology.orchestra.run.smithi064.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.8 MB/s | 226 kB 00:00 2024-08-31T04:11:08.474 INFO:teuthology.orchestra.run.smithi064.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 325 kB/s | 27 kB 00:00 2024-08-31T04:11:08.566 INFO:teuthology.orchestra.run.smithi064.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 347 kB/s | 32 kB 00:00 2024-08-31T04:11:08.735 INFO:teuthology.orchestra.run.smithi002.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.3 MB/s | 874 kB 00:00 2024-08-31T04:11:08.843 INFO:teuthology.orchestra.run.smithi002.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.3 MB/s | 148 kB 00:00 2024-08-31T04:11:08.941 INFO:teuthology.orchestra.run.smithi132.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.3 MB/s | 874 kB 00:00 2024-08-31T04:11:09.074 INFO:teuthology.orchestra.run.smithi132.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.1 MB/s | 148 kB 00:00 2024-08-31T04:11:09.091 INFO:teuthology.orchestra.run.smithi064.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 1.4 MB/s | 766 kB 00:00 2024-08-31T04:11:09.316 INFO:teuthology.orchestra.run.smithi132.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 4.3 MB/s | 5.5 MB 00:01 2024-08-31T04:11:09.417 INFO:teuthology.orchestra.run.smithi064.stdout:(15/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 18 MB 00:01 2024-08-31T04:11:09.442 INFO:teuthology.orchestra.run.smithi064.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 453 kB/s | 159 kB 00:00 2024-08-31T04:11:09.443 INFO:teuthology.orchestra.run.smithi002.stdout:(4/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 3.8 MB/s | 2.3 MB 00:00 2024-08-31T04:11:09.468 INFO:teuthology.orchestra.run.smithi064.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-31T04:11:09.475 INFO:teuthology.orchestra.run.smithi132.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-08-31T04:11:09.701 INFO:teuthology.orchestra.run.smithi064.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 1.9 MB/s | 506 kB 00:00 2024-08-31T04:11:09.818 INFO:teuthology.orchestra.run.smithi064.stdout:(19/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 5.3 MB 00:00 2024-08-31T04:11:09.819 INFO:teuthology.orchestra.run.smithi002.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-08-31T04:11:09.835 INFO:teuthology.orchestra.run.smithi064.stdout:(20/150): python3-ceph-argparse-19.3.0-4560.gd1 338 kB/s | 45 kB 00:00 2024-08-31T04:11:09.885 INFO:teuthology.orchestra.run.smithi064.stdout:(21/150): python3-ceph-common-19.3.0-4560.gd19e 2.1 MB/s | 141 kB 00:00 2024-08-31T04:11:09.952 INFO:teuthology.orchestra.run.smithi064.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.3 MB/s | 161 kB 00:00 2024-08-31T04:11:09.977 INFO:teuthology.orchestra.run.smithi064.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 3.4 MB/s | 321 kB 00:00 2024-08-31T04:11:10.053 INFO:teuthology.orchestra.run.smithi064.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.3 MB/s | 99 kB 00:00 2024-08-31T04:11:10.078 INFO:teuthology.orchestra.run.smithi064.stdout:(25/150): python3-rbd-19.3.0-4560.gd19e6118.el9 2.4 MB/s | 305 kB 00:00 2024-08-31T04:11:10.103 INFO:teuthology.orchestra.run.smithi064.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T04:11:10.217 INFO:teuthology.orchestra.run.smithi132.stdout:(6/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 6.6 MB/s | 4.9 MB 00:00 2024-08-31T04:11:10.284 INFO:teuthology.orchestra.run.smithi132.stdout:(7/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 1.9 MB/s | 2.3 MB 00:01 2024-08-31T04:11:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:(6/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 10 MB/s | 4.9 MB 00:00 2024-08-31T04:11:10.487 INFO:teuthology.orchestra.run.smithi064.stdout:(27/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 18 MB/s | 44 MB 00:02 2024-08-31T04:11:10.512 INFO:teuthology.orchestra.run.smithi064.stdout:(28/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 416 kB/s | 170 kB 00:00 2024-08-31T04:11:10.546 INFO:teuthology.orchestra.run.smithi064.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 588 kB/s | 34 kB 00:00 2024-08-31T04:11:10.588 INFO:teuthology.orchestra.run.smithi064.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.0 MB/s | 154 kB 00:00 2024-08-31T04:11:10.636 INFO:teuthology.orchestra.run.smithi002.stdout:(7/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 2.0 MB/s | 5.5 MB 00:02 2024-08-31T04:11:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 6.9 MB/s | 20 MB 00:02 2024-08-31T04:11:10.955 INFO:teuthology.orchestra.run.smithi064.stdout:(31/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 3.5 MB/s | 3.1 MB 00:00 2024-08-31T04:11:11.009 INFO:teuthology.orchestra.run.smithi132.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 303 kB/s | 25 kB 00:00 2024-08-31T04:11:11.155 INFO:teuthology.orchestra.run.smithi064.stdout:(32/150): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-08-31T04:11:11.239 INFO:teuthology.orchestra.run.smithi064.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 592 kB/s | 49 kB 00:00 2024-08-31T04:11:11.322 INFO:teuthology.orchestra.run.smithi064.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 197 kB/s | 16 kB 00:00 2024-08-31T04:11:11.456 INFO:teuthology.orchestra.run.smithi064.stdout:(35/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 16 MB/s | 14 MB 00:00 2024-08-31T04:11:11.481 INFO:teuthology.orchestra.run.smithi064.stdout:(36/150): ceph-mgr-modules-core-19.3.0-4560.gd1 552 kB/s | 290 kB 00:00 2024-08-31T04:11:11.507 INFO:teuthology.orchestra.run.smithi064.stdout:(37/150): ceph-volume-19.3.0-4560.gd19e6118.el9 1.5 MB/s | 285 kB 00:00 2024-08-31T04:11:11.532 INFO:teuthology.orchestra.run.smithi064.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 363 kB/s | 18 kB 00:00 2024-08-31T04:11:11.565 INFO:teuthology.orchestra.run.smithi064.stdout:(39/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 7.0 MB/s | 781 kB 00:00 2024-08-31T04:11:11.588 INFO:teuthology.orchestra.run.smithi002.stdout:(8/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x86 14 MB/s | 18 MB 00:01 2024-08-31T04:11:11.628 INFO:teuthology.orchestra.run.smithi002.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 606 kB/s | 25 kB 00:00 2024-08-31T04:11:12.166 INFO:teuthology.orchestra.run.smithi064.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 121 kB/s | 80 kB 00:00 2024-08-31T04:11:12.308 INFO:teuthology.orchestra.run.smithi064.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 258 kB/s | 191 kB 00:00 2024-08-31T04:11:12.508 INFO:teuthology.orchestra.run.smithi064.stdout:(42/150): libgfortran-11.5.0-2.el9.x86_64.rpm 821 kB/s | 801 kB 00:00 2024-08-31T04:11:12.617 INFO:teuthology.orchestra.run.smithi132.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 7.4 MB/s | 18 MB 00:02 2024-08-31T04:11:12.718 INFO:teuthology.orchestra.run.smithi132.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.2 MB/s | 226 kB 00:00 2024-08-31T04:11:12.768 INFO:teuthology.orchestra.run.smithi132.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 543 kB/s | 27 kB 00:00 2024-08-31T04:11:12.818 INFO:teuthology.orchestra.run.smithi132.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 635 kB/s | 32 kB 00:00 2024-08-31T04:11:12.952 INFO:teuthology.orchestra.run.smithi132.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 5.6 MB/s | 766 kB 00:00 2024-08-31T04:11:12.983 INFO:teuthology.orchestra.run.smithi064.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 310 kB/s | 253 kB 00:00 2024-08-31T04:11:13.010 INFO:teuthology.orchestra.run.smithi132.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-31T04:11:13.069 INFO:teuthology.orchestra.run.smithi132.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T04:11:13.169 INFO:teuthology.orchestra.run.smithi132.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 5.0 MB/s | 506 kB 00:00 2024-08-31T04:11:13.191 INFO:teuthology.orchestra.run.smithi064.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-08-31T04:11:13.250 INFO:teuthology.orchestra.run.smithi064.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-08-31T04:11:13.553 INFO:teuthology.orchestra.run.smithi002.stdout:(10/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 23 MB/s | 44 MB 00:01 2024-08-31T04:11:13.603 INFO:teuthology.orchestra.run.smithi002.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 4.4 MB/s | 226 kB 00:00 2024-08-31T04:11:13.628 INFO:teuthology.orchestra.run.smithi132.stdout:(18/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 5.3 MB 00:00 2024-08-31T04:11:13.678 INFO:teuthology.orchestra.run.smithi132.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 905 kB/s | 45 kB 00:00 2024-08-31T04:11:13.684 INFO:teuthology.orchestra.run.smithi064.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-08-31T04:11:13.712 INFO:teuthology.orchestra.run.smithi002.stdout:(12/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 3.4 MB/s | 10 MB 00:03 2024-08-31T04:11:13.729 INFO:teuthology.orchestra.run.smithi132.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-31T04:11:13.737 INFO:teuthology.orchestra.run.smithi002.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 202 kB/s | 27 kB 00:00 2024-08-31T04:11:13.762 INFO:teuthology.orchestra.run.smithi002.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 635 kB/s | 32 kB 00:00 2024-08-31T04:11:13.779 INFO:teuthology.orchestra.run.smithi132.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 3.2 MB/s | 161 kB 00:00 2024-08-31T04:11:13.892 INFO:teuthology.orchestra.run.smithi064.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-08-31T04:11:13.946 INFO:teuthology.orchestra.run.smithi002.stdout:(15/150): ceph-common-19.3.0-4560.gd19e6118.el9 3.3 MB/s | 20 MB 00:06 2024-08-31T04:11:13.963 INFO:teuthology.orchestra.run.smithi132.stdout:(22/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 2.8 MB/s | 10 MB 00:03 2024-08-31T04:11:13.971 INFO:teuthology.orchestra.run.smithi002.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 762 kB/s | 159 kB 00:00 2024-08-31T04:11:13.988 INFO:teuthology.orchestra.run.smithi132.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 1.5 MB/s | 321 kB 00:00 2024-08-31T04:11:13.996 INFO:teuthology.orchestra.run.smithi002.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-31T04:11:14.022 INFO:teuthology.orchestra.run.smithi002.stdout:(18/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 2.6 MB/s | 766 kB 00:00 2024-08-31T04:11:14.038 INFO:teuthology.orchestra.run.smithi132.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-31T04:11:14.055 INFO:teuthology.orchestra.run.smithi002.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 1.3 MB/s | 45 kB 00:00 2024-08-31T04:11:14.072 INFO:teuthology.orchestra.run.smithi132.stdout:(25/150): python3-rbd-19.3.0-4560.gd19e6118.el9 2.7 MB/s | 305 kB 00:00 2024-08-31T04:11:14.089 INFO:teuthology.orchestra.run.smithi002.stdout:(20/150): libradosstriper1-19.3.0-4560.gd19e611 4.2 MB/s | 506 kB 00:00 2024-08-31T04:11:14.097 INFO:teuthology.orchestra.run.smithi132.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.4 MB/s | 86 kB 00:00 2024-08-31T04:11:14.101 INFO:teuthology.orchestra.run.smithi064.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-08-31T04:11:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:(21/150): python3-ceph-common-19.3.0-4560.gd19e 2.7 MB/s | 141 kB 00:00 2024-08-31T04:11:14.139 INFO:teuthology.orchestra.run.smithi002.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 3.2 MB/s | 161 kB 00:00 2024-08-31T04:11:14.147 INFO:teuthology.orchestra.run.smithi132.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-31T04:11:14.164 INFO:teuthology.orchestra.run.smithi002.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 5.4 MB/s | 321 kB 00:00 2024-08-31T04:11:14.190 INFO:teuthology.orchestra.run.smithi132.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 825 kB/s | 34 kB 00:00 2024-08-31T04:11:14.215 INFO:teuthology.orchestra.run.smithi002.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.0 MB/s | 305 kB 00:00 2024-08-31T04:11:14.231 INFO:teuthology.orchestra.run.smithi002.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.5 MB/s | 99 kB 00:00 2024-08-31T04:11:14.241 INFO:teuthology.orchestra.run.smithi132.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T04:11:14.265 INFO:teuthology.orchestra.run.smithi002.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T04:11:14.341 INFO:teuthology.orchestra.run.smithi002.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.2 MB/s | 170 kB 00:00 2024-08-31T04:11:14.399 INFO:teuthology.orchestra.run.smithi002.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 18 MB/s | 3.1 MB 00:00 2024-08-31T04:11:14.425 INFO:teuthology.orchestra.run.smithi002.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 410 kB/s | 34 kB 00:00 2024-08-31T04:11:14.434 INFO:teuthology.orchestra.run.smithi064.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 919 kB/s | 689 kB 00:00 2024-08-31T04:11:14.450 INFO:teuthology.orchestra.run.smithi002.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T04:11:14.518 INFO:teuthology.orchestra.run.smithi064.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 256 kB/s | 107 kB 00:00 2024-08-31T04:11:14.535 INFO:teuthology.orchestra.run.smithi064.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-08-31T04:11:14.635 INFO:teuthology.orchestra.run.smithi064.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-08-31T04:11:14.690 INFO:teuthology.orchestra.run.smithi132.stdout:(30/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 12 MB/s | 44 MB 00:03 2024-08-31T04:11:14.736 INFO:teuthology.orchestra.run.smithi064.stdout:(53/150): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-08-31T04:11:14.750 INFO:teuthology.orchestra.run.smithi002.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 25 MB/s | 7.4 MB 00:00 2024-08-31T04:11:14.778 INFO:teuthology.orchestra.run.smithi064.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-08-31T04:11:14.836 INFO:teuthology.orchestra.run.smithi064.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-08-31T04:11:14.842 INFO:teuthology.orchestra.run.smithi002.stdout:(32/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 6.3 MB/s | 5.3 MB 00:00 2024-08-31T04:11:14.867 INFO:teuthology.orchestra.run.smithi002.stdout:(33/150): ceph-mgr-modules-core-19.3.0-4560.gd1 2.4 MB/s | 290 kB 00:00 2024-08-31T04:11:14.878 INFO:teuthology.orchestra.run.smithi064.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-08-31T04:11:14.893 INFO:teuthology.orchestra.run.smithi002.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 987 kB/s | 49 kB 00:00 2024-08-31T04:11:14.907 INFO:teuthology.orchestra.run.smithi132.stdout:(31/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 3.7 MB/s | 3.1 MB 00:00 2024-08-31T04:11:14.918 INFO:teuthology.orchestra.run.smithi002.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 328 kB/s | 16 kB 00:00 2024-08-31T04:11:14.945 INFO:teuthology.orchestra.run.smithi064.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-31T04:11:14.968 INFO:teuthology.orchestra.run.smithi002.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 3.7 MB/s | 285 kB 00:00 2024-08-31T04:11:14.978 INFO:teuthology.orchestra.run.smithi064.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-08-31T04:11:14.991 INFO:teuthology.orchestra.run.smithi132.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.4 MB/s | 290 kB 00:00 2024-08-31T04:11:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 9.2 MB/s | 781 kB 00:00 2024-08-31T04:11:15.027 INFO:teuthology.orchestra.run.smithi002.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 312 kB/s | 18 kB 00:00 2024-08-31T04:11:15.041 INFO:teuthology.orchestra.run.smithi132.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 991 kB/s | 49 kB 00:00 2024-08-31T04:11:15.092 INFO:teuthology.orchestra.run.smithi132.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 330 kB/s | 16 kB 00:00 2024-08-31T04:11:15.112 INFO:teuthology.orchestra.run.smithi064.stdout:(59/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-08-31T04:11:15.138 INFO:teuthology.orchestra.run.smithi064.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-08-31T04:11:15.144 INFO:teuthology.orchestra.run.smithi002.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-08-31T04:11:15.171 INFO:teuthology.orchestra.run.smithi064.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-08-31T04:11:15.175 INFO:teuthology.orchestra.run.smithi132.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 3.4 MB/s | 285 kB 00:00 2024-08-31T04:11:15.211 INFO:teuthology.orchestra.run.smithi002.stdout:(40/150): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-08-31T04:11:15.213 INFO:teuthology.orchestra.run.smithi064.stdout:(62/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-08-31T04:11:15.236 INFO:teuthology.orchestra.run.smithi002.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-08-31T04:11:15.238 INFO:teuthology.orchestra.run.smithi064.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-08-31T04:11:15.261 INFO:teuthology.orchestra.run.smithi002.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-08-31T04:11:15.267 INFO:teuthology.orchestra.run.smithi132.stdout:(36/150): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-08-31T04:11:15.280 INFO:teuthology.orchestra.run.smithi064.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-31T04:11:15.303 INFO:teuthology.orchestra.run.smithi002.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-31T04:11:15.317 INFO:teuthology.orchestra.run.smithi132.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 367 kB/s | 18 kB 00:00 2024-08-31T04:11:15.339 INFO:teuthology.orchestra.run.smithi064.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-08-31T04:11:15.345 INFO:teuthology.orchestra.run.smithi002.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-08-31T04:11:15.370 INFO:teuthology.orchestra.run.smithi002.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-31T04:11:15.384 INFO:teuthology.orchestra.run.smithi132.stdout:(38/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 3.7 MB/s | 781 kB 00:00 2024-08-31T04:11:15.395 INFO:teuthology.orchestra.run.smithi002.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-31T04:11:15.421 INFO:teuthology.orchestra.run.smithi002.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-31T04:11:15.451 INFO:teuthology.orchestra.run.smithi132.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-08-31T04:11:15.455 INFO:teuthology.orchestra.run.smithi002.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-08-31T04:11:15.489 INFO:teuthology.orchestra.run.smithi064.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 683 kB/s | 188 kB 00:00 2024-08-31T04:11:15.496 INFO:teuthology.orchestra.run.smithi002.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-08-31T04:11:15.513 INFO:teuthology.orchestra.run.smithi002.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-31T04:11:15.539 INFO:teuthology.orchestra.run.smithi002.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-08-31T04:11:15.543 INFO:teuthology.orchestra.run.smithi132.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-08-31T04:11:15.564 INFO:teuthology.orchestra.run.smithi002.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-31T04:11:15.598 INFO:teuthology.orchestra.run.smithi002.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-08-31T04:11:15.602 INFO:teuthology.orchestra.run.smithi132.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-08-31T04:11:15.640 INFO:teuthology.orchestra.run.smithi002.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-08-31T04:11:15.656 INFO:teuthology.orchestra.run.smithi132.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.2 MB/s | 253 kB 00:00 2024-08-31T04:11:15.690 INFO:teuthology.orchestra.run.smithi002.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-08-31T04:11:15.694 INFO:teuthology.orchestra.run.smithi132.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-08-31T04:11:15.715 INFO:teuthology.orchestra.run.smithi002.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-08-31T04:11:15.719 INFO:teuthology.orchestra.run.smithi132.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2024-08-31T04:11:15.740 INFO:teuthology.orchestra.run.smithi002.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-31T04:11:15.744 INFO:teuthology.orchestra.run.smithi132.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-31T04:11:15.766 INFO:teuthology.orchestra.run.smithi002.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-08-31T04:11:15.778 INFO:teuthology.orchestra.run.smithi132.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-31T04:11:15.803 INFO:teuthology.orchestra.run.smithi132.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-31T04:11:15.808 INFO:teuthology.orchestra.run.smithi002.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T04:11:15.860 INFO:teuthology.orchestra.run.smithi002.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 6.0 MB/s | 581 kB 00:00 2024-08-31T04:11:15.884 INFO:teuthology.orchestra.run.smithi002.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-08-31T04:11:15.909 INFO:teuthology.orchestra.run.smithi002.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 986 kB/s | 47 kB 00:00 2024-08-31T04:11:15.934 INFO:teuthology.orchestra.run.smithi002.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-31T04:11:15.945 INFO:teuthology.orchestra.run.smithi132.stdout:(48/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 8.3 MB/s | 14 MB 00:01 2024-08-31T04:11:15.959 INFO:teuthology.orchestra.run.smithi002.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-31T04:11:15.985 INFO:teuthology.orchestra.run.smithi002.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-08-31T04:11:16.093 INFO:teuthology.orchestra.run.smithi002.stdout:(66/150): openblas-openmp-0.3.26-2.el9.x86_64.r 37 MB/s | 4.9 MB 00:00 2024-08-31T04:11:16.152 INFO:teuthology.orchestra.run.smithi002.stdout:(67/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-08-31T04:11:16.194 INFO:teuthology.orchestra.run.smithi002.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T04:11:16.227 INFO:teuthology.orchestra.run.smithi002.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-08-31T04:11:16.244 INFO:teuthology.orchestra.run.smithi002.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-08-31T04:11:16.303 INFO:teuthology.orchestra.run.smithi002.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-08-31T04:11:16.378 INFO:teuthology.orchestra.run.smithi002.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-08-31T04:11:16.403 INFO:teuthology.orchestra.run.smithi002.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-08-31T04:11:16.446 INFO:teuthology.orchestra.run.smithi002.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-31T04:11:16.521 INFO:teuthology.orchestra.run.smithi002.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 42 MB/s | 6.0 MB 00:00 2024-08-31T04:11:16.546 INFO:teuthology.orchestra.run.smithi002.stdout:(76/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-08-31T04:11:16.571 INFO:teuthology.orchestra.run.smithi002.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-31T04:11:16.597 INFO:teuthology.orchestra.run.smithi002.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-08-31T04:11:16.612 INFO:teuthology.orchestra.run.smithi132.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-08-31T04:11:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-08-31T04:11:16.647 INFO:teuthology.orchestra.run.smithi002.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-31T04:11:16.672 INFO:teuthology.orchestra.run.smithi002.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-31T04:11:16.715 INFO:teuthology.orchestra.run.smithi002.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-08-31T04:11:16.746 INFO:teuthology.orchestra.run.smithi132.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 712 kB/s | 689 kB 00:00 2024-08-31T04:11:16.788 INFO:teuthology.orchestra.run.smithi132.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 958 kB/s | 943 kB 00:00 2024-08-31T04:11:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-08-31T04:11:16.815 INFO:teuthology.orchestra.run.smithi002.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-31T04:11:16.965 INFO:teuthology.orchestra.run.smithi002.stdout:(85/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 5.6 MB/s | 14 MB 00:02 2024-08-31T04:11:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 241 kB/s | 42 kB 00:00 2024-08-31T04:11:17.016 INFO:teuthology.orchestra.run.smithi002.stdout:(87/150): python3-packaging-20.9-5.el9.noarch.r 342 kB/s | 77 kB 00:00 2024-08-31T04:11:17.041 INFO:teuthology.orchestra.run.smithi002.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-31T04:11:17.066 INFO:teuthology.orchestra.run.smithi002.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-31T04:11:17.092 INFO:teuthology.orchestra.run.smithi002.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-31T04:11:17.098 INFO:teuthology.orchestra.run.smithi064.stdout:(67/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-08-31T04:11:17.117 INFO:teuthology.orchestra.run.smithi002.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T04:11:17.142 INFO:teuthology.orchestra.run.smithi002.stdout:(92/150): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-08-31T04:11:17.168 INFO:teuthology.orchestra.run.smithi002.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-08-31T04:11:17.180 INFO:teuthology.orchestra.run.smithi132.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-08-31T04:11:17.193 INFO:teuthology.orchestra.run.smithi002.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-08-31T04:11:17.218 INFO:teuthology.orchestra.run.smithi002.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-31T04:11:17.243 INFO:teuthology.orchestra.run.smithi002.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-08-31T04:11:17.269 INFO:teuthology.orchestra.run.smithi002.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-31T04:11:17.302 INFO:teuthology.orchestra.run.smithi002.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-31T04:11:17.328 INFO:teuthology.orchestra.run.smithi002.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-08-31T04:11:17.353 INFO:teuthology.orchestra.run.smithi002.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-31T04:11:17.388 INFO:teuthology.orchestra.run.smithi002.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 64 kB 00:00 2024-08-31T04:11:17.405 INFO:teuthology.orchestra.run.smithi132.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 53 kB/s | 33 kB 00:00 2024-08-31T04:11:17.412 INFO:teuthology.orchestra.run.smithi002.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-08-31T04:11:17.556 INFO:teuthology.orchestra.run.smithi132.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 388 kB/s | 313 kB 00:00 2024-08-31T04:11:17.643 INFO:teuthology.orchestra.run.smithi002.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-08-31T04:11:17.693 INFO:teuthology.orchestra.run.smithi002.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-31T04:11:17.726 INFO:teuthology.orchestra.run.smithi002.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-31T04:11:17.752 INFO:teuthology.orchestra.run.smithi002.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-08-31T04:11:17.756 INFO:teuthology.orchestra.run.smithi064.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 716 kB/s | 1.6 MB 00:02 2024-08-31T04:11:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:(107/150): lua-devel-5.4.4-4.el9.x86_64.rpm 50 kB/s | 22 kB 00:00 2024-08-31T04:11:17.919 INFO:teuthology.orchestra.run.smithi002.stdout:(108/150): libarrow-9.0.0-11.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-08-31T04:11:17.931 INFO:teuthology.orchestra.run.smithi132.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-08-31T04:11:17.953 INFO:teuthology.orchestra.run.smithi002.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T04:11:17.978 INFO:teuthology.orchestra.run.smithi002.stdout:(110/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2024-08-31T04:11:18.003 INFO:teuthology.orchestra.run.smithi002.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-08-31T04:11:18.023 INFO:teuthology.orchestra.run.smithi064.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 515 kB/s | 137 kB 00:00 2024-08-31T04:11:18.037 INFO:teuthology.orchestra.run.smithi002.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-08-31T04:11:18.039 INFO:teuthology.orchestra.run.smithi132.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-08-31T04:11:18.071 INFO:teuthology.orchestra.run.smithi002.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-31T04:11:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-08-31T04:11:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:(115/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-08-31T04:11:18.140 INFO:teuthology.orchestra.run.smithi064.stdout:(70/150): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-08-31T04:11:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-08-31T04:11:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-08-31T04:11:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-08-31T04:11:18.231 INFO:teuthology.orchestra.run.smithi002.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-08-31T04:11:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-08-31T04:11:18.264 INFO:teuthology.orchestra.run.smithi002.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-31T04:11:18.290 INFO:teuthology.orchestra.run.smithi002.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-31T04:11:18.315 INFO:teuthology.orchestra.run.smithi002.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-31T04:11:18.340 INFO:teuthology.orchestra.run.smithi002.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-08-31T04:11:18.365 INFO:teuthology.orchestra.run.smithi002.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-08-31T04:11:18.390 INFO:teuthology.orchestra.run.smithi064.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 704 kB/s | 910 kB 00:01 2024-08-31T04:11:18.391 INFO:teuthology.orchestra.run.smithi002.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-08-31T04:11:18.416 INFO:teuthology.orchestra.run.smithi002.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-08-31T04:11:18.441 INFO:teuthology.orchestra.run.smithi002.stdout:(127/150): protobuf-compiler-3.14.0-13.el9.x86_ 839 kB/s | 863 kB 00:01 2024-08-31T04:11:18.466 INFO:teuthology.orchestra.run.smithi002.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-31T04:11:18.500 INFO:teuthology.orchestra.run.smithi002.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T04:11:18.525 INFO:teuthology.orchestra.run.smithi002.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2024-08-31T04:11:18.550 INFO:teuthology.orchestra.run.smithi002.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T04:11:18.574 INFO:teuthology.orchestra.run.smithi064.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-08-31T04:11:18.584 INFO:teuthology.orchestra.run.smithi002.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-31T04:11:18.610 INFO:teuthology.orchestra.run.smithi002.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-08-31T04:11:18.635 INFO:teuthology.orchestra.run.smithi002.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-31T04:11:18.660 INFO:teuthology.orchestra.run.smithi002.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T04:11:18.665 INFO:teuthology.orchestra.run.smithi132.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 218 kB/s | 160 kB 00:00 2024-08-31T04:11:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:(136/150): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-31T04:11:18.711 INFO:teuthology.orchestra.run.smithi132.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-08-31T04:11:18.719 INFO:teuthology.orchestra.run.smithi002.stdout:(137/150): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-08-31T04:11:18.744 INFO:teuthology.orchestra.run.smithi002.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T04:11:18.795 INFO:teuthology.orchestra.run.smithi002.stdout:(139/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-08-31T04:11:18.820 INFO:teuthology.orchestra.run.smithi002.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-31T04:11:18.845 INFO:teuthology.orchestra.run.smithi002.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 354 kB/s | 36 kB 00:00 2024-08-31T04:11:18.871 INFO:teuthology.orchestra.run.smithi002.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 982 kB/s | 74 kB 00:00 2024-08-31T04:11:18.896 INFO:teuthology.orchestra.run.smithi002.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T04:11:18.921 INFO:teuthology.orchestra.run.smithi002.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T04:11:18.947 INFO:teuthology.orchestra.run.smithi002.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-31T04:11:18.980 INFO:teuthology.orchestra.run.smithi002.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-08-31T04:11:19.005 INFO:teuthology.orchestra.run.smithi002.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T04:11:19.056 INFO:teuthology.orchestra.run.smithi002.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T04:11:19.132 INFO:teuthology.orchestra.run.smithi132.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 744 kB/s | 662 kB 00:00 2024-08-31T04:11:19.249 INFO:teuthology.orchestra.run.smithi132.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-08-31T04:11:19.264 INFO:teuthology.orchestra.run.smithi002.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 12 MB/s | 3.4 MB 00:00 2024-08-31T04:11:19.472 INFO:teuthology.orchestra.run.smithi002.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.7 MB/s | 3.1 MB 00:00 2024-08-31T04:11:19.478 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:11:19.479 INFO:teuthology.orchestra.run.smithi002.stdout:Total 19 MB/s | 224 MB 00:11 2024-08-31T04:11:19.541 INFO:teuthology.orchestra.run.smithi132.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 664 kB/s | 581 kB 00:00 2024-08-31T04:11:19.549 INFO:teuthology.orchestra.run.smithi064.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 733 kB/s | 1.0 MB 00:01 2024-08-31T04:11:19.650 INFO:teuthology.orchestra.run.smithi064.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 613 kB/s | 61 kB 00:00 2024-08-31T04:11:19.708 INFO:teuthology.orchestra.run.smithi132.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-31T04:11:19.991 INFO:teuthology.orchestra.run.smithi064.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 716 kB/s | 245 kB 00:00 2024-08-31T04:11:20.125 INFO:teuthology.orchestra.run.smithi132.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-08-31T04:11:20.333 INFO:teuthology.orchestra.run.smithi064.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 727 kB/s | 248 kB 00:00 2024-08-31T04:11:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 61 kB/s | 38 kB 00:00 2024-08-31T04:11:20.367 INFO:teuthology.orchestra.run.smithi132.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 228 kB/s | 188 kB 00:00 2024-08-31T04:11:20.434 INFO:teuthology.orchestra.run.smithi064.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-08-31T04:11:20.534 INFO:teuthology.orchestra.run.smithi064.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-08-31T04:11:20.550 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-31T04:11:20.688 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-31T04:11:20.688 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-31T04:11:20.859 INFO:teuthology.orchestra.run.smithi064.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 530 kB/s | 172 kB 00:00 2024-08-31T04:11:20.960 INFO:teuthology.orchestra.run.smithi064.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-08-31T04:11:21.285 INFO:teuthology.orchestra.run.smithi064.stdout:(81/150): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2024-08-31T04:11:21.359 INFO:teuthology.orchestra.run.smithi132.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-08-31T04:11:21.401 INFO:teuthology.orchestra.run.smithi132.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-31T04:11:21.402 INFO:teuthology.orchestra.run.smithi064.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-08-31T04:11:21.484 INFO:teuthology.orchestra.run.smithi132.stdout:(69/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-31T04:11:21.510 INFO:teuthology.orchestra.run.smithi064.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-08-31T04:11:21.586 INFO:teuthology.orchestra.run.smithi064.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.1 MB/s | 5.1 MB 00:00 2024-08-31T04:11:21.619 INFO:teuthology.orchestra.run.smithi064.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-08-31T04:11:21.678 INFO:teuthology.orchestra.run.smithi064.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 459 kB/s | 42 kB 00:00 2024-08-31T04:11:21.728 INFO:teuthology.orchestra.run.smithi064.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-08-31T04:11:21.787 INFO:teuthology.orchestra.run.smithi064.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-31T04:11:21.837 INFO:teuthology.orchestra.run.smithi064.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-08-31T04:11:21.887 INFO:teuthology.orchestra.run.smithi064.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-08-31T04:11:21.988 INFO:teuthology.orchestra.run.smithi064.stdout:(91/150): postgresql-server-13.16-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-08-31T04:11:22.013 INFO:teuthology.orchestra.run.smithi064.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 305 kB/s | 54 kB 00:00 2024-08-31T04:11:22.105 INFO:teuthology.orchestra.run.smithi064.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-08-31T04:11:22.130 INFO:teuthology.orchestra.run.smithi064.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 377 kB/s | 44 kB 00:00 2024-08-31T04:11:22.176 INFO:teuthology.orchestra.run.smithi132.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 177 kB/s | 137 kB 00:00 2024-08-31T04:11:22.231 INFO:teuthology.orchestra.run.smithi064.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-08-31T04:11:22.256 INFO:teuthology.orchestra.run.smithi064.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 287 kB/s | 36 kB 00:00 2024-08-31T04:11:22.335 INFO:teuthology.orchestra.run.smithi132.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 933 kB/s | 910 kB 00:00 2024-08-31T04:11:22.339 INFO:teuthology.orchestra.run.smithi064.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-08-31T04:11:22.365 INFO:teuthology.orchestra.run.smithi064.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-31T04:11:22.448 INFO:teuthology.orchestra.run.smithi064.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-08-31T04:11:22.473 INFO:teuthology.orchestra.run.smithi064.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-08-31T04:11:22.536 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-31T04:11:22.536 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-31T04:11:22.557 INFO:teuthology.orchestra.run.smithi064.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-08-31T04:11:22.582 INFO:teuthology.orchestra.run.smithi064.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-08-31T04:11:22.660 INFO:teuthology.orchestra.run.smithi132.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-08-31T04:11:22.809 INFO:teuthology.orchestra.run.smithi064.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-08-31T04:11:22.833 INFO:teuthology.orchestra.run.smithi064.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-08-31T04:11:22.883 INFO:teuthology.orchestra.run.smithi064.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-08-31T04:11:22.908 INFO:teuthology.orchestra.run.smithi064.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-08-31T04:11:22.934 INFO:teuthology.orchestra.run.smithi064.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-08-31T04:11:22.957 INFO:teuthology.orchestra.run.smithi064.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-08-31T04:11:22.983 INFO:teuthology.orchestra.run.smithi064.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T04:11:23.008 INFO:teuthology.orchestra.run.smithi064.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T04:11:23.010 INFO:teuthology.orchestra.run.smithi132.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 130 kB/s | 87 kB 00:00 2024-08-31T04:11:23.033 INFO:teuthology.orchestra.run.smithi064.stdout:(111/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-08-31T04:11:23.067 INFO:teuthology.orchestra.run.smithi064.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-08-31T04:11:23.126 INFO:teuthology.orchestra.run.smithi064.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 9.5 MB/s | 548 kB 00:00 2024-08-31T04:11:23.135 INFO:teuthology.orchestra.run.smithi132.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-08-31T04:11:23.151 INFO:teuthology.orchestra.run.smithi064.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T04:11:23.185 INFO:teuthology.orchestra.run.smithi064.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 952 kB/s | 32 kB 00:00 2024-08-31T04:11:23.211 INFO:teuthology.orchestra.run.smithi064.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-08-31T04:11:23.244 INFO:teuthology.orchestra.run.smithi064.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-08-31T04:11:23.270 INFO:teuthology.orchestra.run.smithi064.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-08-31T04:11:23.303 INFO:teuthology.orchestra.run.smithi064.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T04:11:23.337 INFO:teuthology.orchestra.run.smithi064.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-08-31T04:11:23.362 INFO:teuthology.orchestra.run.smithi064.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-31T04:11:23.387 INFO:teuthology.orchestra.run.smithi064.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-31T04:11:23.412 INFO:teuthology.orchestra.run.smithi064.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-08-31T04:11:23.437 INFO:teuthology.orchestra.run.smithi064.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-08-31T04:11:23.463 INFO:teuthology.orchestra.run.smithi064.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-08-31T04:11:23.488 INFO:teuthology.orchestra.run.smithi064.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-08-31T04:11:23.514 INFO:teuthology.orchestra.run.smithi064.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-08-31T04:11:23.589 INFO:teuthology.orchestra.run.smithi064.stdout:(128/150): libarrow-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-08-31T04:11:23.614 INFO:teuthology.orchestra.run.smithi064.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T04:11:23.619 INFO:teuthology.orchestra.run.smithi132.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-08-31T04:11:23.656 INFO:teuthology.orchestra.run.smithi064.stdout:(130/150): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-08-31T04:11:23.681 INFO:teuthology.orchestra.run.smithi064.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-08-31T04:11:23.707 INFO:teuthology.orchestra.run.smithi064.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T04:11:23.732 INFO:teuthology.orchestra.run.smithi064.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-31T04:11:23.766 INFO:teuthology.orchestra.run.smithi064.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-08-31T04:11:23.790 INFO:teuthology.orchestra.run.smithi064.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-08-31T04:11:23.807 INFO:teuthology.orchestra.run.smithi064.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 679 kB/s | 28 kB 00:00 2024-08-31T04:11:23.828 INFO:teuthology.orchestra.run.smithi132.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-08-31T04:11:23.833 INFO:teuthology.orchestra.run.smithi064.stdout:(137/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-08-31T04:11:23.850 INFO:teuthology.orchestra.run.smithi064.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-08-31T04:11:23.867 INFO:teuthology.orchestra.run.smithi064.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-08-31T04:11:23.884 INFO:teuthology.orchestra.run.smithi064.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-08-31T04:11:23.909 INFO:teuthology.orchestra.run.smithi064.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-31T04:11:23.943 INFO:teuthology.orchestra.run.smithi064.stdout:(142/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-31T04:11:23.968 INFO:teuthology.orchestra.run.smithi064.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-08-31T04:11:23.970 INFO:teuthology.orchestra.run.smithi132.stdout:(77/150): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-08-31T04:11:23.993 INFO:teuthology.orchestra.run.smithi064.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-31T04:11:24.027 INFO:teuthology.orchestra.run.smithi064.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-08-31T04:11:24.052 INFO:teuthology.orchestra.run.smithi064.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-08-31T04:11:24.077 INFO:teuthology.orchestra.run.smithi064.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T04:11:24.128 INFO:teuthology.orchestra.run.smithi064.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T04:11:24.295 INFO:teuthology.orchestra.run.smithi064.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.4 MB 00:00 2024-08-31T04:11:24.370 INFO:teuthology.orchestra.run.smithi132.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-08-31T04:11:24.437 INFO:teuthology.orchestra.run.smithi132.stdout:(79/150): python3-jinja2-2.11.3-6.el9.noarch.rp 304 kB/s | 248 kB 00:00 2024-08-31T04:11:24.487 INFO:teuthology.orchestra.run.smithi132.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-08-31T04:11:24.536 INFO:teuthology.orchestra.run.smithi064.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.9 MB/s | 3.1 MB 00:00 2024-08-31T04:11:24.543 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:11:24.543 INFO:teuthology.orchestra.run.smithi064.stdout:Total 12 MB/s | 224 MB 00:18 2024-08-31T04:11:24.987 INFO:teuthology.orchestra.run.smithi132.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-08-31T04:11:25.096 INFO:teuthology.orchestra.run.smithi132.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-08-31T04:11:25.604 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-08-31T04:11:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-08-31T04:11:25.742 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-08-31T04:11:25.743 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-08-31T04:11:25.838 INFO:teuthology.orchestra.run.smithi132.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 295 kB/s | 250 kB 00:00 2024-08-31T04:11:25.889 INFO:teuthology.orchestra.run.smithi132.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 281 kB/s | 222 kB 00:00 2024-08-31T04:11:26.264 INFO:teuthology.orchestra.run.smithi132.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-08-31T04:11:26.497 INFO:teuthology.orchestra.run.smithi132.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-08-31T04:11:26.682 INFO:teuthology.orchestra.run.smithi132.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 340 kB/s | 269 kB 00:00 2024-08-31T04:11:27.040 INFO:teuthology.orchestra.run.smithi132.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-08-31T04:11:27.291 INFO:teuthology.orchestra.run.smithi132.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-08-31T04:11:27.316 INFO:teuthology.orchestra.run.smithi132.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 344 kB/s | 279 kB 00:00 2024-08-31T04:11:27.591 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-08-31T04:11:27.592 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-08-31T04:11:27.641 INFO:teuthology.orchestra.run.smithi132.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-08-31T04:11:27.942 INFO:teuthology.orchestra.run.smithi132.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-08-31T04:11:28.235 INFO:teuthology.orchestra.run.smithi132.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 74 kB/s | 44 kB 00:00 2024-08-31T04:11:28.574 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-31T04:11:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:11:28.827 INFO:teuthology.orchestra.run.smithi132.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-31T04:11:28.852 INFO:teuthology.orchestra.run.smithi132.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 58 kB/s | 36 kB 00:00 2024-08-31T04:11:28.886 INFO:teuthology.orchestra.run.smithi132.stdout:(97/150): qatlib-24.02.0-1.el9.x86_64.rpm 234 kB/s | 221 kB 00:00 2024-08-31T04:11:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:11:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:11:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:11:29.403 INFO:teuthology.orchestra.run.smithi132.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-31T04:11:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:29.503 INFO:teuthology.orchestra.run.smithi132.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-08-31T04:11:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:29.637 INFO:teuthology.orchestra.run.smithi132.stdout:(100/150): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-08-31T04:11:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:11:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:11:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:11:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:11:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:11:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:30.095 INFO:teuthology.orchestra.run.smithi132.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 138 kB/s | 96 kB 00:00 2024-08-31T04:11:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:30.129 INFO:teuthology.orchestra.run.smithi132.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-08-31T04:11:30.179 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:30.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:30.204 INFO:teuthology.orchestra.run.smithi132.stdout:(103/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-08-31T04:11:30.225 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:30.229 INFO:teuthology.orchestra.run.smithi132.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-08-31T04:11:30.296 INFO:teuthology.orchestra.run.smithi132.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-08-31T04:11:30.313 INFO:teuthology.orchestra.run.smithi132.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-08-31T04:11:30.347 INFO:teuthology.orchestra.run.smithi132.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-08-31T04:11:30.364 INFO:teuthology.orchestra.run.smithi132.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-08-31T04:11:30.380 INFO:teuthology.orchestra.run.smithi132.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-08-31T04:11:30.423 INFO:teuthology.orchestra.run.smithi132.stdout:(110/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-08-31T04:11:30.448 INFO:teuthology.orchestra.run.smithi132.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-08-31T04:11:30.472 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:30.508 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:11:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:11:30.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:11:30.707 INFO:teuthology.orchestra.run.smithi132.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 533 kB/s | 151 kB 00:00 2024-08-31T04:11:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:11:30.790 INFO:teuthology.orchestra.run.smithi132.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.4 MB/s | 839 kB 00:00 2024-08-31T04:11:30.818 INFO:teuthology.orchestra.run.smithi132.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.6 MB/s | 43 kB 00:00 2024-08-31T04:11:30.819 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:11:30.843 INFO:teuthology.orchestra.run.smithi132.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T04:11:30.859 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:11:30.868 INFO:teuthology.orchestra.run.smithi132.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-08-31T04:11:30.902 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:11:30.902 INFO:teuthology.orchestra.run.smithi132.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-08-31T04:11:30.927 INFO:teuthology.orchestra.run.smithi132.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-31T04:11:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:11:30.962 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:11:30.969 INFO:teuthology.orchestra.run.smithi132.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-08-31T04:11:31.028 INFO:teuthology.orchestra.run.smithi132.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-08-31T04:11:31.037 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:11:31.094 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:11:31.095 INFO:teuthology.orchestra.run.smithi132.stdout:(121/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-08-31T04:11:31.120 INFO:teuthology.orchestra.run.smithi132.stdout:(122/150): python3-google-auth-2.34.0-1.el9.noa 1.4 MB/s | 220 kB 00:00 2024-08-31T04:11:31.131 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:11:31.145 INFO:teuthology.orchestra.run.smithi132.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-31T04:11:31.171 INFO:teuthology.orchestra.run.smithi132.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-08-31T04:11:31.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:11:31.196 INFO:teuthology.orchestra.run.smithi132.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-31T04:11:31.221 INFO:teuthology.orchestra.run.smithi132.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-31T04:11:31.247 INFO:teuthology.orchestra.run.smithi132.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-31T04:11:31.256 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:11:31.272 INFO:teuthology.orchestra.run.smithi132.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-31T04:11:31.295 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:11:31.297 INFO:teuthology.orchestra.run.smithi132.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T04:11:31.330 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:11:31.331 INFO:teuthology.orchestra.run.smithi132.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-31T04:11:31.358 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:11:31.364 INFO:teuthology.orchestra.run.smithi132.stdout:(131/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-08-31T04:11:31.390 INFO:teuthology.orchestra.run.smithi132.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-08-31T04:11:31.415 INFO:teuthology.orchestra.run.smithi132.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-08-31T04:11:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:11:31.440 INFO:teuthology.orchestra.run.smithi132.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-08-31T04:11:31.474 INFO:teuthology.orchestra.run.smithi132.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-31T04:11:31.481 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:11:31.499 INFO:teuthology.orchestra.run.smithi132.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-08-31T04:11:31.524 INFO:teuthology.orchestra.run.smithi132.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-08-31T04:11:31.550 INFO:teuthology.orchestra.run.smithi132.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T04:11:31.560 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:11:31.575 INFO:teuthology.orchestra.run.smithi132.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-31T04:11:31.601 INFO:teuthology.orchestra.run.smithi132.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-31T04:11:31.626 INFO:teuthology.orchestra.run.smithi132.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T04:11:31.660 INFO:teuthology.orchestra.run.smithi132.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-31T04:11:31.685 INFO:teuthology.orchestra.run.smithi132.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-31T04:11:31.706 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:11:31.752 INFO:teuthology.orchestra.run.smithi132.stdout:(144/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-08-31T04:11:31.776 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:11:31.777 INFO:teuthology.orchestra.run.smithi132.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2024-08-31T04:11:31.803 INFO:teuthology.orchestra.run.smithi132.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T04:11:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-08-31T04:11:31.886 INFO:teuthology.orchestra.run.smithi132.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T04:11:32.170 INFO:teuthology.orchestra.run.smithi132.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-08-31T04:11:32.343 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:11:32.389 INFO:teuthology.orchestra.run.smithi132.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 5.8 MB/s | 3.4 MB 00:00 2024-08-31T04:11:32.394 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:11:32.394 INFO:teuthology.orchestra.run.smithi132.stdout:Total 9.0 MB/s | 224 MB 00:24 2024-08-31T04:11:32.424 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:11:32.459 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:11:32.502 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:11:32.541 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:11:32.574 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:11:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:11:32.739 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:11:32.814 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:11:32.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:11:32.886 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:11:32.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:11:32.969 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:11:33.013 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:11:33.054 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:11:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:11:33.239 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:11:33.281 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:11:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:11:33.422 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:11:33.462 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:11:33.487 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:11:33.497 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-08-31T04:11:33.511 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:11:33.590 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:11:33.625 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-08-31T04:11:33.625 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-08-31T04:11:33.665 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-08-31T04:11:33.728 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:11:33.748 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:11:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:11:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:11:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:11:33.842 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:11:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:11:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:11:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:11:33.974 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:11:34.008 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:11:34.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:11:34.080 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:11:34.084 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:11:34.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:11:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:11:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:11:34.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:11:34.518 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:11:34.593 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:11:34.632 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:34.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:11:34.746 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:34.774 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:34.851 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:34.892 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:11:34.921 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:11:34.946 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:11:35.106 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:11:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:11:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:35.297 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:35.331 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-08-31T04:11:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-08-31T04:11:35.393 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:35.415 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:35.436 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:35.439 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:11:35.486 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:11:35.536 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:11:35.642 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:11:35.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:11:35.731 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:35.746 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:11:35.765 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:35.836 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:11:35.872 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:11:35.878 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:11:35.905 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:11:35.941 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:11:36.017 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:11:36.061 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:11:36.076 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:11:36.094 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:11:36.124 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:11:36.167 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:11:36.173 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:11:36.200 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:11:36.227 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:11:36.300 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:11:36.360 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:11:36.388 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:11:36.441 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:11:36.529 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:11:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:11:36.620 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:11:36.648 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:11:36.722 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:11:36.772 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:11:36.850 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:11:36.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:11:36.996 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:11:37.047 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:11:37.059 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:11:37.623 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:11:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:11:37.751 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:11:37.794 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:11:37.832 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:11:37.865 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:11:37.969 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:11:38.039 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:11:38.150 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:11:38.187 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:11:38.234 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:11:38.269 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:11:38.313 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:11:38.364 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:11:38.369 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:11:38.456 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:11:38.484 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:11:38.517 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:11:38.557 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:11:38.598 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:11:38.706 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:11:38.739 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:11:38.780 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:11:38.805 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:11:38.830 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:11:38.861 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:11:38.905 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:38.908 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:11:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:11:39.047 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:11:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:11:39.096 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:11:39.123 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:11:39.166 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:11:39.212 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:11:39.249 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:11:39.288 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:11:39.318 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:11:39.352 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:11:39.386 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:11:39.436 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:11:39.479 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:11:39.569 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:11:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:11:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:39.618 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:11:39.648 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:11:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:11:39.767 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:11:39.818 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:11:40.598 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:11:40.689 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:11:40.722 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:11:40.827 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:11:40.878 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:11:40.949 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:11:41.048 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:11:41.083 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:11:41.285 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:11:41.315 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:11:41.396 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:11:41.480 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-08-31T04:11:41.564 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:11:41.598 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:11:41.641 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:11:41.983 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:11:42.084 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:42.085 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:11:42.090 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:42.201 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:11:42.211 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:11:42.233 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:11:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:11:42.413 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:11:42.438 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:11:42.593 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:11:42.644 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:11:42.672 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:42.778 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:11:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:11:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:11:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:42.860 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:11:42.882 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:11:42.906 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:11:43.220 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:43.257 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:11:43.375 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:11:43.407 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:11:43.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:11:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:11:43.532 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:11:43.592 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:11:43.611 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:11:43.632 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:11:43.648 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:11:43.681 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:11:43.684 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:11:43.725 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:11:43.753 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:11:43.825 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:11:43.876 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:11:43.914 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:11:43.958 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:11:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:11:44.037 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:11:44.085 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:11:44.093 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:44.128 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:11:44.157 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:11:44.186 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:44.215 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:11:44.230 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:11:44.251 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:11:44.273 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:11:44.348 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:11:44.494 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:11:44.550 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:11:44.796 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:11:44.830 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:44.885 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:44.915 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:11:45.091 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:11:45.180 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:11:45.224 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:11:45.267 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:11:45.305 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:11:45.337 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:11:45.431 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:11:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:11:45.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:11:45.607 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:11:45.643 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:11:45.690 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:11:45.726 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:11:45.769 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:11:45.811 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:11:45.950 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:11:46.004 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:11:46.045 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:11:46.150 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:11:46.201 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:11:46.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:11:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:11:46.278 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:11:46.353 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:11:46.481 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:11:46.518 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:11:46.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:11:46.581 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:11:46.625 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:11:46.671 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:11:46.702 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:11:46.732 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:11:46.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:11:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:11:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:11:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:11:46.981 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:11:47.040 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:11:47.071 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:11:47.177 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:11:47.231 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:11:47.305 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:47.344 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:47.955 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:47.968 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:11:48.014 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:48.019 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:11:48.053 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:11:48.107 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:48.107 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:11:48.107 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:11:48.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:11:48.140 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:11:48.154 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:11:48.203 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:11:48.247 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:11:48.338 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:11:48.384 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:11:48.568 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:11:48.589 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:11:48.667 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:11:49.325 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:11:49.449 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:11:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:11:50.810 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:11:50.838 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:11:50.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:11:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:11:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:51.334 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:11:51.364 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:11:51.401 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:11:51.900 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:11:51.945 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:52.017 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:11:52.047 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:11:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:54.377 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:54.951 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:11:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:55.099 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:11:55.100 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:11:55.100 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:11:55.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:11:55.140 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:11:55.251 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:11:55.251 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-08-31T04:11:55.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:55.431 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:11:55.446 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:11:55.446 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:11:55.447 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:11:55.447 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:11:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:11:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:57.861 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:11:57.884 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:11:57.884 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:11:57.885 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:11:57.885 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:11:57.885 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:11:57.885 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:11:57.992 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:11:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:11:58.114 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:11:58.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:11:58.363 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:11:58.445 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:11:58.533 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:11:58.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:11:58.722 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:11:58.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:11:58.780 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:11:59.219 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:11:59.246 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:11:59.278 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:11:59.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:11:59.393 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:00.250 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:12:00.250 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-08-31T04:12:00.251 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:00.439 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:12:00.454 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:12:00.454 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:00.454 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:12:00.454 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:02.133 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:12:02.160 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:02.409 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:12:02.431 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:12:02.431 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:02.432 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:12:02.432 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:12:02.432 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:12:02.432 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:02.745 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:02.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:02.926 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:12:02.949 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:12:03.117 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:12:03.180 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:12:03.375 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:12:03.421 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:12:03.501 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:12:03.590 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:12:03.733 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:12:03.771 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:12:03.802 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:12:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:03.830 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:12:03.841 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:03.963 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:04.141 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:12:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:04.192 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:04.244 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:04.255 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:04.277 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:12:04.303 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:12:04.336 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:12:04.358 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:12:04.405 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:12:04.409 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:12:04.435 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:05.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:12:05.454 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:05.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:05.530 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:05.553 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:05.553 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:05.553 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:12:05.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:05.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:05.628 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:05.628 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:05.628 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:12:05.628 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:05.629 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:05.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:05.957 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:05.979 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:05.979 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:05.980 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:12:05.980 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:05.980 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:05.980 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:07.129 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:12:07.129 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-08-31T04:12:07.129 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-08-31T04:12:07.130 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:07.298 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:12:07.315 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:12:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:12:07.315 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:07.849 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:07.907 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:08.926 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:12:08.940 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:08.953 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:12:08.953 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:08.954 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:12:08.954 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:12:08.954 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:12:08.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:08.974 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:12:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:09.270 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:12:09.301 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:09.324 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:09.324 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:09.325 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:12:09.325 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:09.325 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:09.325 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:09.369 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:09.379 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:09.485 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:12:09.535 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:12:09.663 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:12:09.687 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:12:09.687 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:09.687 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:12:09.687 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:12:09.687 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:12:09.688 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:09.794 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:12:09.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:12:09.906 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:12:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:12:10.148 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:12:10.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:12:10.316 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:12:10.457 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:12:10.500 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:12:10.532 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:12:10.560 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:12:10.569 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:12:10.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:12:10.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:12:10.604 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:10.628 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:10.628 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:10.628 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:12:10.628 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:10.629 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:10.629 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:10.643 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:12:10.672 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:10.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:12:10.694 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:10.694 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:10.694 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:12:10.694 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:10.701 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:12:10.739 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:10.761 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:10.761 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:10.761 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:12:10.762 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:10.762 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:10.762 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:12:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:12:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:12:10.990 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:12:11.017 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:12:11.049 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:12:11.098 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:11.120 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:11.121 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:11.121 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:12:11.121 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:11.121 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:11.121 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:11.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:12:11.157 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:12:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:12:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:12:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:12:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:12:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:14.338 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:12:14.396 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:15.358 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:12:15.388 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:15.501 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:12:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:12:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:12:15.731 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:15.782 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:15.794 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:12:15.819 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:12:15.861 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:12:15.893 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:12:15.901 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:12:15.933 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:12:15.938 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:12:15.960 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:12:16.152 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:12:16.206 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:12:16.236 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:12:16.877 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:16.909 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:12:16.916 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:16.936 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:16.944 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:12:16.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:17.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:17.034 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:12:17.034 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:17.034 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:12:17.034 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:17.086 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:12:17.110 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:17.429 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:12:17.452 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:17.810 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:12:17.946 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:12:17.988 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:12:18.074 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:12:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:12:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:18.186 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:18.186 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:19.294 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:19.294 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:12:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:12:19.296 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:12:19.297 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:12:19.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:12:19.299 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:12:19.300 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:12:19.301 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:12:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:12:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:12:19.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:12:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:12:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:12:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:12:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:12:21.543 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:21.543 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.544 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:12:21.546 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:12:21.547 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:12:21.548 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:12:21.549 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:12:21.550 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:12:21.551 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:12:21.552 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:12:21.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:12:21.555 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:12:21.556 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:12:21.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:12:21.556 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-31T04:12:21.816 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:12:21.857 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:12:21.878 DEBUG:teuthology.parallel:result is None 2024-08-31T04:12:21.898 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:12:21.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:12:21.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:12:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:12:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:12:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:12:22.850 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:22.890 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:22.911 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:12:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:12:23.821 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:12:23.861 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:12:23.951 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:12:23.992 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:12:23.992 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:24.075 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:12:24.075 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:12:24.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:12:24.911 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:12:24.912 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:12:24.923 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:12:24.924 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:12:24.925 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:12:24.926 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:12:24.927 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:12:24.928 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:12:24.929 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:12:24.930 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:12:24.931 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:12:24.932 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:12:24.933 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:12:24.934 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:12:27.158 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:27.158 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:27.158 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-08-31T04:12:27.158 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.159 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.160 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:12:27.161 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:12:27.162 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:12:27.163 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:12:27.164 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:12:27.165 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:12:27.166 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:12:27.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.168 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:12:27.169 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:12:27.170 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:12:27.171 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:12:27.171 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:12:27.171 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:12:27.171 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-08-31T04:12:27.478 DEBUG:teuthology.parallel:result is None 2024-08-31T04:12:31.145 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:12:31.146 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:12:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:12:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:12:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:12:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:12:31.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:12:31.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:12:31.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:12:31.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:12:31.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:12:31.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:12:31.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:12:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:12:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:12:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:33.441 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:12:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:12:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:12:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:12:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:12:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:12:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:12:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:12:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:12:33.454 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-08-31T04:12:33.762 DEBUG:teuthology.parallel:result is None 2024-08-31T04:12:33.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:33.905 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:12:33.932 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:33.933 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:33.933 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:12:33.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:34.070 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:12:34.096 INFO:teuthology.orchestra.run.smithi064.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:34.096 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:34.096 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:12:34.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:34.230 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:12:34.252 INFO:teuthology.orchestra.run.smithi132.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:34.252 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:12:34.252 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:12:34.254 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T04:12:34.255 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:12:34.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:12:34.287 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:12:34.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:12:34.319 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:12:34.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:12:34.345 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T04:12:34.346 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:12:34.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:12:34.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:12:34.441 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:12:34.441 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:12:34.471 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:12:34.540 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:12:34.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:12:34.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:12:34.630 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T04:12:34.630 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:12:34.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:12:34.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:12:34.720 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:12:34.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:12:34.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:12:34.821 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:12:34.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:12:34.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:12:34.910 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T04:12:34.911 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:12:34.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:12:34.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:12:35.000 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:12:35.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:12:35.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:12:35.098 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:12:35.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:12:35.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:12:35.187 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T04:12:35.294 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-08-31T04:12:35.294 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:35.295 INFO:tasks.cephadm:Cluster fsid is 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:35.295 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T04:12:35.295 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.64', 'mon.c': '172.21.15.132'} 2024-08-31T04:12:35.295 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-08-31T04:12:35.296 INFO:tasks.cephadm:First mgr is x 2024-08-31T04:12:35.296 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T04:12:35.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-08-31T04:12:35.321 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname $(hostname -s) 2024-08-31T04:12:35.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname $(hostname -s) 2024-08-31T04:12:35.374 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T04:12:35.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:35.518 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T04:12:35.653 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:35.655 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T04:12:35.655 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T04:12:35.655 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:36.364 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:12 /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:36.365 DEBUG:teuthology.orchestra.run.smithi064:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:36.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:12 /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:36.973 DEBUG:teuthology.orchestra.run.smithi132:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:37.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:12 /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:37.614 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:37.633 DEBUG:teuthology.orchestra.run.smithi064:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:37.652 DEBUG:teuthology.orchestra.run.smithi132:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:12:37.689 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T04:12:37.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:12:37.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:12:37.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:12:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:12:39.367 INFO:teuthology.orchestra.run.smithi132.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:12:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:14:06.768 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:14:06.769 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:14:10.147 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-08-31T04:14:10.147 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:14:10.147 INFO:teuthology.orchestra.run.smithi132.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:14:10.148 INFO:teuthology.orchestra.run.smithi132.stdout: "repo_digests": [ 2024-08-31T04:14:10.148 INFO:teuthology.orchestra.run.smithi132.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:14:10.148 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-08-31T04:14:10.148 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout: "repo_digests": [ 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-08-31T04:14:26.142 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-08-31T04:14:26.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-08-31T04:14:26.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph 2024-08-31T04:14:26.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph 2024-08-31T04:14:26.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-08-31T04:14:26.307 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /etc/ceph 2024-08-31T04:14:26.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /etc/ceph 2024-08-31T04:14:26.363 INFO:tasks.cephadm:Writing seed config... 2024-08-31T04:14:26.364 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-31T04:14:26.364 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-08-31T04:14:26.364 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T04:14:26.365 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T04:14:26.366 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-31T04:14:26.367 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:14:26.367 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T04:14:26.384 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4070480a-674f-11ef-bcd4-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-08-31T04:14:26.385 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T04:14:26.427 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T04:14:26.470 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T04:14:26.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:14:26.682 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:14:26.682 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-08-31T04:14:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T04:14:26.683 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-08-31T04:14:26.707 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-08-31T04:14:26.707 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-08-31T04:14:26.707 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-08-31T04:14:26.714 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T04:14:26.714 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T04:14:26.721 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T04:14:26.721 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:14:26.727 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-08-31T04:14:26.734 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-08-31T04:14:26.734 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-08-31T04:14:26.734 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-08-31T04:14:26.756 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-08-31T04:14:26.756 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T04:14:26.756 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-08-31T04:14:26.756 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-08-31T04:14:26.762 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T04:14:26.762 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T04:14:26.768 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T04:14:26.768 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:14:26.775 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-08-31T04:14:26.781 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-08-31T04:14:26.781 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-08-31T04:14:26.781 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-08-31T04:14:26.781 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:26.781 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140247806329904 on /run/cephadm/4070480a-674f-11ef-bcd4-c7b262605968.lock 2024-08-31T04:14:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140247806329904 acquired on /run/cephadm/4070480a-674f-11ef-bcd4-c7b262605968.lock 2024-08-31T04:14:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-08-31T04:14:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-08-31T04:14:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-08-31T04:14:26.785 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-08-31T04:14:26.785 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-08-31T04:14:26.788 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T04:14:26.788 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-31T04:14:26.788 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-31T04:14:26.790 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T04:14:26.790 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::6f05:b039:a4ec:1f10/64 scope link noprefixroute 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-08-31T04:14:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-08-31T04:14:26.792 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T04:14:26.792 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T04:14:26.792 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:14:27.226 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T04:14:27.226 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:14:27.227 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T04:14:27.227 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T04:14:27.227 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T04:14:27.227 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T04:14:27.227 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T04:14:28.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:14:28.097 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:14:28.097 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T04:14:29.061 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-08-31T04:14:29.061 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-08-31T04:14:29.911 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQClmNJmO2ulFBAARxe04HO+SUD92988P9jZLA== 2024-08-31T04:14:34.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQCmmNJmGPrODRAAwtxatVdakRBH1uUAaocygQ== 2024-08-31T04:14:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQCtmNJmbazZFxAANWhbR900yFXo/mfA/ieH8w== 2024-08-31T04:14:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-08-31T04:14:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T04:14:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:14:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-08-31T04:14:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-08-31T04:14:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T04:14:45.371 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T04:14:45.541 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target. 2024-08-31T04:14:45.542 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target. 2024-08-31T04:14:45.772 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a 2024-08-31T04:14:45.772 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T04:14:45.934 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target.wants/ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968@.service. 2024-08-31T04:14:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:46 smithi002 podman[18269]: 2024-08-31 04:14:46.362994064 +0000 UTC m=+0.312858199 container start 216e80612d5fdbf585674413b2e3fa1c012f8322f28ebb1e08914492d27d3088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:14:46.457 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:14:46.457 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-08-31T04:14:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:14:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:14:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-08-31T04:14:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T04:14:46.465 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-08-31T04:14:46.465 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-08-31T04:14:46.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:46 smithi002 ceph-mon[18288]: mkfs 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:46.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:46 smithi002 ceph-mon[18288]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:14:46.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:46 smithi002 bash[18269]: 216e80612d5fdbf585674413b2e3fa1c012f8322f28ebb1e08914492d27d3088 2024-08-31T04:14:46.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:46 smithi002 systemd[1]: Started Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:47.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.505003s) 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-08-31T04:14:47.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-08-31T04:14:47.380 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T04:14:47.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:14:47.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: monmap epoch 1 2024-08-31T04:14:47.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: last_changed 2024-08-31T04:14:43.552151+0000 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: min_mon_release 19 (squid) 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: election_strategy: 1 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: fsmap 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: mgrmap e1: no daemons active 2024-08-31T04:14:47.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:47 smithi002 ceph-mon[18288]: from='client.? 172.21.15.2:0/2875663778' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T04:14:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T04:14:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T04:14:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T04:14:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-08-31T04:14:48.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:48 smithi002 ceph-mon[18288]: from='client.? 172.21.15.2:0/967407347' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T04:14:48.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:48 smithi002 ceph-mon[18288]: from='client.? 172.21.15.2:0/967407347' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T04:14:49.398 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-08-31T04:14:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:49 smithi002 ceph-mon[18288]: from='client.? 172.21.15.2:0/207123655' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:49 smithi002 systemd[1]: Stopping Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:14:50.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a[18284]: 2024-08-31T04:14:49.664+0000 7f95e273b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:14:50.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a[18284]: 2024-08-31T04:14:49.664+0000 7f95e273b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T04:14:50.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:49 smithi002 podman[18532]: 2024-08-31 04:14:49.848717081 +0000 UTC m=+0.278231044 container died 216e80612d5fdbf585674413b2e3fa1c012f8322f28ebb1e08914492d27d3088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:14:50.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 podman[18532]: 2024-08-31 04:14:50.155679622 +0000 UTC m=+0.585193620 container cleanup 216e80612d5fdbf585674413b2e3fa1c012f8322f28ebb1e08914492d27d3088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T04:14:50.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 bash[18532]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a 2024-08-31T04:14:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 podman[18544]: 2024-08-31 04:14:50.323124936 +0000 UTC m=+0.475007540 container remove 216e80612d5fdbf585674413b2e3fa1c012f8322f28ebb1e08914492d27d3088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T04:14:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T04:14:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 systemd[1]: Stopped Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 systemd[1]: Starting Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:14:51.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 podman[18637]: 2024-08-31 04:14:50.563867652 +0000 UTC m=+0.015734905 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:14:51.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:50 smithi002 podman[18637]: 2024-08-31 04:14:50.66567118 +0000 UTC m=+0.117538496 container create 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:14:51.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 podman[18637]: 2024-08-31 04:14:51.001219021 +0000 UTC m=+0.453086275 container init 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:14:51.089 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T04:14:51.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 podman[18637]: 2024-08-31 04:14:51.004318925 +0000 UTC m=+0.456186179 container start 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:14:51.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T04:14:51.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T04:14:51.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: pidfile_write: ignore empty --pid-file 2024-08-31T04:14:51.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: load: jerasure load: lrc 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: RocksDB version: 7.9.2 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Git sha 0 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: DB SUMMARY 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: DB Session ID: VYAASIZJUKP5WD9JUPIZ 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: CURRENT file: CURRENT 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T04:14:51.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94417 ; 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.error_if_exists: 0 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.create_if_missing: 0 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.paranoid_checks: 1 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.env: 0x564d137d95a0 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.info_log: 0x564d1870b4e0 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T04:14:51.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.statistics: (nil) 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.use_fsync: 0 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_log_file_size: 0 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T04:14:51.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_fallocate: 1 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.use_direct_reads: 0 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.db_log_dir: 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.wal_dir: 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T04:14:51.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.write_buffer_manager: 0x564d1870f5e0 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T04:14:51.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.unordered_write: 0 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.row_cache: None 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.wal_filter: None 2024-08-31T04:14:51.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.two_write_queues: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.wal_compression: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.atomic_flush: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.log_readahead_size: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T04:14:51.323 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_background_jobs: 2 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_background_compactions: -1 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_subcompactions: 1 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T04:14:51.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_open_files: -1 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_background_flushes: -1 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Compression algorithms supported: 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kZSTD supported: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kXpressCompression supported: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kBZip2Compression supported: 0 2024-08-31T04:14:51.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kLZ4Compression supported: 1 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kZlibCompression supported: 1 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: kSnappyCompression supported: 1 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.merge_operator: 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_filter: None 2024-08-31T04:14:51.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d1870b100) 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T04:14:51.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x564d146ce850 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-08-31T04:14:51.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-08-31T04:14:51.329 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression: NoCompression 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.num_levels: 7 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T04:14:51.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T04:14:51.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T04:14:51.332 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T04:14:51.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.inplace_update_support: 0 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T04:14:51.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.bloom_locality: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.max_successive_merges: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.ttl: 2592000 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T04:14:51.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enable_blob_files: false 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.min_blob_size: 0 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T04:14:51.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 656f0284-333b-448c-b60d-60f5c9848b08 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077691040778, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077691041870, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 280, "table_properties": {"data_size": 88688, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11496, "raw_average_key_size": 48, "raw_value_size": 82203, "raw_average_value_size": 343, "num_data_blocks": 12, "num_entries": 239, "num_filter_entries": 239, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725077691, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "656f0284-333b-448c-b60d-60f5c9848b08", "db_session_id": "VYAASIZJUKP5WD9JUPIZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077691041977, "job": 1, "event": "recovery_finished"} 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564d1872ea80 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: DB pointer 0x564d194d0000 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-08-31T04:14:51.337 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 90.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 90.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:14:51.338 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T04:14:51.339 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 25.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 25.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x564d146ce850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???) e1 preinit fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).mds e1 new map 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).mds e1 print_map 2024-08-31T04:14:51.340 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-08-31T04:14:46:409940+0000 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T04:14:51.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 bash[18637]: 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 systemd[1]: Started Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: monmap epoch 1 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: last_changed 2024-08-31T04:14:43.552151+0000 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: election_strategy: 1 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: fsmap 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T04:14:51.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:51 smithi002 ceph-mon[18656]: mgrmap e1: no daemons active 2024-08-31T04:14:52.143 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T04:14:52.165 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:14:52.165 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-08-31T04:14:52.166 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T04:14:52.166 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T04:14:52.418 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T04:14:52.418 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T04:14:52.570 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968.target.wants/ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4070480a-674f-11ef-bcd4-c7b262605968@.service. 2024-08-31T04:14:52.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:52 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4245629157' entity='client.admin' 2024-08-31T04:14:53.071 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:14:52 smithi002 podman[18867]: 2024-08-31 04:14:52.997265898 +0000 UTC m=+0.312327637 container start 9f6b9dc37523b7079a09420b3c6736e1c1f522aa1b8b2ce9fa1b614e3586e71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T04:14:53.071 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:14:53 smithi002 bash[18867]: 9f6b9dc37523b7079a09420b3c6736e1c1f522aa1b8b2ce9fa1b614e3586e71b 2024-08-31T04:14:53.085 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:14:53.085 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-08-31T04:14:53.092 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:14:53.092 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:14:53.092 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-08-31T04:14:53.092 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T04:14:53.101 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:14:53.101 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-08-31T04:14:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:14:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:14:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-08-31T04:14:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T04:14:53.109 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-08-31T04:14:53.109 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-08-31T04:14:53.331 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:14:53 smithi002 systemd[1]: Started Ceph mgr.x for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:53.893 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:53 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1402916312' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:14:54.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:54.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:14:54.141 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-31T04:14:54.142 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:14:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:14:54.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:14:46:409940+0000", 2024-08-31T04:14:54.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:14:54.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:14:46.410720+0000", 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:14:54.149 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-08-31T04:14:56.891 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:56 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2082695782' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:14:57.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:14:57.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:14:57.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:14:57.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:14:57.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:57.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:14:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:14:57.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:14:57.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:14:46:409940+0000", 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:14:57.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:14:46.410720+0000", 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:14:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-08-31T04:14:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: Activating manager daemon x 2024-08-31T04:14:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: mgrmap e2: x(active, starting, since 0.00330054s) 2024-08-31T04:14:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:14:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:14:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: Manager daemon x is now available 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' 2024-08-31T04:14:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:14:58 smithi002 ceph-mon[18656]: from='mgr.14100 172.21.15.2:0/677322732' entity='mgr.x' 2024-08-31T04:15:00.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:15:00.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:15:00.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:15:00.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:15:00.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:14:46:409940+0000", 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:15:00.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:15:00.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:15:00.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:15:00.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:15:00.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:14:46.410720+0000", 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:15:00.394 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-08-31T04:15:00.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:00 smithi002 ceph-mon[18656]: mgrmap e3: x(active, since 1.00797s) 2024-08-31T04:15:00.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:00 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/817137045' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:15:01.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:01 smithi002 ceph-mon[18656]: mgrmap e4: x(active, since 2s) 2024-08-31T04:15:01.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:01 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/945132859' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T04:15:01.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T04:15:01.458 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-08-31T04:15:02.518 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3917691617' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T04:15:02.519 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setuser ceph since I am not root 2024-08-31T04:15:02.519 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setgroup ceph since I am not root 2024-08-31T04:15:03.438 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3917691617' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T04:15:03.438 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:03 smithi002 ceph-mon[18656]: mgrmap e5: x(active, since 4s) 2024-08-31T04:15:04.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-08-31T04:15:04.027 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-08-31T04:15:04.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:04 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2334565453' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T04:15:07.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: Active manager daemon x restarted 2024-08-31T04:15:07.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: Activating manager daemon x 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: mgrmap e6: x(active, starting, since 0.00366194s) 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:15:07.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:07 smithi002 ceph-mon[18656]: Manager daemon x is now available 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-08-31T04:15:09.024 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-08-31T04:15:09.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: mgrmap e7: x(active, since 1.00588s) 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: Found migration_current of "None". Setting to last migration. 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:15:09.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:09 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:15:10.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:10 smithi002 ceph-mon[18656]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:10.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:10 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:10.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:10 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:10.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:10 smithi002 ceph-mon[18656]: mgrmap e8: x(active, since 2s) 2024-08-31T04:15:11.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T04:15:11.436 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-mon[18656]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:11] ENGINE Bus STARTING 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:15:11.472+0000 7fec8b7cd640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:04:15:11] ENGINE Error in HTTPServer.serve 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Traceback (most recent call last): 2024-08-31T04:15:11.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._connections.run(self.expiration_interval) 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._run(expiration_interval) 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s = self.context.wrap_socket( 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: return self.sslsocket_class._create( 2024-08-31T04:15:11.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:15:11.686 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self.do_handshake() 2024-08-31T04:15:11.686 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:15:11.686 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._sslobj.do_handshake() 2024-08-31T04:15:11.686 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:15:11.686 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:15:12.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:11] ENGINE Serving on http://172.21.15.2:8765 2024-08-31T04:15:12.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:11] ENGINE Serving on https://172.21.15.2:7150 2024-08-31T04:15:12.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:11] ENGINE Bus STARTED 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:11] ENGINE Error in HTTPServer.serve 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-08-31T04:15:12.682 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: Generating ssh key... 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Generating public/private rsa key pair. 2024-08-31T04:15:12.683 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Your identification has been saved in /tmp/tmp2lzcgpz2/key 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Your public key has been saved in /tmp/tmp2lzcgpz2/key.pub 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: The key fingerprint is: 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: SHA256:LfUXl0mIWca+eGOEHYT0kpd0ZCpWM5Uk+bt22yuPjNQ ceph-4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: The key's randomart image is: 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: +---[RSA 3072]----+ 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | ..BX*B.| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | +*=X.o| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | .=+=+o.| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | o.o++ + | 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | S . + o .| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | . ..* . | 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | .oE. .| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | . o..oo| 2024-08-31T04:15:12.684 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: | . o++=| 2024-08-31T04:15:12.685 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: +----[SHA256]-----+ 2024-08-31T04:15:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:15:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T04:15:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-08-31T04:15:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:14 smithi002 ceph-mon[18656]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:15.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:15 smithi002 ceph-mon[18656]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:16.490 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:16 smithi002 ceph-mon[18656]: Deploying cephadm binary to smithi002 2024-08-31T04:15:18.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-08-31T04:15:18.973 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-08-31T04:15:19.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:19 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:19.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:19 smithi002 ceph-mon[18656]: Added host smithi002 2024-08-31T04:15:19.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:19 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:21.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:20 smithi002 ceph-mon[18656]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:21.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:20 smithi002 ceph-mon[18656]: Saving service mon spec with placement count:5 2024-08-31T04:15:21.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:20 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:21.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:20 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:21.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T04:15:21.296 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-08-31T04:15:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:22 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:22 smithi002 ceph-mon[18656]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:22 smithi002 ceph-mon[18656]: Saving service mgr spec with placement count:2 2024-08-31T04:15:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:22 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:22.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T04:15:24.587 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:24 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2241668521' entity='client.admin' 2024-08-31T04:15:24.587 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:24 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:25.193 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-08-31T04:15:25.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:25 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2044922930' entity='client.admin' 2024-08-31T04:15:25.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:25 smithi002 ceph-mon[18656]: from='mgr.14118 172.21.15.2:0/3645600166' entity='mgr.x' 2024-08-31T04:15:27.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:26 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/721171909' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T04:15:27.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:26 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setuser ceph since I am not root 2024-08-31T04:15:27.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:26 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setgroup ceph since I am not root 2024-08-31T04:15:27.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:27 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/721171909' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T04:15:27.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:27 smithi002 ceph-mon[18656]: mgrmap e9: x(active, since 19s) 2024-08-31T04:15:28.571 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:15:28.571 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-08-31T04:15:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-08-31T04:15:28.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:28 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1764313368' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T04:15:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: Active manager daemon x restarted 2024-08-31T04:15:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: Activating manager daemon x 2024-08-31T04:15:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T04:15:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: mgrmap e10: x(active, starting, since 0.00358574s) 2024-08-31T04:15:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:15:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:15:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:15:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:15:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:31 smithi002 ceph-mon[18656]: Manager daemon x is now available 2024-08-31T04:15:33.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:32 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:33.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:15:33.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:15:33.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-mon[18656]: mgrmap e11: x(active, since 1.00725s) 2024-08-31T04:15:33.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:15:33.453+0000 7fa3b2df2640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:04:15:33] ENGINE Error in HTTPServer.serve 2024-08-31T04:15:33.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Traceback (most recent call last): 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._connections.run(self.expiration_interval) 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._run(expiration_interval) 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s = self.context.wrap_socket( 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:15:33.559 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: return self.sslsocket_class._create( 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self.do_handshake() 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._sslobj.do_handshake() 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:15:33.560 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:15:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-08-31T04:15:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:34 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:33] ENGINE Bus STARTING 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:34 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:33] ENGINE Serving on https://172.21.15.2:7150 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:34 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:33] ENGINE Error in HTTPServer.serve 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:15:34.147 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-08-31T04:15:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:15:34.149 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-08-31T04:15:34.149 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:15:34.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:34 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:33] ENGINE Serving on http://172.21.15.2:8765 2024-08-31T04:15:34.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:34 smithi002 ceph-mon[18656]: [31/Aug/2024:04:15:33] ENGINE Bus STARTED 2024-08-31T04:15:35.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:35 smithi002 ceph-mon[18656]: mgrmap e12: x(active, since 2s) 2024-08-31T04:15:35.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:35 smithi002 ceph-mon[18656]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:35.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:35 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:35.711 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUYNuylW1E0Egn6CBEVDat0EHc2HUwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTA0MTUzNVoXDTM0\nMDkwMTA0MTUzNVowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjIwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCgt5p9yhZxoqaHxlUQxdM/yCZNeNgu1sXfsiTR\nbSWJ5APjf4CU8vxGd2W3mNq8/5LB48FbAQNpI6BNTsmyORczrLc7Zf4SNgOQaeGj\nknx6x9eJeIv4oS3GW6Q4zj2L/VEWwm5uKCtBJ3DX4QA2EiqESF5R9AEC4f4WT363\nKP2pWiGbnPLtuXSe74B1UQ4fCpygneg47pjAzThnp6LbyOvXcJjHurKhTGksWf7N\nVUDnUSQ6rFNDO+7F/LyPKCG8GUmu2FyxR3s++7L06UvUBE7110utqp8jZwv8UcIc\nEGoONMPgGOYdVzDNDFxCgLa287nbsb01A25vL1fsnh8IrrueLcaTBRfthttUHBnh\nsQssw+egsPUqq1tx6s+cEtg9SsirO2tlP5XZ6ILQBnI+LAwgdZ/AXdCY79Z+o/Mw\nasOE5VIxHUFwEE1srwagKpZCAYlic3kzA234AYjWEmRCgMprukyexZ0cpRSCBt1G\n5Pu/GTBwWWmwHXQTpig6hYB+Nb2Q++JAGiDtGCqox6yGCP/8p25C6OZG81Sa/ViW\nyvEiZxadtRQCAORbS4wlM3EaKorRuQe1deUF/YUbbITMykfdsfpG8Nkk1RquerF5\nw7VXV/NrFrHPEtAQDu5M1bT1rbTB00d5kRJVRhNkoZEIP41P8cH7o+xlU/rKpB9M\nGQePCQIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDKCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8CMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAF57\nBaj+zlcilJMSrdmBvRpX7me+mQ6yDMOWY1MC9Bd5bGDq57ssIyE7InXLYNEduiKo\ncusbl8YFiEMeyUQIoMj42sDv5xk8wdxrwYNo7QR5mg5M+qBRzlBzCqYKlfGgjknN\nvC3nYp2o8HH2t0HQ/xYB6/rU1suAEfHoYXlVKj1S4D6AkYxPIguSwfQOUUzCZGak\nC7VBotsucodugu0hian1wqxUfyGRaBPIW1nN6euSElu9cAEIkhwCuNyakBkXNxHX\nCem0qPBVuzQL839JKvfKtxLA1XeIGnbgPbQUTa0I0RYH3CYlGPCxvswohpCo62ci\n3s+TA+y5I96HjGRSGpgbmR7GLBHj1QwA/43+jE4XlbMKcVK/+zfAFkvoAwkxMZT5\nSM6e49V1q7yGxbYBdhFTFYqNsfsv7JtXWxt7TDjB24115/qwfOcVx6Hhs3CJoQui\n54g5HEgMTG87FHsYlFLcHGacd07ZAuTtzn4zjovMM2axDBIxZMa6pXekHl236AHu\nziT8N7CRx0hz2RAFJtQU5MgmJzxJUwmh4ZBvnvOwILOABiKc7H2kRpL75mIpRTYh\nKv24/PXXvCdw8JRislTpA019kb9GIkcxb4lfVtjhkzitjBTp1hzpeNWs16m8P3eR\nCrsUdoV8Pc1/c0HMBOG4CdGzUT5gW3fYGez7xUUT\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAoLeafcoWcaKmh8ZVEMXTP8gmTXjYLtbF37Ik0W0lieQD43+A\nlPL8Rndlt5javP+SwePBWwEDaSOgTU7JsjkXM6y3O2X+EjYDkGnho5J8esfXiXiL\n+KEtxlukOM49i/1RFsJubigrQSdw1+EANhIqhEheUfQBAuH+Fk9+tyj9qVohm5zy\n7bl0nu+AdVEOHwqcoJ3oOO6YwM04Z6ei28jr13CYx7qyoUxpLFn+zVVA51EkOqxT\nQzvuxfy8jyghvBlJrthcsUd7Pvuy9OlL1ARO9ddLraqfI2cL/FHCHBBqDjTD4Bjm\nHVcwzQxcQoC2tvO527G9NQNuby9X7J4fCK67ni3GkwUX7YbbVBwZ4bELLMPnoLD1\nKqtbcerPnBLYPUrIqztrZT+V2eiC0AZyPiwMIHWfwF3QmO/WfqPzMGrDhOVSMR1B\ncBBNbK8GoCqWQgGJYnN5MwNt+AGI1hJkQoDKa7pMnsWdHKUUggbdRuT7vxkwcFlp\nsB10E6YoOoWAfjW9kPviQBog7RgqqMeshgj//KduQujmRvNUmv1YlsrxImcWnbUU\nAgDkW0uMJTNxGiqK0bkHtXXlBf2FG2yEzMpH3bH6RvDZJNUarnqxecO1V1fzaxax\nzxLQEA7uTNW09a20wdNHeZESVUYTZKGRCD+NT/HB+6PsZVP6yqQfTBkHjwkCAwEA\nAQKCAgAScDYEd+6ev10RJycjuzpq7xy71yEgMIo3iYHRWA8ONI9gpoRbMkxQjkqo\nZ1wzAjQ1U9qfROy9/3UY4XDg5k1b45UK9r7RGorKoucc48WttWcsMZ0HW4B7qRBc\nZwbnHFsU/B38u9WIjkyTK9BhI7Dmh8Hwb4i9Kq3CpACi5UxCxWElL/qr3NK9GDeZ\n3gB7fbVt9OfLPk5ekjzGIZSc1/58s0GH6oqrWC+Zw8Jojr8ZOrUoGRSdWk8gvkfo\nuZ8zLAiIy3BI8203kttbXzeQnaTsbfST+kbzIhOdMUkOfLCaLCILv/eIhrQF1kTw\naUFtGGWqh4fwQNJG5bzV2+cuERPbmZQ4lCQYVaXeITiIN5oCfmEbkRb3O1SrJyjr\ntQaM5RVqhJrt8ft+gkJBCWnHv7yYKuqUEuBgA3QzwY+/rdumSa1ufSF5o4tE6Bgv\nmtGBdv4UrS7xE0ZODO4TheszGKpWogNbfmlUOgSQN5Fu05+TGcoWYNndd5sGpIq9\nAqF9WAYs5iQj4BsrhMP1h5zYdUFwPijZvprAVZ7FuW3ot4UwWuCALEhDh5joMgWX\nGp91/eqX4Tyt8Rf+lrl5wTHowXFhhNmCrXr1bR8IopTrtLt+AqLWn/9ptcCGcFO9\nde+O8RQfZ5pV4l/i4gou+qiM9q0+Yx9FUtbfd/Num51kak7JgQKCAQEAzFEUYGpy\nECoxGyUQUsjvzSs/e5BOQWsP9u9+WKYM1cbIDFUCyfxlySdlu6j3vONcEH7V8AE8\n7yZApadXxlDdR4AN8+S8iNVMzoJuR+qQods8Cq3dzAty4d1ZUqhtaZLmtvXuVfb7\nJ3AVOiK1dhqPPmRsfgq+Rq768odzSYPMMMHRu0BqxvLku7hoaA7S1naBgW/XpYLw\nkUWgpnRzMCRiBd5hbxk6NYWXJRvoJwDfoOSQnSxj9F2EshoobRgnsW8khS+NqBrk\nTkbmUFTvO/wfkaaxtUgb/WHuqhFEZ4I3cSomDJ1Wa8cF10r/prvjfBqctQwrWRPE\nhFYUWWmuBRkMQQKCAQEAyV8nWS2oWRJVvbbPRQnO+Y7z5gj2YeyNgZK2SDyGj3gi\nJ8cCC91hTV9wmjW9G9K0foDN6kQ3cwGpS7ryJjyqlaZ7XID2Q1VYkDxudQGR4RQ2\nWhkzaoeCxl/GMO2M/4nfPvC7SdGjxeH55kkOEI+Zi4JfIBA5D29UP+tTNgL6Z87D\ndIUyvH92lf0Qgf3vUrdTt51m4Yz2pNLLYUv/iHN22+IeB2axs6y+YaN33j3D6vtb\nNDuz6bxtQh7TndP//DugTaxGdPVp0N//GSx7FYcOfJ2y7OpnOikDvAmrOdthK2eM\nRJVvuLJbYK8/y8kT75fPfkPBBJtHouYgDXCO5ODwyQKCAQBu/41mY+3bwlAzQwt/\nLhK5D8nJQziAab2elbW6S1ult/xuVrDRMwHJKlImhUExqQMXIxDu9n04Hzv3wtX4\ns23DrlnmKloSrG6xskJfZ5tzkzsnQhXBCGc9NZeVRFNMi7Yzp5/3q9n+LvIZR0n2\nA6/WYZBfWU7N77n9kICda7C+vE1IwVJBCywgn6p4/bSlNnRc8XniPSSch4sjYxhB\nC0MFlS6xwK7S7OSUEHkq11qmegXmnXsgAr5YU8WqnvjReGQKxy7aKOHndLUi50Gh\nAPPVmQ3qQmaSXWXflsnmweOE4zUQnVmZ6+HMeL4ywthvT7Xa1eWm2wpkKq+bc8JK\nmrUBAoIBABw0KpOv9GM9USr4HsGhpQ6I+hoe6Ts/4XXjcYpeh84yWj5N/jhhMk6e\n7mt62Vi7QzJwoeaM1WNTOT31GhNG7fF11tNW8Kbvni7dd+8FYEQxC4fE/dGO1z8n\njN+vdc8YpV7wYprtNM3zX4fkdYbWRgAnK2GXRBaoVhl5wTbQZfgCGpgIS9ng1GAf\niJ9cTJe+O4h9EDrI/oaJS5j+BvU6jswvOFt7A6qRqDyOo6xJ5FXWDKkdL46uKHNZ\nU/RIDBNs2n/mgBvDf6WUqesBst+KAfpsL/JExl57/hzpEcVRt6NXpmq4r2Qj/u5k\nvT+ykws8rQAXR0J46SikqJqZSDpAUxkCggEBAK7notWwDFmCm4IgFuHzGuC6PVwA\neF1GO3KJ6rbc+AiDLfu4y2nUYZJRCZbaCiv+bLEA6NsjYTYrcrXpViGb1wIYnrup\nj1oJYFXNtvClNc8c8q+kzExJSZ2RiDR6R3H8rfYCYJMEvaRfbUV3EM02DfgrG7qo\n1umj7IMNuY1GvjQ8MehDhMYEe5YSVDWA/Ta8YLPlE0HRiNrYH9ybEN8e/xxgzzbo\nZ1ULnrIrBM9nBSRXxl/xsu2E7wZ9aDmg1vhSqVtlY8tUw50oKegWfb9RUJ7uqhzz\n7Ua36DZsRefwQhCc7QeplaFAoxLHN0rs1yhiWZT2DTuAkzdE/FOiTrdAShE=\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T04:15:36.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T04:15:37.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:36 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:37.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:36 smithi002 ceph-mon[18656]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:37.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:36 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:38.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T04:15:38.221 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-08-31T04:15:38.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:38 smithi002 ceph-mon[18656]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:38.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:38 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$8kDGchczk6mTZ3Y2I15FKOdi2iSSDm3kaUgOz2YBFXbJQbkBdy2TS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725077739, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T04:15:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-08-31T04:15:40.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:40 smithi002 ceph-mon[18656]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:40.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:40 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T04:15:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:15:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-08-31T04:15:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:15:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-08-31T04:15:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-08-31T04:15:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002:8443/ 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout: Password: k2f4ca1ram 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config directory 2024-08-31T04:15:41.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:41 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3680596886' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-08-31T04:15:42.225 INFO:tasks.cephadm:Fetching config... 2024-08-31T04:15:42.226 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:15:42.226 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T04:15:42.242 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T04:15:42.242 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:15:42.242 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T04:15:42.297 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T04:15:42.298 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:15:42.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T04:15:42.362 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T04:15:42.363 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:15:42.363 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T04:15:42.418 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T04:15:42.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:15:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:42.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:15:42.546 INFO:teuthology.orchestra.run.smithi064.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:42.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:15:42.599 INFO:teuthology.orchestra.run.smithi132.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGsWHbPsO/lFGEaL1aIAojeaf9OKmJKTO1KmnS7TmpKwiMre534VuRsyainylVN8IkdW4/9mLxbkdv0ydXfrQgejD1F9Yum7TW8CilgmYbeujvosLjLhuqjIrMbg3EKg1ps56anAc0+8+0cfMgmEH/O8PERXT2Cc1v1dNr8p4IB6Br1Hn2KGkfxDL3qiBUkRh3xKAeT8lnCNcX4tJEo8qBZljw4cMsa+xYa9/Nsez/a6Jhk6aTlv6v2Br8bnYzJ8A5I5jfI+Z5AQQLpskExzc/8TZ4y+Wiuh0LMswJfZea/TNFhRGa1L44aINN+YJ4kxYpiFabvni+ZpZ2adZqzMqLvwA3+BSXfiYwgy1rbrD3Z8cppudJ6F4E0hOP7aOIcPCsPuf/trncA21L568AaUs2BfIDAQNdVZrBy/oRBXz7xBhVKoDdmp1WLjMFvRzJMXhlj59KZcOCh4brIsn/wbWKeTqac26SOTPTx1SEqF4IyFMkMJ9zGztr1r9/MKIW+V0= ceph-4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:15:42.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T04:15:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:42.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2778260746' entity='client.admin' 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3883867329' entity='client.admin' 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:44.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:44 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:45.013 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T04:15:45.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T04:15:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:45.961 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:45 smithi002 ceph-mon[18656]: mgrmap e13: x(active, since 13s) 2024-08-31T04:15:46.976 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi064 2024-08-31T04:15:46.977 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:15:46.977 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.conf 2024-08-31T04:15:46.995 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:15:46.996 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:15:47.053 INFO:tasks.cephadm:Adding host smithi064 to orchestrator... 2024-08-31T04:15:47.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch host add smithi064 2024-08-31T04:15:47.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:47.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:47 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:48 smithi002 ceph-mon[18656]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:15:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:49 smithi002 ceph-mon[18656]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:50 smithi002 ceph-mon[18656]: Deploying cephadm binary to smithi064 2024-08-31T04:15:51.850 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi064' with addr '172.21.15.64' 2024-08-31T04:15:52.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T04:15:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:53.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:53.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: Added host smithi064 2024-08-31T04:15:53.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:53.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:15:53.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:53.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:52 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:53.370 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:15:53.370 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}] 2024-08-31T04:15:53.900 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi132 2024-08-31T04:15:53.900 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:15:53.900 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/etc/ceph/ceph.conf 2024-08-31T04:15:53.918 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:15:53.919 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:15:53.976 INFO:tasks.cephadm:Adding host smithi132 to orchestrator... 2024-08-31T04:15:53.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch host add smithi132 2024-08-31T04:15:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:54.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:54 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:54.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:54 smithi002 ceph-mon[18656]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:15:55.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:55 smithi002 ceph-mon[18656]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi132", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:56.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:56.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:56 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:15:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:15:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: Deploying cephadm binary to smithi132 2024-08-31T04:15:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:15:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:15:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:15:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:57 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:58.722 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi132' with addr '172.21.15.132' 2024-08-31T04:15:59.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T04:15:59.529 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: Added host smithi132 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:15:59.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:15:59 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:00.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:16:00.150 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}, {"addr": "172.21.15.132", "hostname": "smithi132", "labels": [], "status": ""}] 2024-08-31T04:16:00.709 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T04:16:00.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T04:16:00.955 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:01.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:01 smithi002 ceph-mon[18656]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:01.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:01 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:01.375 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:01 smithi002 ceph-mon[18656]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:16:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-08-31T04:16:02.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3632622725' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T04:16:02.652 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-08-31T04:16:02.653 INFO:tasks.cephadm:Adding mon.b on smithi064 2024-08-31T04:16:02.653 INFO:tasks.cephadm:Adding mon.c on smithi132 2024-08-31T04:16:02.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi064:172.21.15.64=b;smithi132:172.21.15.132=c' 2024-08-31T04:16:02.998 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T04:16:03.043 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T04:16:03.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:03.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3632622725' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T04:16:03.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:03.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:03.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:03 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:03.757 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mon update... 2024-08-31T04:16:04.379 DEBUG:teuthology.orchestra.run.smithi064:mon.b> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T04:16:04.381 DEBUG:teuthology.orchestra.run.smithi132:mon.c> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T04:16:04.384 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:16:04.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:16:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi064:172.21.15.64=b;smithi132:172.21.15.132=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi064:172.21.15.64=b;smithi132:172.21.15.132=c;count:3 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:05.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:04 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:05.427 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:06.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:05 smithi002 ceph-mon[18656]: Deploying daemon mon.c on smithi132 2024-08-31T04:16:06.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:05 smithi002 ceph-mon[18656]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:06.647 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:16:06.647 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":1,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:14:43.552151Z","created":"2024-08-31T04:14:43.552151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T04:16:06.647 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 1 2024-08-31T04:16:07.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:06 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/3157881057' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:08.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:07 smithi002 ceph-mon[18656]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:08.594 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:16:08.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:16:08.618 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:08 smithi132 systemd[1]: Started Ceph mon.c for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:16:08.858 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: mon.a calling monitor election 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: mon.c calling monitor election 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: monmap epoch 2 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: last_changed 2024-08-31T04:16:08.408587+0000 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: min_mon_release 19 (squid) 2024-08-31T04:16:13.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: election_strategy: 1 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: 1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: fsmap 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: mgrmap e13: x(active, since 41s) 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: overall HEALTH_OK 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:13.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:13 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: mon.a calling monitor election 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: mon.c calling monitor election 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: monmap epoch 2 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: last_changed 2024-08-31T04:16:08.408587+0000 2024-08-31T04:16:13.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: election_strategy: 1 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: 1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: fsmap 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: mgrmap e13: x(active, since 41s) 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: overall HEALTH_OK 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:13.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:13 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:13.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:16:13.977 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:16:08.408587Z","created":"2024-08-31T04:14:43.552151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T04:16:13.977 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 2 2024-08-31T04:16:14.565 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:14 smithi132 ceph-mon[22335]: Deploying daemon mon.b on smithi064 2024-08-31T04:16:14.565 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:14 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/851198914' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:14.565 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:14 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:14 smithi002 ceph-mon[18656]: Deploying daemon mon.b on smithi064 2024-08-31T04:16:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:14 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/851198914' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:14 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:15.596 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:16:15.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:16:15.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:15 smithi132 ceph-mon[22335]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:15.851 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:15.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:15 smithi002 ceph-mon[18656]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:16.809 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:16:16.809 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:16:08.408587Z","created":"2024-08-31T04:14:43.552151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T04:16:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 2 2024-08-31T04:16:17.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:17 smithi132 ceph-mon[22335]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:17.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:17 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/420398618' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:17.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:17 smithi002 ceph-mon[18656]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:17.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:17 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/420398618' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:17.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:17 smithi064 systemd[1]: Started Ceph mon.b for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:16:18.374 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:16:18.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:16:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:22.894 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:16:22.894 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:16:17.522721Z","created":"2024-08-31T04:14:43.552151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T04:16:22.894 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 3 2024-08-31T04:16:22.894 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:22.894 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: mon.a calling monitor election 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: mon.c calling monitor election 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: mon.b calling monitor election 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:16:22.895 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: monmap epoch 3 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: last_changed 2024-08-31T04:16:17.522721+0000 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: min_mon_release 19 (squid) 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: election_strategy: 1 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: 1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-08-31T04:16:22.896 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: fsmap 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: mgrmap e13: x(active, since 50s) 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: overall HEALTH_OK 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.897 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:22 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: mon.a calling monitor election 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: mon.c calling monitor election 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: mon.b calling monitor election 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: monmap epoch 3 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: last_changed 2024-08-31T04:16:17.522721+0000 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: election_strategy: 1 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: 1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: fsmap 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: mgrmap e13: x(active, since 50s) 2024-08-31T04:16:22.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: overall HEALTH_OK 2024-08-31T04:16:22.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:22.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:22 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: mon.a calling monitor election 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: mon.c calling monitor election 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: mon.b calling monitor election 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: monmap epoch 3 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: last_changed 2024-08-31T04:16:17.522721+0000 2024-08-31T04:16:23.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: created 2024-08-31T04:14:43.552151+0000 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: min_mon_release 19 (squid) 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: election_strategy: 1 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: 1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: fsmap 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: mgrmap e13: x(active, since 50s) 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: overall HEALTH_OK 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:23.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:22 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:23.524 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T04:16:23.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T04:16:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:23.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:23 smithi132 ceph-mon[22335]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:23.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:23 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:23.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/2888381189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:23.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:23 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:23.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:23 smithi002 ceph-mon[18656]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:23.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:23 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:23.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/2888381189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:23.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:23 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:24.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:23 smithi064 ceph-mon[22007]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:24.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:23 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:24.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/2888381189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:16:24.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:23 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-08-31T04:16:24.406 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:16:24.406 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:24 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2185206018' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:24 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2185206018' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:25.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:24 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2185206018' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:25.098 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T04:16:25.098 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:16:25.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:16:25.126 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:16:25.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:25.191 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:16:25.191 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:16:25.219 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:16:25.219 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:25.285 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:16:25.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:16:25.313 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:16:25.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:25.379 INFO:tasks.cephadm:enabling module snap_schedule 2024-08-31T04:16:25.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-08-31T04:16:25.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:25.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:25.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:25.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:25.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:25.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:25 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:26.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:26.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:26.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:25 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:26.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:25 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.142 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: Reconfiguring daemon mon.a on smithi002 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:26.799 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:26 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: Reconfiguring daemon mon.a on smithi002 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:26.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:26 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:16:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: Reconfiguring daemon mon.a on smithi002 2024-08-31T04:16:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:27.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:27.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:27.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:27.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:26 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: Reconfiguring daemon mon.b on smithi064 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:27.993 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:27.994 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:27.994 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:27.994 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:27 smithi132 ceph-mon[22335]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: Reconfiguring daemon mon.b on smithi064 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:28.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:27 smithi064 ceph-mon[22007]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.089 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setuser ceph since I am not root 2024-08-31T04:16:28.089 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ignoring --setgroup ceph since I am not root 2024-08-31T04:16:28.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: Reconfiguring daemon mon.b on smithi064 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:28.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:27 smithi002 ceph-mon[18656]: from='mgr.14150 172.21.15.2:0/2408588549' entity='mgr.x' 2024-08-31T04:16:28.319 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-08-31T04:16:28.319 INFO:tasks.cephadm:Adding mgr.y on smithi064 2024-08-31T04:16:28.319 INFO:tasks.cephadm:Adding mgr.z on smithi132 2024-08-31T04:16:28.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi064=y;smithi132=z' 2024-08-31T04:16:28.791 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:29.011 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:28 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T04:16:29.011 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:28 smithi132 ceph-mon[22335]: mgrmap e14: x(active, since 55s) 2024-08-31T04:16:29.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:28 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T04:16:29.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:28 smithi064 ceph-mon[22007]: mgrmap e14: x(active, since 55s) 2024-08-31T04:16:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:28 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2580080031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T04:16:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:28 smithi002 ceph-mon[18656]: mgrmap e14: x(active, since 55s) 2024-08-31T04:16:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: Active manager daemon x restarted 2024-08-31T04:16:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: Activating manager daemon x 2024-08-31T04:16:33.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T04:16:33.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: mgrmap e15: x(active, starting, since 0.00481792s) 2024-08-31T04:16:33.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:33.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:33.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:33.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:16:33.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:16:33.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:16:33.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:16:33.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:33 smithi064 ceph-mon[22007]: Manager daemon x is now available 2024-08-31T04:16:33.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: Active manager daemon x restarted 2024-08-31T04:16:33.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: Activating manager daemon x 2024-08-31T04:16:33.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T04:16:33.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: mgrmap e15: x(active, starting, since 0.00481792s) 2024-08-31T04:16:33.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:33.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:33.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:33.322 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:16:33.322 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:16:33.322 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:16:33.322 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:16:33.322 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:33 smithi132 ceph-mon[22335]: Manager daemon x is now available 2024-08-31T04:16:33.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: Active manager daemon x restarted 2024-08-31T04:16:33.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: Activating manager daemon x 2024-08-31T04:16:33.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T04:16:33.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: mgrmap e15: x(active, starting, since 0.00481792s) 2024-08-31T04:16:33.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:16:33.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:16:33.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:16:33.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:16:33.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:16:33.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:16:33.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:16:33.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:33 smithi002 ceph-mon[18656]: Manager daemon x is now available 2024-08-31T04:16:34.000 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mgr update... 2024-08-31T04:16:34.310 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:34.310 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:16:34.310 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:16:34.310 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:34 smithi132 ceph-mon[22335]: mgrmap e16: x(active, since 1.01095s) 2024-08-31T04:16:34.310 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:16:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:16:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:34 smithi064 ceph-mon[22007]: mgrmap e16: x(active, since 1.01095s) 2024-08-31T04:16:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:34.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:34.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:16:34.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:16:34.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-mon[18656]: mgrmap e16: x(active, since 1.01095s) 2024-08-31T04:16:34.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:34.598 DEBUG:teuthology.orchestra.run.smithi064:mgr.y> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T04:16:34.601 DEBUG:teuthology.orchestra.run.smithi132:mgr.z> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T04:16:34.604 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T04:16:34.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T04:16:34.606 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T04:16:34.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T04:16:34.649 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T04:16:34.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T04:16:34.692 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T04:16:34.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T04:16:34.735 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T04:16:34.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T04:16:34.778 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T04:16:34.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T04:16:34.822 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T04:16:34.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T04:16:34.868 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T04:16:34.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T04:16:34.912 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T04:16:34.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T04:16:34.957 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T04:16:34.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T04:16:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:34.969 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T04:16:34.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:16:34.867+0000 7f2859618640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:04:16:34] ENGINE Error in HTTPServer.serve 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: Traceback (most recent call last): 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._connections.run(self.expiration_interval) 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._run(expiration_interval) 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:16:34.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: s = self.context.wrap_socket( 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: return self.sslsocket_class._create( 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self.do_handshake() 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: self._sslobj.do_handshake() 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:16:34.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:16:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:16:34.995 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T04:16:34.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T04:16:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:35.014 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T04:16:35.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T04:16:35.058 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T04:16:35.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T04:16:35.113 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T04:16:35.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T04:16:35.164 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T04:16:35.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T04:16:35.216 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T04:16:35.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T04:16:35.265 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T04:16:35.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T04:16:35.316 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T04:16:35.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T04:16:35.403 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-08-31T04:16:35.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-08-31T04:16:35.454 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-08-31T04:16:35.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-08-31T04:16:35.515 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-08-31T04:16:35.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-08-31T04:16:35.559 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-08-31T04:16:35.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-08-31T04:16:35.642 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T04:16:35.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T04:16:35.704 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T04:16:35.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T04:16:35.763 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T04:16:35.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T04:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:35.789 DEBUG:tasks.cephadm:set 26 configs 2024-08-31T04:16:35.789 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi002') 2024-08-31T04:16:35.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: Saving service mgr spec with placement smithi002=x;smithi064=y;smithi132=z;count:3 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: [31/Aug/2024:04:16:34] ENGINE Bus STARTING 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: [31/Aug/2024:04:16:34] ENGINE Serving on http://172.21.15.2:8765 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: Saving service mgr spec with placement smithi002=x;smithi064=y;smithi132=z;count:3 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: [31/Aug/2024:04:16:34] ENGINE Bus STARTING 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: [31/Aug/2024:04:16:34] ENGINE Serving on http://172.21.15.2:8765 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: Saving service mgr spec with placement smithi002=x;smithi064=y;smithi132=z;count:3 2024-08-31T04:16:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: [31/Aug/2024:04:16:34] ENGINE Bus STARTING 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: [31/Aug/2024:04:16:34] ENGINE Serving on http://172.21.15.2:8765 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:36.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: [31/Aug/2024:04:16:34] ENGINE Serving on https://172.21.15.2:7150 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: [31/Aug/2024:04:16:34] ENGINE Bus STARTED 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: [31/Aug/2024:04:16:34] ENGINE Error in HTTPServer.serve 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:16:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: mgrmap e17: x(active, since 2s) 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:37.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/524021693' entity='client.admin' 2024-08-31T04:16:37.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:36 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3348547863' entity='client.admin' 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: [31/Aug/2024:04:16:34] ENGINE Serving on https://172.21.15.2:7150 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: [31/Aug/2024:04:16:34] ENGINE Bus STARTED 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: [31/Aug/2024:04:16:34] ENGINE Error in HTTPServer.serve 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: Traceback (most recent call last): 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: self._run(expiration_interval) 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:16:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: s = self.context.wrap_socket( 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: return self.sslsocket_class._create( 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: self.do_handshake() 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: self._sslobj.do_handshake() 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: mgrmap e17: x(active, since 2s) 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/524021693' entity='client.admin' 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:36 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3348547863' entity='client.admin' 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: [31/Aug/2024:04:16:34] ENGINE Serving on https://172.21.15.2:7150 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: [31/Aug/2024:04:16:34] ENGINE Bus STARTED 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: [31/Aug/2024:04:16:34] ENGINE Error in HTTPServer.serve 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.c.smithi132.stdout: Traceback (most recent call last): 2024-08-31T04:16:37.069 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: self._run(expiration_interval) 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: s = self.context.wrap_socket( 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: return self.sslsocket_class._create( 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: self.do_handshake() 2024-08-31T04:16:37.070 INFO:journalctl@ceph.mon.c.smithi132.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout: self._sslobj.do_handshake() 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: mgrmap e17: x(active, since 2s) 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/524021693' entity='client.admin' 2024-08-31T04:16:37.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:36 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3348547863' entity='client.admin' 2024-08-31T04:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f780403f2d0 msgr2=0x7f78040417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f780403f2d0 0x7f78040417e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f780002a930 tx=0x7f7800005fd0 comp rx=0 tx=0).stop 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814101920 msgr2=0x7f7814199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814101920 0x7f7814199b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f780800d770 tx=0x7f780800dc30 comp rx=0 tx=0).stop 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 shutdown_connections 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7814109250 0x7f781419ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:37.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7814102350 0x7f781419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f780403f2d0 0x7f78040417e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 --2- 172.21.15.2:0/2486167260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814101920 0x7f7814199b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 >> 172.21.15.2:0/2486167260 conn(0x7f78140fd510 msgr2=0x7f7814107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 shutdown_connections 2024-08-31T04:16:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:37.868+0000 7f781ac9a640 1 -- 172.21.15.2:0/2486167260 wait complete. 2024-08-31T04:16:38.018 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi002') 2024-08-31T04:16:38.018 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi002') 2024-08-31T04:16:38.633 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-08-31T04:16:38.638 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:38.658 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:38.658 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2486167260' entity='client.admin' 2024-08-31T04:16:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:38 smithi002 ceph-mon[18656]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 -- 172.21.15.2:0/3916340524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103ec0 msgr2=0x7f479c10a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 --2- 172.21.15.2:0/3916340524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103ec0 0x7f479c10a860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4794009ca0 tx=0x7f479402a950 comp rx=0 tx=0).stop 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 -- 172.21.15.2:0/3916340524 shutdown_connections 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 --2- 172.21.15.2:0/3916340524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103ec0 0x7f479c10a860 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 --2- 172.21.15.2:0/3916340524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c103520 0x7f479c103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 --2- 172.21.15.2:0/3916340524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c102490 0x7f479c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 -- 172.21.15.2:0/3916340524 >> 172.21.15.2:0/3916340524 conn(0x7f479c0fde20 msgr2=0x7f479c1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 -- 172.21.15.2:0/3916340524 shutdown_connections 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.303+0000 7f47a0da7640 1 -- 172.21.15.2:0/3916340524 wait complete. 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 Processor -- start 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 -- start start 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103520 0x7f479c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c103ec0 0x7f479c19ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f479c10de90 con 0x7f479c103520 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f479c10dd10 con 0x7f479c103ec0 2024-08-31T04:16:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f47a0da7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f479c10e010 con 0x7f479c102490 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.304+0000 7f479a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:51086/0 (socket says 172.21.15.2:51086) 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 -- 172.21.15.2:0/1665772238 learned_addr learned my addr 172.21.15.2:0/1665772238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f4799d9b640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103520 0x7f479c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479ad9d640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c103ec0 0x7f479c19ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 -- 172.21.15.2:0/1665772238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c103ec0 msgr2=0x7f479c19ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c103ec0 0x7f479c19ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 -- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103520 msgr2=0x7f479c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103520 0x7f479c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 -- 172.21.15.2:0/1665772238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c19b5b0 con 0x7f479c102490 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f479a59c640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f478c00e9f0 tx=0x7f478c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.305+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c00cd80 con 0x7f479c102490 2024-08-31T04:16:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.306+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c19b8a0 con 0x7f479c102490 2024-08-31T04:16:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.306+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f478c0108a0 con 0x7f479c102490 2024-08-31T04:16:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.306+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c1a1fa0 con 0x7f479c102490 2024-08-31T04:16:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.306+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c018760 con 0x7f479c102490 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f478c018900 con 0x7f479c102490 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f478b7fe640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 0x7f47840417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c102900 con 0x7f479c102490 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f478c054ea0 con 0x7f479c102490 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f4799d9b640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 0x7f47840417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.307+0000 7f4799d9b640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 0x7f47840417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4790009b60 tx=0x7f4790005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.312+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f478c01fe00 con 0x7f479c102490 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2486167260' entity='client.admin' 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:38 smithi064 ceph-mon[22007]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2486167260' entity='client.admin' 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi002:/etc/ceph/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi064:/etc/ceph/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi132:/etc/ceph/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:38 smithi132 ceph-mon[22335]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.519+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f479c1a25a0 con 0x7f479c102490 2024-08-31T04:16:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.524+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f478c054640 con 0x7f479c102490 2024-08-31T04:16:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.524+0000 7f478b7fe640 1 -- 172.21.15.2:0/1665772238 <== mon.1 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f478c022de0 con 0x7f479c102490 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.526+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 msgr2=0x7f47840417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.526+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 0x7f47840417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4790009b60 tx=0x7f4790005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 msgr2=0x7f479c199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f478c00e9f0 tx=0x7f478c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 shutdown_connections 2024-08-31T04:16:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f478403f2d0 0x7f47840417e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f479c103520 0x7f479c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f479c103ec0 0x7f479c19ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 --2- 172.21.15.2:0/1665772238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f479c102490 0x7f479c199b80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 >> 172.21.15.2:0/1665772238 conn(0x7f479c0fde20 msgr2=0x7f479c0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 shutdown_connections 2024-08-31T04:16:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:39.527+0000 7f47a0da7640 1 -- 172.21.15.2:0/1665772238 wait complete. 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: Deploying daemon mgr.z on smithi132 2024-08-31T04:16:40.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:40 smithi002 ceph-mon[18656]: from='client.? ' entity='client.admin' 2024-08-31T04:16:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 -- 172.21.15.2:0/2336775159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 msgr2=0x7ff02410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 --2- 172.21.15.2:0/2336775159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff02410f2e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009ca0 tx=0x7ff01c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 -- 172.21.15.2:0/2336775159 shutdown_connections 2024-08-31T04:16:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 --2- 172.21.15.2:0/2336775159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff02410f2e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 --2- 172.21.15.2:0/2336775159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024108160 0x7ff024108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 --2- 172.21.15.2:0/2336775159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024102820 0x7ff024102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 -- 172.21.15.2:0/2336775159 >> 172.21.15.2:0/2336775159 conn(0x7ff0240794e0 msgr2=0x7ff0240798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 -- 172.21.15.2:0/2336775159 shutdown_connections 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.316+0000 7ff02b374640 1 -- 172.21.15.2:0/2336775159 wait complete. 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 Processor -- start 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 -- start start 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 0x7ff02410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024108160 0x7ff0241100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff024113710 con 0x7ff024108ab0 2024-08-31T04:16:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff024113590 con 0x7ff024102820 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02b374640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff024113890 con 0x7ff024108160 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41736/0 (socket says 172.21.15.2:41736) 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 -- 172.21.15.2:0/2825037865 learned_addr learned my addr 172.21.15.2:0/2825037865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029110640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 0x7ff02410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff02890f640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024108160 0x7ff0241100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 -- 172.21.15.2:0/2825037865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024108160 msgr2=0x7ff0241100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024108160 0x7ff0241100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 -- 172.21.15.2:0/2825037865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 msgr2=0x7ff02410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 0x7ff02410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029911640 1 -- 172.21.15.2:0/2825037865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0241a8580 con 0x7ff024108ab0 2024-08-31T04:16:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.317+0000 7ff029110640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 0x7ff02410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff029911640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006010 tx=0x7ff01c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c003b70 con 0x7ff024108ab0 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff01c003d10 con 0x7ff024108ab0 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0241a8810 con 0x7ff024108ab0 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c004600 con 0x7ff024108ab0 2024-08-31T04:16:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.318+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0241a8da0 con 0x7ff024108ab0 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.319+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7ff01c04d440 con 0x7ff024108ab0 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.319+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff024103aa0 con 0x7ff024108ab0 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.319+0000 7ff01a7fc640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 0x7ff0100417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.319+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff01c074a10 con 0x7ff024108ab0 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.319+0000 7ff029110640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 0x7ff0100417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.320+0000 7ff029110640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 0x7ff0100417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0241115c0 tx=0x7ff014005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.324+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff01c0412e0 con 0x7ff024108ab0 2024-08-31T04:16:40.510 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.515+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7ff02410a8a0 con 0x7ff024108ab0 2024-08-31T04:16:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.520+0000 7ff01a7fc640 1 -- 172.21.15.2:0/2825037865 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7ff01c039e70 con 0x7ff024108ab0 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 msgr2=0x7ff0100417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 0x7ff0100417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0241115c0 tx=0x7ff014005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 msgr2=0x7ff0241105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006010 tx=0x7ff01c0093d0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 shutdown_connections 2024-08-31T04:16:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff01003f2d0 0x7ff0100417e0 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0241115c0 tx=0x7ff014005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff024108ab0 0x7ff0241105f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff024108160 0x7ff0241100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 --2- 172.21.15.2:0/2825037865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff024102820 0x7ff02410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.523+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 >> 172.21.15.2:0/2825037865 conn(0x7ff0240794e0 msgr2=0x7ff0241042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.524+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 shutdown_connections 2024-08-31T04:16:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.524+0000 7ff02b374640 1 -- 172.21.15.2:0/2825037865 wait complete. 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: Deploying daemon mgr.z on smithi132 2024-08-31T04:16:40.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:40 smithi064 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: Updating smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: Updating smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: Updating smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: Deploying daemon mgr.z on smithi132 2024-08-31T04:16:40.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:40 smithi132 ceph-mon[22335]: from='client.? ' entity='client.admin' 2024-08-31T04:16:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 -- 172.21.15.2:0/2672544428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 msgr2=0x7f4f10109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2672544428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f10109650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009900 tx=0x7f4efc02a410 comp rx=0 tx=0).stop 2024-08-31T04:16:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 -- 172.21.15.2:0/2672544428 shutdown_connections 2024-08-31T04:16:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2672544428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f10109650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2672544428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10109b90 0x7f4f101103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2672544428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10103900 0x7f4f10103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.702+0000 7f4f16b52640 1 -- 172.21.15.2:0/2672544428 >> 172.21.15.2:0/2672544428 conn(0x7f4f1007b5f0 msgr2=0x7f4f1007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 -- 172.21.15.2:0/2672544428 shutdown_connections 2024-08-31T04:16:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 -- 172.21.15.2:0/2672544428 wait complete. 2024-08-31T04:16:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 Processor -- start 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 -- start start 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10103900 0x7f4f1019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.703+0000 7f4f16b52640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 0x7f4f1019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f16b52640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10113780 con 0x7f4f10109240 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f16b52640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10113600 con 0x7f4f10109b90 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f16b52640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10113900 con 0x7f4f10103900 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41752/0 (socket says 172.21.15.2:41752) 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f148ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10103900 0x7f4f1019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 -- 172.21.15.2:0/2813726555 learned_addr learned my addr 172.21.15.2:0/2813726555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f150ef640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 0x7f4f1019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 -- 172.21.15.2:0/2813726555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10103900 msgr2=0x7f4f1019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10103900 0x7f4f1019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 -- 172.21.15.2:0/2813726555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 msgr2=0x7f4f1019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 0x7f4f1019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 -- 172.21.15.2:0/2813726555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f101a0140 con 0x7f4f10109240 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f150ef640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 0x7f4f1019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0ffff640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4efc02a930 tx=0x7f4efc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc03f070 con 0x7f4f10109240 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4efc003e10 con 0x7f4f10109240 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f101a03d0 con 0x7f4f10109240 2024-08-31T04:16:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.704+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc035030 con 0x7f4f10109240 2024-08-31T04:16:40.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.705+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f101a6b90 con 0x7f4f10109240 2024-08-31T04:16:40.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f10104b80 con 0x7f4f10109240 2024-08-31T04:16:40.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f4efc042070 con 0x7f4f10109240 2024-08-31T04:16:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f0dffb640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 0x7f4f000417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4efc074210 con 0x7f4f10109240 2024-08-31T04:16:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f148ee640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 0x7f4f000417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.706+0000 7f4f148ee640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 0x7f4f000417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f04005fd0 tx=0x7f4f0400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.711+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4efc04a260 con 0x7f4f10109240 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 -- 172.21.15.2:0/3039570416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 msgr2=0x7fe9d410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/3039570416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d410f300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009ca0 tx=0x7fe9cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 -- 172.21.15.2:0/3039570416 shutdown_connections 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/3039570416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d410f300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/3039570416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4108180 0x7fe9d4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/3039570416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4102840 0x7fe9d4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 -- 172.21.15.2:0/3039570416 >> 172.21.15.2:0/3039570416 conn(0x7fe9d4079580 msgr2=0x7fe9d4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 -- 172.21.15.2:0/3039570416 shutdown_connections 2024-08-31T04:16:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.878+0000 7fe9dbf68640 1 -- 172.21.15.2:0/3039570416 wait complete. 2024-08-31T04:16:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.879+0000 7fe9dbf68640 1 Processor -- start 2024-08-31T04:16:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.879+0000 7fe9dbf68640 1 -- start start 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.879+0000 7fe9dbf68640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102840 0x7fe9d419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.879+0000 7fe9dbf68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4108180 0x7fe9d419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9dbf68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9dbf68640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4112670 con 0x7fe9d4108ad0 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9dbf68640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d41124f0 con 0x7fe9d4102840 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9dbf68640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d41127f0 con 0x7fe9d4108180 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41764/0 (socket says 172.21.15.2:41764) 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 -- 172.21.15.2:0/2682969904 learned_addr learned my addr 172.21.15.2:0/2682969904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9d9503640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4108180 0x7fe9d419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9d9d04640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102840 0x7fe9d419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 -- 172.21.15.2:0/2682969904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4108180 msgr2=0x7fe9d419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4108180 0x7fe9d419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 -- 172.21.15.2:0/2682969904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102840 msgr2=0x7fe9d419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102840 0x7fe9d419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 -- 172.21.15.2:0/2682969904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d41a0180 con 0x7fe9d4108ad0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9da505640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc005e30 tx=0x7fe9cc0305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc003b70 con 0x7fe9d4108ad0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe9cc003d10 con 0x7fe9d4108ad0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d41a0410 con 0x7fe9d4108ad0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.880+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0046d0 con 0x7fe9d4108ad0 2024-08-31T04:16:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.881+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41a6bd0 con 0x7fe9d4108ad0 2024-08-31T04:16:40.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.882+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d4102c50 con 0x7fe9d4108ad0 2024-08-31T04:16:40.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.882+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fe9cc0307b0 con 0x7fe9d4108ad0 2024-08-31T04:16:40.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.882+0000 7fe9c6ffd640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 0x7fe9c00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:40.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.882+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe9cc074c10 con 0x7fe9d4108ad0 2024-08-31T04:16:40.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.882+0000 7fe9d9d04640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 0x7fe9c00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.883+0000 7fe9d9d04640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 0x7fe9c00417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009990 tx=0x7fe9d0009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:40.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.887+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe9cc030aa0 con 0x7fe9d4108ad0 2024-08-31T04:16:40.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.902+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4f1010b980 con 0x7f4f10109240 2024-08-31T04:16:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.907+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f4efc031400 con 0x7f4f10109240 2024-08-31T04:16:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.908+0000 7f4f0dffb640 1 -- 172.21.15.2:0/2813726555 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4efc039e40 con 0x7f4f10109240 2024-08-31T04:16:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.908+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc036030 con 0x7fe9d4108ad0 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.910+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 msgr2=0x7f4f000417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.910+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 0x7f4f000417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f04005fd0 tx=0x7f4f0400b390 comp rx=0 tx=0).stop 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.910+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 msgr2=0x7f4f1019a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.910+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4efc02a930 tx=0x7f4efc003c20 comp rx=0 tx=0).stop 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 shutdown_connections 2024-08-31T04:16:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f0003f2d0 0x7f4f000417e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f10109240 0x7f4f1019a770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f10109b90 0x7f4f1019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 --2- 172.21.15.2:0/2813726555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f10103900 0x7f4f1019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 >> 172.21.15.2:0/2813726555 conn(0x7f4f1007b5f0 msgr2=0x7f4f10105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 shutdown_connections 2024-08-31T04:16:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:40.911+0000 7f4f16b52640 1 -- 172.21.15.2:0/2813726555 wait complete. 2024-08-31T04:16:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.084+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe9d410b8d0 con 0x7fe9d4108ad0 2024-08-31T04:16:41.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.087+0000 7fe9c6ffd640 1 -- 172.21.15.2:0/2682969904 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7fe9cc004010 con 0x7fe9d4108ad0 2024-08-31T04:16:41.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 msgr2=0x7fe9c00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 0x7fe9c00417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009990 tx=0x7fe9d0009110 comp rx=0 tx=0).stop 2024-08-31T04:16:41.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 msgr2=0x7fe9d419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc005e30 tx=0x7fe9cc0305c0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 shutdown_connections 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9c003f2d0 0x7fe9c00417e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9d4108ad0 0x7fe9d419fa50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9d4108180 0x7fe9d419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 --2- 172.21.15.2:0/2682969904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102840 0x7fe9d419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 >> 172.21.15.2:0/2682969904 conn(0x7fe9d4079580 msgr2=0x7fe9d406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 shutdown_connections 2024-08-31T04:16:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.090+0000 7fe9dbf68640 1 -- 172.21.15.2:0/2682969904 wait complete. 2024-08-31T04:16:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:41.317 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 systemd[1]: Starting Ceph mgr.z for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:16:41.575 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:41 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2825037865' entity='client.admin' 2024-08-31T04:16:41.575 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:41 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2813726555' entity='client.admin' 2024-08-31T04:16:41.576 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:41 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2682969904' entity='client.admin' 2024-08-31T04:16:41.667 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:41 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2825037865' entity='client.admin' 2024-08-31T04:16:41.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:41 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2813726555' entity='client.admin' 2024-08-31T04:16:41.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:41 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2682969904' entity='client.admin' 2024-08-31T04:16:41.668 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 podman[25089]: 2024-08-31 04:16:41.294670714 +0000 UTC m=+0.015812622 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:16:41.668 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 podman[25089]: 2024-08-31 04:16:41.423372913 +0000 UTC m=+0.144514807 container create ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:16:41.668 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 podman[25089]: 2024-08-31 04:16:41.667454021 +0000 UTC m=+0.388595917 container init ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.697+0000 7f670c777640 1 -- 172.21.15.2:0/1053851480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 msgr2=0x7f67041100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.697+0000 7f670c777640 1 --2- 172.21.15.2:0/1053851480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f67041100a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009ca0 tx=0x7f66fc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 -- 172.21.15.2:0/1053851480 shutdown_connections 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 --2- 172.21.15.2:0/1053851480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f67041100a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 --2- 172.21.15.2:0/1053851480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 0x7f670410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 --2- 172.21.15.2:0/1053851480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 0x7f6704104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 -- 172.21.15.2:0/1053851480 >> 172.21.15.2:0/1053851480 conn(0x7f67040794d0 msgr2=0x7f67040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 -- 172.21.15.2:0/1053851480 shutdown_connections 2024-08-31T04:16:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 -- 172.21.15.2:0/1053851480 wait complete. 2024-08-31T04:16:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 Processor -- start 2024-08-31T04:16:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.698+0000 7f670c777640 1 -- start start 2024-08-31T04:16:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 0x7f670419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 0x7f670419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6704113830 con 0x7f670410dbb0 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f67041136b0 con 0x7f67041050a0 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670c777640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f67041139b0 con 0x7f6704104750 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41798/0 (socket says 172.21.15.2:41798) 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 -- 172.21.15.2:0/2723532021 learned_addr learned my addr 172.21.15.2:0/2723532021 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670a513640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 0x7f670419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f6709d12640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 0x7f670419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 -- 172.21.15.2:0/2723532021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 msgr2=0x7f670419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 0x7f670419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 -- 172.21.15.2:0/2723532021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 msgr2=0x7f670419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 0x7f670419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 -- 172.21.15.2:0/2723532021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67041a0170 con 0x7f670410dbb0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.699+0000 7f670ad14640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0098d0 tx=0x7f66fc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.700+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc003b70 con 0x7f670410dbb0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.700+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67041a0400 con 0x7f670410dbb0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.700+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67041a6bc0 con 0x7f670410dbb0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.700+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66fc003d10 con 0x7f670410dbb0 2024-08-31T04:16:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.700+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc02fa20 con 0x7f670410dbb0 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.701+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6704104b60 con 0x7f670410dbb0 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.701+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f66fc02fcc0 con 0x7f670410dbb0 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.701+0000 7f66fb7fe640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 0x7f66f00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.701+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f66fc074ed0 con 0x7f670410dbb0 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.701+0000 7f670a513640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 0x7f66f00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.702+0000 7f670a513640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 0x7f66f00417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f670406ba00 tx=0x7f6700005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.706+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f66fc044c60 con 0x7f670410dbb0 2024-08-31T04:16:41.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:41 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2825037865' entity='client.admin' 2024-08-31T04:16:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:41 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2813726555' entity='client.admin' 2024-08-31T04:16:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:41 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2682969904' entity='client.admin' 2024-08-31T04:16:41.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.893+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f67041a6eb0 con 0x7f670410dbb0 2024-08-31T04:16:41.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.897+0000 7f66fb7fe640 1 -- 172.21.15.2:0/2723532021 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7f66fc044e40 con 0x7f670410dbb0 2024-08-31T04:16:41.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 msgr2=0x7f66f00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 0x7f66f00417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f670406ba00 tx=0x7f6700005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 msgr2=0x7f670419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0098d0 tx=0x7f66fc0317b0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 shutdown_connections 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66f003f2d0 0x7f66f00417e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670410dbb0 0x7f670419fa40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67041050a0 0x7f670419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 --2- 172.21.15.2:0/2723532021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6704104750 0x7f670419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 >> 172.21.15.2:0/2723532021 conn(0x7f67040794d0 msgr2=0x7f6704105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 shutdown_connections 2024-08-31T04:16:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.899+0000 7f670c777640 1 -- 172.21.15.2:0/2723532021 wait complete. 2024-08-31T04:16:42.067 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 podman[25089]: 2024-08-31 04:16:41.670651385 +0000 UTC m=+0.391793280 container start ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T04:16:42.067 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 ceph-mgr[25108]: -- 172.21.15.132:0/2527526502 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fba2ad10e0 con 0x55fba2aefa80 2024-08-31T04:16:42.067 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 bash[25089]: ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff 2024-08-31T04:16:42.067 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:16:41 smithi132 systemd[1]: Started Ceph mgr.z for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:16:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 -- 172.21.15.2:0/3134743476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 msgr2=0x7fa394109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3134743476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa394109650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa380009900 tx=0x7fa38002a410 comp rx=0 tx=0).stop 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 -- 172.21.15.2:0/3134743476 shutdown_connections 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3134743476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa394109650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3134743476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 0x7fa3941103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3134743476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 0x7fa394103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 -- 172.21.15.2:0/3134743476 >> 172.21.15.2:0/3134743476 conn(0x7fa39407b5f0 msgr2=0x7fa39407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.380+0000 7fa39aa93640 1 -- 172.21.15.2:0/3134743476 shutdown_connections 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 -- 172.21.15.2:0/3134743476 wait complete. 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 Processor -- start 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 -- start start 2024-08-31T04:16:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 0x7fa39419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 0x7fa39419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa394113850 con 0x7fa394109240 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941136d0 con 0x7fa394103900 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.381+0000 7fa39aa93640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941139d0 con 0x7fa394109b90 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41774/0 (socket says 172.21.15.2:41774) 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 -- 172.21.15.2:0/3539324662 learned_addr learned my addr 172.21.15.2:0/3539324662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa399030640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 0x7fa39419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa39882f640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 0x7fa39419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 -- 172.21.15.2:0/3539324662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 msgr2=0x7fa39419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 0x7fa39419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 -- 172.21.15.2:0/3539324662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 msgr2=0x7fa39419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 0x7fa39419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 -- 172.21.15.2:0/3539324662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3941a0190 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa393fff640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa38002a930 tx=0x7fa380004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38003f030 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa380003aa0 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3941a0420 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.382+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380035070 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.383+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941a6be0 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394104b80 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fa380042030 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa391ffb640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 0x7fa3840417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa3800741d0 con 0x7fa394109240 2024-08-31T04:16:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa39882f640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 0x7fa3840417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.384+0000 7fa39882f640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 0x7fa3840417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa388005fd0 tx=0x7fa388005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.389+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa380038350 con 0x7fa394109240 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.574+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa39410b980 con 0x7fa394109240 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.577+0000 7fa391ffb640 1 -- 172.21.15.2:0/3539324662 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7fa38003ae40 con 0x7fa394109240 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 msgr2=0x7fa3840417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 0x7fa3840417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa388005fd0 tx=0x7fa388005850 comp rx=0 tx=0).stop 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 msgr2=0x7fa39419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa38002a930 tx=0x7fa380004270 comp rx=0 tx=0).stop 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 shutdown_connections 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa38403f2d0 0x7fa3840417e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa394109240 0x7fa39419a7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa394109b90 0x7fa39419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 --2- 172.21.15.2:0/3539324662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa394103900 0x7fa39419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 >> 172.21.15.2:0/3539324662 conn(0x7fa39407b5f0 msgr2=0x7fa394107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 shutdown_connections 2024-08-31T04:16:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:41.580+0000 7fa39aa93640 1 -- 172.21.15.2:0/3539324662 wait complete. 2024-08-31T04:16:42.853 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3539324662' entity='client.admin' 2024-08-31T04:16:42.853 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.853 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.853 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.854 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:42.854 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:42.854 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:42.854 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:42.854 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2723532021' entity='client.admin' 2024-08-31T04:16:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3539324662' entity='client.admin' 2024-08-31T04:16:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2723532021' entity='client.admin' 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3539324662' entity='client.admin' 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:16:43.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:43.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:43.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2723532021' entity='client.admin' 2024-08-31T04:16:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- 172.21.15.2:0/2985249851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 msgr2=0x7f29a8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 --2- 172.21.15.2:0/2985249851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a8108570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2994009900 tx=0x7f299402a410 comp rx=0 tx=0).stop 2024-08-31T04:16:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- 172.21.15.2:0/2985249851 shutdown_connections 2024-08-31T04:16:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 --2- 172.21.15.2:0/2985249851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a8108570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 --2- 172.21.15.2:0/2985249851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 0x7f29a810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 --2- 172.21.15.2:0/2985249851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- 172.21.15.2:0/2985249851 >> 172.21.15.2:0/2985249851 conn(0x7f29a80794e0 msgr2=0x7f29a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- 172.21.15.2:0/2985249851 shutdown_connections 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- 172.21.15.2:0/2985249851 wait complete. 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 Processor -- start 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.459+0000 7f29aefb3640 1 -- start start 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 0x7f29a819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:43.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8113840 con 0x7f29a8108160 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29a81136c0 con 0x7f29a8108ab0 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29aefb3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29a81139c0 con 0x7f29a8102820 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41818/0 (socket says 172.21.15.2:41818) 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 -- 172.21.15.2:0/3023323644 learned_addr learned my addr 172.21.15.2:0/3023323644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29acd4f640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29ad550640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 0x7f29a819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 -- 172.21.15.2:0/3023323644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 msgr2=0x7f29a819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 -- 172.21.15.2:0/3023323644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 msgr2=0x7f29a819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 0x7f29a819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 -- 172.21.15.2:0/3023323644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a81a0160 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29acd4f640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.460+0000 7f29a7fff640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2994032fd0 tx=0x7f2994031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.461+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299403f030 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.461+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2994004490 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.461+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a81a03f0 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.461+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994035070 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.461+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a81a6bb0 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.462+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f2994042030 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.462+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a8103aa0 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.462+0000 7f29a5ffb640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 0x7f29980417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.462+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2994073f80 con 0x7f29a8108160 2024-08-31T04:16:43.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.463+0000 7f29acd4f640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 0x7f29980417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:43.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.463+0000 7f29acd4f640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 0x7f29980417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f299c009fc0 tx=0x7f299c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:43.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.467+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29940303a0 con 0x7f29a8108160 2024-08-31T04:16:43.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.658+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f29a819b320 con 0x7f29a8108160 2024-08-31T04:16:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.662+0000 7f29a5ffb640 1 -- 172.21.15.2:0/3023323644 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f29a819b320 con 0x7f29a8108160 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 msgr2=0x7f29980417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 0x7f29980417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f299c009fc0 tx=0x7f299c005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 msgr2=0x7f29a819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2994032fd0 tx=0x7f2994031a20 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 shutdown_connections 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299803f2d0 0x7f29980417e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a8108160 0x7f29a819a790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a8108ab0 0x7f29a819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 --2- 172.21.15.2:0/3023323644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29a8102820 0x7f29a819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 >> 172.21.15.2:0/3023323644 conn(0x7f29a80794e0 msgr2=0x7f29a81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 shutdown_connections 2024-08-31T04:16:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:43.664+0000 7f29aefb3640 1 -- 172.21.15.2:0/3023323644 wait complete. 2024-08-31T04:16:43.729 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:43 smithi002 ceph-mon[18656]: Deploying daemon mgr.y on smithi064 2024-08-31T04:16:43.753 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:43 smithi064 ceph-mon[22007]: Deploying daemon mgr.y on smithi064 2024-08-31T04:16:43.847 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:43 smithi132 ceph-mon[22335]: Deploying daemon mgr.y on smithi064 2024-08-31T04:16:44.019 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:16:43 smithi064 podman[24313]: 2024-08-31 04:16:43.985014094 +0000 UTC m=+0.346081409 container start 17324dfcc8f775209b409796ef07d728371dfd49950b3dab1f14a8e0e1669768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-08-31T04:16:44.019 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mgr[24332]: -- 172.21.15.64:0/4224737393 <== mon.2 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565b61c90e0 con 0x5565b61e7a80 2024-08-31T04:16:44.317 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:16:44 smithi064 bash[24313]: 17324dfcc8f775209b409796ef07d728371dfd49950b3dab1f14a8e0e1669768 2024-08-31T04:16:44.317 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:16:44 smithi064 systemd[1]: Started Ceph mgr.y for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:16:44.870 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3023323644' entity='client.admin' 2024-08-31T04:16:44.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:44.991 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3023323644' entity='client.admin' 2024-08-31T04:16:44.991 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.992 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.992 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.992 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:44.992 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 -- 172.21.15.2:0/1599388081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 msgr2=0x7fe7001085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 --2- 172.21.15.2:0/1599388081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe7001085d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009900 tx=0x7fe6f002a410 comp rx=0 tx=0).stop 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 -- 172.21.15.2:0/1599388081 shutdown_connections 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 --2- 172.21.15.2:0/1599388081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe7001085d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 --2- 172.21.15.2:0/1599388081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 0x7fe70010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 --2- 172.21.15.2:0/1599388081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe700102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 -- 172.21.15.2:0/1599388081 >> 172.21.15.2:0/1599388081 conn(0x7fe700079510 msgr2=0x7fe700079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 -- 172.21.15.2:0/1599388081 shutdown_connections 2024-08-31T04:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.049+0000 7fe7082c7640 1 -- 172.21.15.2:0/1599388081 wait complete. 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 Processor -- start 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 -- start start 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe70019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 0x7fe70019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7001138f0 con 0x7fe7001081c0 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe700113770 con 0x7fe700102880 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe7082c7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe700113a70 con 0x7fe700108b10 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe705862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe706063640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe70019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe705862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41836/0 (socket says 172.21.15.2:41836) 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.050+0000 7fe705862640 1 -- 172.21.15.2:0/2000495907 learned_addr learned my addr 172.21.15.2:0/2000495907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe706864640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 0x7fe70019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 -- 172.21.15.2:0/2000495907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 msgr2=0x7fe70019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 0x7fe70019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 -- 172.21.15.2:0/2000495907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 msgr2=0x7fe70019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe70019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 -- 172.21.15.2:0/2000495907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7001a0270 con 0x7fe7001081c0 2024-08-31T04:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe706063640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe70019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe705862640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002a930 tx=0x7fe6f0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f003f030 con 0x7fe7001081c0 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f0004490 con 0x7fe7001081c0 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7001a0500 con 0x7fe7001081c0 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0035070 con 0x7fe7001081c0 2024-08-31T04:16:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.051+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7001a6cc0 con 0x7fe7001081c0 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.052+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe700103b00 con 0x7fe7001081c0 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.052+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fe6f0042030 con 0x7fe7001081c0 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.053+0000 7fe6f77fe640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 0x7fe6ec0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.053+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe6f0073ea0 con 0x7fe7001081c0 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.053+0000 7fe706063640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 0x7fe6ec0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.053+0000 7fe706063640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 0x7fe6ec0417e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009fc0 tx=0x7fe6fc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.058+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6f00303a0 con 0x7fe7001081c0 2024-08-31T04:16:45.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3023323644' entity='client.admin' 2024-08-31T04:16:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.247+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe70010a900 con 0x7fe7001081c0 2024-08-31T04:16:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.251+0000 7fe6f77fe640 1 -- 172.21.15.2:0/2000495907 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7fe6f002f300 con 0x7fe7001081c0 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.253+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 msgr2=0x7fe6ec0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.253+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 0x7fe6ec0417e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009fc0 tx=0x7fe6fc005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.253+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 msgr2=0x7fe70019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.253+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002a930 tx=0x7fe6f0031a20 comp rx=0 tx=0).stop 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.253+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 shutdown_connections 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe6ec03f2d0 0x7fe6ec0417e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7001081c0 0x7fe70019a8a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700108b10 0x7fe70019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 --2- 172.21.15.2:0/2000495907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe700102880 0x7fe70019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 >> 172.21.15.2:0/2000495907 conn(0x7fe700079510 msgr2=0x7fe700104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 shutdown_connections 2024-08-31T04:16:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.254+0000 7fe7082c7640 1 -- 172.21.15.2:0/2000495907 wait complete. 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 -- 172.21.15.2:0/2352422332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc105010 msgr2=0x7fa9cc10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/2352422332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc105010 0x7fa9cc10d650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009900 tx=0x7fa9c002a410 comp rx=0 tx=0).stop 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 -- 172.21.15.2:0/2352422332 shutdown_connections 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/2352422332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc105010 0x7fa9cc10d650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/2352422332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/2352422332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 -- 172.21.15.2:0/2352422332 >> 172.21.15.2:0/2352422332 conn(0x7fa9cc0794d0 msgr2=0x7fa9cc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 -- 172.21.15.2:0/2352422332 shutdown_connections 2024-08-31T04:16:45.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.270+0000 7fa9d0a44640 1 -- 172.21.15.2:0/2352422332 wait complete. 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.271+0000 7fa9d0a44640 1 Processor -- start 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.271+0000 7fa9d0a44640 1 -- start start 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc105010 0x7fa9cc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1137d0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc113650 con 0x7fa9cc10db90 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9d0a44640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc113950 con 0x7fa9cc105010 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41852/0 (socket says 172.21.15.2:41852) 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 -- 172.21.15.2:0/1665527317 learned_addr learned my addr 172.21.15.2:0/1665527317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9cad9d640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9c9d9b640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc105010 0x7fa9cc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 -- 172.21.15.2:0/1665527317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc105010 msgr2=0x7fa9cc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc105010 0x7fa9cc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 -- 172.21.15.2:0/1665527317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 msgr2=0x7fa9cc19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9ca59c640 1 -- 172.21.15.2:0/1665527317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc1a01b0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.272+0000 7fa9cad9d640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9ca59c640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00e9c0 tx=0x7fa9bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00cde0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9bc0108e0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc1a04a0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc018960 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.273+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1023d0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.274+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fa9bc01f020 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.274+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc1049f0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.274+0000 7fa9bb7fe640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 0x7fa9b40417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.274+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa9bc054b90 con 0x7fa9cc1045e0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.275+0000 7fa9c9d9b640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 0x7fa9b40417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.275+0000 7fa9c9d9b640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 0x7fa9b40417e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009230 tx=0x7fa9c0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.280+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa9bc0203a0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.470+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa9cc19b370 con 0x7fa9cc1045e0 2024-08-31T04:16:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.474+0000 7fa9bb7fe640 1 -- 172.21.15.2:0/1665527317 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fa9bc010db0 con 0x7fa9cc1045e0 2024-08-31T04:16:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 msgr2=0x7fa9b40417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 0x7fa9b40417e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009230 tx=0x7fa9c0031400 comp rx=0 tx=0).stop 2024-08-31T04:16:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 msgr2=0x7fa9cc19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00e9c0 tx=0x7fa9bc00ee80 comp rx=0 tx=0).stop 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 shutdown_connections 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9cc10db90 0x7fa9cc19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9cc105010 0x7fa9cc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9b403f2d0 0x7fa9b40417e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 --2- 172.21.15.2:0/1665527317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9cc1045e0 0x7fa9cc19a240 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 >> 172.21.15.2:0/1665527317 conn(0x7fa9cc0794d0 msgr2=0x7fa9cc0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 shutdown_connections 2024-08-31T04:16:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.477+0000 7fa9d0a44640 1 -- 172.21.15.2:0/1665527317 wait complete. 2024-08-31T04:16:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 -- 172.21.15.2:0/2527244919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c103930 msgr2=0x7fc58c103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 --2- 172.21.15.2:0/2527244919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c103930 0x7fc58c103d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc588009900 tx=0x7fc58802a410 comp rx=0 tx=0).stop 2024-08-31T04:16:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 -- 172.21.15.2:0/2527244919 shutdown_connections 2024-08-31T04:16:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 --2- 172.21.15.2:0/2527244919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c109bc0 0x7fc58c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 --2- 172.21.15.2:0/2527244919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 --2- 172.21.15.2:0/2527244919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c103930 0x7fc58c103d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.782+0000 7fc59370e640 1 -- 172.21.15.2:0/2527244919 >> 172.21.15.2:0/2527244919 conn(0x7fc58c0ff380 msgr2=0x7fc58c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.783+0000 7fc59370e640 1 -- 172.21.15.2:0/2527244919 shutdown_connections 2024-08-31T04:16:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.783+0000 7fc59370e640 1 -- 172.21.15.2:0/2527244919 wait complete. 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.784+0000 7fc59370e640 1 Processor -- start 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.784+0000 7fc59370e640 1 -- start start 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.784+0000 7fc59370e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.784+0000 7fc59370e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.784+0000 7fc59370e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc5914aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc5914aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:52874/0 (socket says 172.21.15.2:52874) 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc590ca9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc590ca9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:56124/0 (socket says 172.21.15.2:56124) 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc591cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc591cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52298/0 (socket says 172.21.15.2:52298) 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc59370e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c113880 con 0x7fc58c109bc0 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc59370e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c113700 con 0x7fc58c109270 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc59370e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c113a00 con 0x7fc58c103930 2024-08-31T04:16:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.785+0000 7fc5914aa640 1 -- 172.21.15.2:0/1208964471 learned_addr learned my addr 172.21.15.2:0/1208964471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 -- 172.21.15.2:0/1208964471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 msgr2=0x7fc58c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 -- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 msgr2=0x7fc58c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 -- 172.21.15.2:0/1208964471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1a01c0 con 0x7fc58c103930 2024-08-31T04:16:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc591cab640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5914aa640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc588005940 tx=0x7fc5880040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.786+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58803f030 con 0x7fc58c103930 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.787+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1a0450 con 0x7fc58c103930 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.787+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c1a6c10 con 0x7fc58c103930 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.787+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5880044c0 con 0x7fc58c103930 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.787+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588035070 con 0x7fc58c103930 2024-08-31T04:16:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.788+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fc588042030 con 0x7fc58c103930 2024-08-31T04:16:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.788+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5700052c0 con 0x7fc58c103930 2024-08-31T04:16:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.789+0000 7fc5827fc640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 0x7fc5780417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.789+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc588074d70 con 0x7fc58c103930 2024-08-31T04:16:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.789+0000 7fc590ca9640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 0x7fc5780417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.790+0000 7fc590ca9640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 0x7fc5780417e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc58c108db0 tx=0x7fc57c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.794+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc588049030 con 0x7fc58c103930 2024-08-31T04:16:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.981+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fc5700055b0 con 0x7fc58c103930 2024-08-31T04:16:45.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.988+0000 7fc5827fc640 1 -- 172.21.15.2:0/1208964471 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7fc58802ee90 con 0x7fc58c103930 2024-08-31T04:16:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 msgr2=0x7fc5780417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 0x7fc5780417e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc58c108db0 tx=0x7fc57c005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 msgr2=0x7fc58c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc588005940 tx=0x7fc5880040c0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 shutdown_connections 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc57803f2d0 0x7fc5780417e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc58c109bc0 0x7fc58c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc58c109270 0x7fc58c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 --2- 172.21.15.2:0/1208964471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc58c103930 0x7fc58c19a250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 >> 172.21.15.2:0/1208964471 conn(0x7fc58c0ff380 msgr2=0x7fc58c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 shutdown_connections 2024-08-31T04:16:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:45.990+0000 7fc59370e640 1 -- 172.21.15.2:0/1208964471 wait complete. 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2000495907' entity='client.admin' 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: Reconfiguring daemon mgr.x on smithi002 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1665527317' entity='client.admin' 2024-08-31T04:16:46.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:46 smithi002 ceph-mon[18656]: from='client.? ' entity='client.admin' 2024-08-31T04:16:46.462 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.462 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2000495907' entity='client.admin' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: Reconfiguring daemon mgr.x on smithi002 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1665527317' entity='client.admin' 2024-08-31T04:16:46.463 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:46 smithi064 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2000495907' entity='client.admin' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: Reconfiguring daemon mgr.x on smithi002 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1665527317' entity='client.admin' 2024-08-31T04:16:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:46 smithi132 ceph-mon[22335]: from='client.? ' entity='client.admin' 2024-08-31T04:16:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 -- 172.21.15.2:0/626171542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c10dbc0 msgr2=0x7f095c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 --2- 172.21.15.2:0/626171542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c10dbc0 0x7f095c1100a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0954009900 tx=0x7f095402a410 comp rx=0 tx=0).stop 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 -- 172.21.15.2:0/626171542 shutdown_connections 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 --2- 172.21.15.2:0/626171542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c10dbc0 0x7f095c1100a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 --2- 172.21.15.2:0/626171542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c105040 0x7f095c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 --2- 172.21.15.2:0/626171542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 0x7f095c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 -- 172.21.15.2:0/626171542 >> 172.21.15.2:0/626171542 conn(0x7f095c0794d0 msgr2=0x7f095c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 -- 172.21.15.2:0/626171542 shutdown_connections 2024-08-31T04:16:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.459+0000 7f09638d2640 1 -- 172.21.15.2:0/626171542 wait complete. 2024-08-31T04:16:47.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: Standby manager daemon z started 2024-08-31T04:16:47.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:16:47.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:47.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:16:47.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:47.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:47 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4130484926' entity='client.admin' 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 Processor -- start 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 -- start start 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 0x7f095c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c10dbc0 0x7f095c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f095c113830 con 0x7f095c105040 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f095c1136b0 con 0x7f095c104610 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f09638d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f095c1139b0 con 0x7f095c10dbc0 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52336/0 (socket says 172.21.15.2:52336) 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 -- 172.21.15.2:0/2595532167 learned_addr learned my addr 172.21.15.2:0/2595532167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f096166e640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 0x7f095c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0961e6f640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c10dbc0 0x7f095c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 -- 172.21.15.2:0/2595532167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c10dbc0 msgr2=0x7f095c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c10dbc0 0x7f095c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 -- 172.21.15.2:0/2595532167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 msgr2=0x7f095c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 0x7f095c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.460+0000 7f0960e6d640 1 -- 172.21.15.2:0/2595532167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c1a0210 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f0960e6d640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f095000e9c0 tx=0x7f095000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095000ccc0 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09500054d0 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c1a0500 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950010430 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.461+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c1a6c60 con 0x7f095c105040 2024-08-31T04:16:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.462+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095c06bf00 con 0x7f095c105040 2024-08-31T04:16:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.462+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 101903+0+0 (secure 0 0 0) 0x7f09500105d0 con 0x7f095c105040 2024-08-31T04:16:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.463+0000 7f095a7fc640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 0x7f094407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.463+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f095009bb00 con 0x7f095c105040 2024-08-31T04:16:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.463+0000 7f096166e640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 0x7f094407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.464+0000 7f096166e640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 0x7f094407c3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f094c005fd0 tx=0x7f094c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.468+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0950064950 con 0x7f095c105040 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: Standby manager daemon z started 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:47 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4130484926' entity='client.admin' 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: Standby manager daemon z started 2024-08-31T04:16:47.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:16:47.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:47.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:16:47.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.132:0/1350576589' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:47.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:47 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4130484926' entity='client.admin' 2024-08-31T04:16:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 -- 172.21.15.2:0/3865294180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624108a90 msgr2=0x7f562410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 --2- 172.21.15.2:0/3865294180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624108a90 0x7f562410f2c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f561c009ca0 tx=0x7f561c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 -- 172.21.15.2:0/3865294180 shutdown_connections 2024-08-31T04:16:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 --2- 172.21.15.2:0/3865294180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624108a90 0x7f562410f2c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 --2- 172.21.15.2:0/3865294180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 0x7f5624108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 --2- 172.21.15.2:0/3865294180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624102800 0x7f5624102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 -- 172.21.15.2:0/3865294180 >> 172.21.15.2:0/3865294180 conn(0x7f56240794d0 msgr2=0x7f56240798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 -- 172.21.15.2:0/3865294180 shutdown_connections 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.719+0000 7f562c7a7640 1 -- 172.21.15.2:0/3865294180 wait complete. 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 Processor -- start 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 -- start start 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 0x7f562419b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624108a90 0x7f562419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5624112710 con 0x7f5624102800 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5624112590 con 0x7f5624108140 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562c7a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5624112890 con 0x7f5624108a90 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52318/0 (socket says 172.21.15.2:52318) 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 -- 172.21.15.2:0/4130484926 learned_addr learned my addr 172.21.15.2:0/4130484926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f5629d42640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 0x7f562419b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562ad44640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624108a90 0x7f562419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 -- 172.21.15.2:0/4130484926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624108a90 msgr2=0x7f562419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624108a90 0x7f562419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 -- 172.21.15.2:0/4130484926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 msgr2=0x7f562419b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 0x7f562419b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.720+0000 7f562a543640 1 -- 172.21.15.2:0/4130484926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56241a63d0 con 0x7f5624102800 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f562a543640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f562000e9f0 tx=0x7f562000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562000cd80 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56200054d0 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620010690 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241a66c0 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.721+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a6bb0 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.722+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f5620004e90 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.722+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624102c10 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.722+0000 7f561b7fe640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 0x7f56100417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.722+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5620053f60 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.722+0000 7f5629d42640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 0x7f56100417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.723+0000 7f5629d42640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 0x7f56100417e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5624105d20 tx=0x7f561400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.727+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5620011dc0 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.917+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f562402e430 con 0x7f5624102800 2024-08-31T04:16:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.920+0000 7f561b7fe640 1 -- 172.21.15.2:0/4130484926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f56200046c0 con 0x7f5624102800 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 msgr2=0x7f56100417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 0x7f56100417e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5624105d20 tx=0x7f561400b410 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 msgr2=0x7f562419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f562000e9f0 tx=0x7f562000edf0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 shutdown_connections 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5624108a90 0x7f562419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5624108140 0x7f562419b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f561003f2d0 0x7f56100417e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.922+0000 7f562c7a7640 1 --2- 172.21.15.2:0/4130484926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5624102800 0x7f562419b0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.923+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 >> 172.21.15.2:0/4130484926 conn(0x7f56240794d0 msgr2=0x7f56241041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.923+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 shutdown_connections 2024-08-31T04:16:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:46.923+0000 7f562c7a7640 1 -- 172.21.15.2:0/4130484926 wait complete. 2024-08-31T04:16:47.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.656+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f095c19b3d0 con 0x7f095c105040 2024-08-31T04:16:47.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.660+0000 7f095a7fc640 1 -- 172.21.15.2:0/2595532167 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f095c19b3d0 con 0x7f095c105040 2024-08-31T04:16:47.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 msgr2=0x7f094407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 0x7f094407c3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f094c005fd0 tx=0x7f094c009500 comp rx=0 tx=0).stop 2024-08-31T04:16:47.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 msgr2=0x7f095c19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:47.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f095000e9c0 tx=0x7f095000ee80 comp rx=0 tx=0).stop 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 shutdown_connections 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0944079ee0 0x7f094407c3f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f095c105040 0x7f095c19a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095c10dbc0 0x7f095c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 --2- 172.21.15.2:0/2595532167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095c104610 0x7f095c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 >> 172.21.15.2:0/2595532167 conn(0x7f095c0794d0 msgr2=0x7f095c1056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 shutdown_connections 2024-08-31T04:16:47.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:47.663+0000 7f09638d2640 1 -- 172.21.15.2:0/2595532167 wait complete. 2024-08-31T04:16:48.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:48 smithi002 ceph-mon[18656]: mgrmap e18: x(active, since 14s), standbys: z 2024-08-31T04:16:48.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:16:48.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:48 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2595532167' entity='client.admin' 2024-08-31T04:16:48.457 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-08-31T04:16:48.457 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi002') 2024-08-31T04:16:48.457 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi002') 2024-08-31T04:16:48.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:48 smithi064 ceph-mon[22007]: mgrmap e18: x(active, since 14s), standbys: z 2024-08-31T04:16:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:16:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:48 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2595532167' entity='client.admin' 2024-08-31T04:16:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:48 smithi132 ceph-mon[22335]: mgrmap e18: x(active, since 14s), standbys: z 2024-08-31T04:16:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:16:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:48 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2595532167' entity='client.admin' 2024-08-31T04:16:49.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi002') 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: Standby manager daemon y started 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:16:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:49 smithi002 ceph-mon[18656]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: Standby manager daemon y started 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:49 smithi064 ceph-mon[22007]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:49.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:49.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: Standby manager daemon y started 2024-08-31T04:16:49.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:16:49.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:16:49.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:16:49.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:49 smithi132 ceph-mon[22335]: from='mgr.? 172.21.15.64:0/1488399191' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:16:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.973+0000 7f47d68f5640 1 -- 172.21.15.2:0/2559160932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 msgr2=0x7f47d0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.973+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2559160932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d0109650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009900 tx=0x7f47c402a410 comp rx=0 tx=0).stop 2024-08-31T04:16:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 -- 172.21.15.2:0/2559160932 shutdown_connections 2024-08-31T04:16:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2559160932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d0109650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2559160932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0109b90 0x7f47d01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2559160932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0103900 0x7f47d0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 -- 172.21.15.2:0/2559160932 >> 172.21.15.2:0/2559160932 conn(0x7f47d007b5f0 msgr2=0x7f47d007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 -- 172.21.15.2:0/2559160932 shutdown_connections 2024-08-31T04:16:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 -- 172.21.15.2:0/2559160932 wait complete. 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 Processor -- start 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.974+0000 7f47d68f5640 1 -- start start 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 0x7f47d019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0109b90 0x7f47d01a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01138a0 con 0x7f47d0109240 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0113720 con 0x7f47d0103900 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d68f5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0113a20 con 0x7f47d0109b90 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52364/0 (socket says 172.21.15.2:52364) 2024-08-31T04:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 -- 172.21.15.2:0/2708283931 learned_addr learned my addr 172.21.15.2:0/2708283931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cffff640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 0x7f47d019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47d4e92640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0109b90 0x7f47d01a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 -- 172.21.15.2:0/2708283931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0109b90 msgr2=0x7f47d01a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0109b90 0x7f47d01a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 -- 172.21.15.2:0/2708283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 msgr2=0x7f47d019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 0x7f47d019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 -- 172.21.15.2:0/2708283931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d01a22e0 con 0x7f47d0109240 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cffff640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 0x7f47d019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.975+0000 7f47cf7fe640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47c4031440 tx=0x7f47c4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.976+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c403f070 con 0x7f47d0109240 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.976+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d01a2570 con 0x7f47d0109240 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.976+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47c4031d60 con 0x7f47d0109240 2024-08-31T04:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.976+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4035030 con 0x7f47d0109240 2024-08-31T04:16:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.976+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01a2aa0 con 0x7f47d0109240 2024-08-31T04:16:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.977+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0103d10 con 0x7f47d0109240 2024-08-31T04:16:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.979+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f47c4042070 con 0x7f47d0109240 2024-08-31T04:16:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.980+0000 7f47cd7fa640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 0x7f47b80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.980+0000 7f47cffff640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 0x7f47b80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.980+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f47c4104110 con 0x7f47d0109240 2024-08-31T04:16:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.981+0000 7f47cffff640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 0x7f47b80b7030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c000abe0 tx=0x7f47c000a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:49.983+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f47d01a2aa0 con 0x7f47d0109240 2024-08-31T04:16:50.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.170+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f47d01a8f40 con 0x7f47d0109240 2024-08-31T04:16:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.175+0000 7f47cd7fa640 1 -- 172.21.15.2:0/2708283931 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f47c40ccda0 con 0x7f47d0109240 2024-08-31T04:16:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 msgr2=0x7f47b80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 0x7f47b80b7030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c000abe0 tx=0x7f47c000a5c0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 msgr2=0x7f47d019c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47c4031440 tx=0x7f47c4003d50 comp rx=0 tx=0).stop 2024-08-31T04:16:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 shutdown_connections 2024-08-31T04:16:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47b80b4b20 0x7f47b80b7030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d0109240 0x7f47d019c9d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47d0109b90 0x7f47d01a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 --2- 172.21.15.2:0/2708283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0103900 0x7f47d019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 >> 172.21.15.2:0/2708283931 conn(0x7f47d007b5f0 msgr2=0x7f47d0104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 -- 172.21.15.2:0/1987044620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28010dbc0 msgr2=0x7ff2801100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 --2- 172.21.15.2:0/1987044620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28010dbc0 0x7ff2801100b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff278009ca0 tx=0x7ff27802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 -- 172.21.15.2:0/1987044620 shutdown_connections 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 --2- 172.21.15.2:0/1987044620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28010dbc0 0x7ff2801100b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 --2- 172.21.15.2:0/1987044620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2801050b0 0x7ff28010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 --2- 172.21.15.2:0/1987044620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280104760 0x7ff280104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 -- 172.21.15.2:0/1987044620 >> 172.21.15.2:0/1987044620 conn(0x7ff2800794d0 msgr2=0x7ff2800798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 shutdown_connections 2024-08-31T04:16:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7f47d68f5640 1 -- 172.21.15.2:0/2708283931 wait complete. 2024-08-31T04:16:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 -- 172.21.15.2:0/1987044620 shutdown_connections 2024-08-31T04:16:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.178+0000 7ff285075640 1 -- 172.21.15.2:0/1987044620 wait complete. 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.179+0000 7ff285075640 1 Processor -- start 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.179+0000 7ff285075640 1 -- start start 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.179+0000 7ff285075640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.179+0000 7ff285075640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2801050b0 0x7ff28019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff285075640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 0x7ff28019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff285075640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff280113820 con 0x7ff280104760 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff285075640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801136a0 con 0x7ff28010dbc0 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff285075640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801139a0 con 0x7ff2801050b0 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52368/0 (socket says 172.21.15.2:52368) 2024-08-31T04:16:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 -- 172.21.15.2:0/4191187923 learned_addr learned my addr 172.21.15.2:0/4191187923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27f59e640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 0x7ff28019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27e59c640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2801050b0 0x7ff28019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 -- 172.21.15.2:0/4191187923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2801050b0 msgr2=0x7ff28019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2801050b0 0x7ff28019a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 -- 172.21.15.2:0/4191187923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 msgr2=0x7ff28019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 0x7ff28019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 -- 172.21.15.2:0/4191187923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2801a0260 con 0x7ff280104760 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27f59e640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 0x7ff28019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.180+0000 7ff27ed9d640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff27000d770 tx=0x7ff27000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.181+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270017070 con 0x7ff280104760 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.181+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff270009c30 con 0x7ff280104760 2024-08-31T04:16:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.181+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2801a0550 con 0x7ff280104760 2024-08-31T04:16:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.181+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270003cc0 con 0x7ff280104760 2024-08-31T04:16:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.181+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2801a6cb0 con 0x7ff280104760 2024-08-31T04:16:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.182+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28006bf80 con 0x7ff280104760 2024-08-31T04:16:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.183+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7ff270003e60 con 0x7ff280104760 2024-08-31T04:16:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.184+0000 7ff267fff640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 0x7ff2680b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.184+0000 7ff27e59c640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 0x7ff2680b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.184+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff2700e2ec0 con 0x7ff280104760 2024-08-31T04:16:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.185+0000 7ff27e59c640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 0x7ff2680b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff28010f990 tx=0x7ff27400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.188+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff270009de0 con 0x7ff280104760 2024-08-31T04:16:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.381+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7ff2801a6f40 con 0x7ff280104760 2024-08-31T04:16:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.386+0000 7ff267fff640 1 -- 172.21.15.2:0/4191187923 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v26)=0 v26) ==== 133+0+0 (secure 0 0 0) 0x7ff2700ab580 con 0x7ff280104760 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 msgr2=0x7ff2680b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 0x7ff2680b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff28010f990 tx=0x7ff27400b390 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 msgr2=0x7ff28019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff27000d770 tx=0x7ff27000dc30 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 shutdown_connections 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28010dbc0 0x7ff28019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2801050b0 0x7ff28019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2680b4af0 0x7ff2680b7000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 --2- 172.21.15.2:0/4191187923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff280104760 0x7ff28019a2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 >> 172.21.15.2:0/4191187923 conn(0x7ff2800794d0 msgr2=0x7ff280106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 shutdown_connections 2024-08-31T04:16:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.389+0000 7ff285075640 1 -- 172.21.15.2:0/4191187923 wait complete. 2024-08-31T04:16:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:50 smithi002 ceph-mon[18656]: mgrmap e19: x(active, since 16s), standbys: z, y 2024-08-31T04:16:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:16:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:50 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2708283931' entity='client.admin' 2024-08-31T04:16:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:50 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4191187923' entity='client.admin' 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 -- 172.21.15.2:0/1689564421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc190102880 msgr2=0x7fc190102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 --2- 172.21.15.2:0/1689564421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc190102880 0x7fc190102c90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009900 tx=0x7fc18c02a410 comp rx=0 tx=0).stop 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 -- 172.21.15.2:0/1689564421 shutdown_connections 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 --2- 172.21.15.2:0/1689564421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190108b10 0x7fc19010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 --2- 172.21.15.2:0/1689564421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1901081c0 0x7fc1901085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 --2- 172.21.15.2:0/1689564421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc190102880 0x7fc190102c90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 -- 172.21.15.2:0/1689564421 >> 172.21.15.2:0/1689564421 conn(0x7fc190079510 msgr2=0x7fc190079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.786+0000 7fc198022640 1 -- 172.21.15.2:0/1689564421 shutdown_connections 2024-08-31T04:16:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.787+0000 7fc198022640 1 -- 172.21.15.2:0/1689564421 wait complete. 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.787+0000 7fc198022640 1 Processor -- start 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.787+0000 7fc198022640 1 -- start start 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.787+0000 7fc198022640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 0x7fc19019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc190108b10 0x7fc19019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1901127e0 con 0x7fc1901081c0 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc190112660 con 0x7fc190102880 2024-08-31T04:16:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc190112960 con 0x7fc190108b10 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52386/0 (socket says 172.21.15.2:52386) 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 -- 172.21.15.2:0/879893871 learned_addr learned my addr 172.21.15.2:0/879893871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1965bf640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc190108b10 0x7fc19019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc195dbe640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 0x7fc19019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 -- 172.21.15.2:0/879893871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc190108b10 msgr2=0x7fc19019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc190108b10 0x7fc19019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 -- 172.21.15.2:0/879893871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 msgr2=0x7fc19019a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 0x7fc19019a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 -- 172.21.15.2:0/879893871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1901a0250 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc195dbe640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 0x7fc19019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc1955bd640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d750 tx=0x7fc18000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180017070 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1800054d0 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180004c30 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.788+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1901a0540 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.789+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1901a6ca0 con 0x7fc1901081c0 2024-08-31T04:16:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.790+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc190103b00 con 0x7fc1901081c0 2024-08-31T04:16:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.791+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fc180004dd0 con 0x7fc1901081c0 2024-08-31T04:16:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.792+0000 7fc186ffd640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 0x7fc17c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.792+0000 7fc195dbe640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 0x7fc17c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.792+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc1800e32b0 con 0x7fc1901081c0 2024-08-31T04:16:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.792+0000 7fc195dbe640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 0x7fc17c0b7080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc18c031440 tx=0x7fc18c009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.795+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1800ac060 con 0x7fc1901081c0 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:50 smithi064 ceph-mon[22007]: mgrmap e19: x(active, since 16s), standbys: z, y 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:50 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2708283931' entity='client.admin' 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:50 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4191187923' entity='client.admin' 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:50 smithi132 ceph-mon[22335]: mgrmap e19: x(active, since 16s), standbys: z, y 2024-08-31T04:16:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:16:50.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:50 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2708283931' entity='client.admin' 2024-08-31T04:16:50.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:50 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4191187923' entity='client.admin' 2024-08-31T04:16:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.981+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fc190102c90 con 0x7fc1901081c0 2024-08-31T04:16:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.985+0000 7fc186ffd640 1 -- 172.21.15.2:0/879893871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) ==== 138+0+0 (secure 0 0 0) 0x7fc1800ab960 con 0x7fc1901081c0 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 msgr2=0x7fc17c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 0x7fc17c0b7080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc18c031440 tx=0x7fc18c009680 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 msgr2=0x7fc19019a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d750 tx=0x7fc18000dc10 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 shutdown_connections 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc17c0b4b70 0x7fc17c0b7080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1901081c0 0x7fc19019a880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc190108b10 0x7fc19019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 --2- 172.21.15.2:0/879893871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc190102880 0x7fc19019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:50.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 >> 172.21.15.2:0/879893871 conn(0x7fc190079510 msgr2=0x7fc1901018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:50.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 shutdown_connections 2024-08-31T04:16:50.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:50.987+0000 7fc198022640 1 -- 172.21.15.2:0/879893871 wait complete. 2024-08-31T04:16:52.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:51 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/879893871' entity='client.admin' 2024-08-31T04:16:52.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:51 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/879893871' entity='client.admin' 2024-08-31T04:16:52.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:51 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/879893871' entity='client.admin' 2024-08-31T04:16:53.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi002') 2024-08-31T04:16:53.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi002') 2024-08-31T04:16:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 -- 172.21.15.2:0/149715444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108a90 msgr2=0x7f386010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 --2- 172.21.15.2:0/149715444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108a90 0x7f386010f2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3858009ca0 tx=0x7f385802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 -- 172.21.15.2:0/149715444 shutdown_connections 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 --2- 172.21.15.2:0/149715444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108a90 0x7f386010f2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 --2- 172.21.15.2:0/149715444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108140 0x7f3860108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 --2- 172.21.15.2:0/149715444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f3860102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 -- 172.21.15.2:0/149715444 >> 172.21.15.2:0/149715444 conn(0x7f38600794d0 msgr2=0x7f38600798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 -- 172.21.15.2:0/149715444 shutdown_connections 2024-08-31T04:16:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.210+0000 7f3865752640 1 -- 172.21.15.2:0/149715444 wait complete. 2024-08-31T04:16:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 Processor -- start 2024-08-31T04:16:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 -- start start 2024-08-31T04:16:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f386019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108a90 0x7f386019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3860112710 con 0x7f3860108140 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3860112590 con 0x7f3860102800 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f3865752640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3860112890 con 0x7f3860108a90 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f385e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f385effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f386019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f385e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52390/0 (socket says 172.21.15.2:52390) 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f385e7fc640 1 -- 172.21.15.2:0/1075340748 learned_addr learned my addr 172.21.15.2:0/1075340748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.211+0000 7f385f7fe640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108a90 0x7f386019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 -- 172.21.15.2:0/1075340748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108a90 msgr2=0x7f386019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108a90 0x7f386019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 -- 172.21.15.2:0/1075340748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 msgr2=0x7f386019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f386019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 -- 172.21.15.2:0/1075340748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38601a00a0 con 0x7f3860108140 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385effd640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f386019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f385e7fc640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f385400d740 tx=0x7f385400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854017070 con 0x7f3860108140 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38601a0390 con 0x7f3860108140 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3854009820 con 0x7f3860108140 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854004ce0 con 0x7f3860108140 2024-08-31T04:16:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.212+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38601a6bb0 con 0x7f3860108140 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.213+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3860103a80 con 0x7f3860108140 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.215+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f3854005220 con 0x7f3860108140 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.215+0000 7f3847fff640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 0x7f38480b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.215+0000 7f385effd640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 0x7f38480b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.215+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f38540e2e60 con 0x7f3860108140 2024-08-31T04:16:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.216+0000 7f385effd640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 0x7f38480b7030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f385000afb0 tx=0x7f385000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.220+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f38540abb90 con 0x7f3860108140 2024-08-31T04:16:53.229 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:53.230 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.411+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f386010b890 con 0x7f3860108140 2024-08-31T04:16:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.415+0000 7f3847fff640 1 -- 172.21.15.2:0/1075340748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f38540ab490 con 0x7f3860108140 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 msgr2=0x7f38480b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 0x7f38480b7030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f385000afb0 tx=0x7f385000a2d0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 msgr2=0x7f386019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f385400d740 tx=0x7f385400db40 comp rx=0 tx=0).stop 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 shutdown_connections 2024-08-31T04:16:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f38480b4b20 0x7f38480b7030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860108140 0x7f386019a790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3860108a90 0x7f386019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 --2- 172.21.15.2:0/1075340748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3860102800 0x7f386019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 >> 172.21.15.2:0/1075340748 conn(0x7f38600794d0 msgr2=0x7f386006af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 shutdown_connections 2024-08-31T04:16:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:53.418+0000 7f3865752640 1 -- 172.21.15.2:0/1075340748 wait complete. 2024-08-31T04:16:54.506 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:54 smithi002 ceph-mon[18656]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:54.506 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:54 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1075340748' entity='client.admin' 2024-08-31T04:16:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- 172.21.15.2:0/3395679158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 msgr2=0x7f15281103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 --2- 172.21.15.2:0/3395679158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f15281103c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1520009ca0 tx=0x7f152002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- 172.21.15.2:0/3395679158 shutdown_connections 2024-08-31T04:16:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 --2- 172.21.15.2:0/3395679158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f15281103c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 --2- 172.21.15.2:0/3395679158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f1528109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 --2- 172.21.15.2:0/3395679158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 0x7f1528103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- 172.21.15.2:0/3395679158 >> 172.21.15.2:0/3395679158 conn(0x7f152807b5f0 msgr2=0x7f152807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- 172.21.15.2:0/3395679158 shutdown_connections 2024-08-31T04:16:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- 172.21.15.2:0/3395679158 wait complete. 2024-08-31T04:16:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 Processor -- start 2024-08-31T04:16:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.601+0000 7f152f260640 1 -- start start 2024-08-31T04:16:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 0x7f15280754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f15280759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1528113850 con 0x7f1528109b90 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15281136d0 con 0x7f1528109240 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152f260640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15281139d0 con 0x7f1528103900 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52396/0 (socket says 172.21.15.2:52396) 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 -- 172.21.15.2:0/492048329 learned_addr learned my addr 172.21.15.2:0/492048329 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f1527fff640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f15280759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152cffc640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 0x7f15280754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 -- 172.21.15.2:0/492048329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 msgr2=0x7f15280754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 0x7f15280754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 -- 172.21.15.2:0/492048329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 msgr2=0x7f15280759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f15280759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 -- 172.21.15.2:0/492048329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15281a8480 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f1527fff640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f15280759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.602+0000 7f152d7fd640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1520005cc0 tx=0x7f152002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.603+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520003bf0 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.603+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1520003d90 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.603+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15281a8710 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.603+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152002fbc0 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.603+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15281a8ca0 con 0x7f1528109b90 2024-08-31T04:16:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.604+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1528103d10 con 0x7f1528109b90 2024-08-31T04:16:54.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.605+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f152002fd60 con 0x7f1528109b90 2024-08-31T04:16:54.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.606+0000 7f1525ffb640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 0x7f15180b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.606+0000 7f152cffc640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 0x7f15180b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.606+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1520104c80 con 0x7f1528109b90 2024-08-31T04:16:54.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.607+0000 7f152cffc640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 0x7f15180b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f151c005fd0 tx=0x7f151c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.609+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15200cd9b0 con 0x7f1528109b90 2024-08-31T04:16:54.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.800+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f15280767b0 con 0x7f1528109b90 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 -- 172.21.15.2:0/4095340749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde010dbd0 msgr2=0x7fcde01100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 --2- 172.21.15.2:0/4095340749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde010dbd0 0x7fcde01100c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009ca0 tx=0x7fcdd802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 -- 172.21.15.2:0/4095340749 shutdown_connections 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 --2- 172.21.15.2:0/4095340749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde010dbd0 0x7fcde01100c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 --2- 172.21.15.2:0/4095340749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde01050c0 0x7fcde010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 --2- 172.21.15.2:0/4095340749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde0104770 0x7fcde0104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 -- 172.21.15.2:0/4095340749 >> 172.21.15.2:0/4095340749 conn(0x7fcde00794e0 msgr2=0x7fcde00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:54.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 -- 172.21.15.2:0/4095340749 shutdown_connections 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.791+0000 7fcde495b640 1 -- 172.21.15.2:0/4095340749 wait complete. 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 Processor -- start 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 -- start start 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde0104770 0x7fcde019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde010dbd0 0x7fcde019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0113850 con 0x7fcde01050c0 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcde01136d0 con 0x7fcde0104770 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.792+0000 7fcde495b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcde01139d0 con 0x7fcde010dbd0 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52412/0 (socket says 172.21.15.2:52412) 2024-08-31T04:16:54.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2414141886 learned_addr learned my addr 172.21.15.2:0/2414141886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdded9d640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde010dbd0 0x7fcde019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdde59c640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde0104770 0x7fcde019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2414141886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde010dbd0 msgr2=0x7fcde019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde010dbd0 0x7fcde019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2414141886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde0104770 msgr2=0x7fcde019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde0104770 0x7fcde019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2414141886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde01a0170 con 0x7fcde01050c0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9f0 tx=0x7fcdd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400ccc0 con 0x7fcde01050c0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd40108e0 con 0x7fcde01050c0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde01a0460 con 0x7fcde01050c0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4018860 con 0x7fcde01050c0 2024-08-31T04:16:54.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.793+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde01a6bc0 con 0x7fcde01050c0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.794+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde0104b80 con 0x7fcde01050c0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.796+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fcdd4010430 con 0x7fcde01050c0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.796+0000 7fcdcf7fe640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 0x7fcdc80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.797+0000 7fcdde59c640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 0x7fcdc80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.797+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcdd40e3d30 con 0x7fcde01050c0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.797+0000 7fcdde59c640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 0x7fcdc80b7080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0005fd0 tx=0x7fcdd0005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.800+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcdd40aca60 con 0x7fcde01050c0 2024-08-31T04:16:54.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.805+0000 7f1525ffb640 1 -- 172.21.15.2:0/492048329 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f15200cd2b0 con 0x7f1528109b90 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 msgr2=0x7f15180b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 0x7f15180b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f151c005fd0 tx=0x7f151c005850 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 msgr2=0x7f1528075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1520005cc0 tx=0x7f152002f380 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 shutdown_connections 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15180b4b70 0x7f15180b7080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1528109b90 0x7f1528075f30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1528109240 0x7f15280759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 --2- 172.21.15.2:0/492048329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1528103900 0x7f15280754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:54.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 >> 172.21.15.2:0/492048329 conn(0x7f152807b5f0 msgr2=0x7f1528107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:54.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 shutdown_connections 2024-08-31T04:16:54.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.808+0000 7f152f260640 1 -- 172.21.15.2:0/492048329 wait complete. 2024-08-31T04:16:54.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:54 smithi064 ceph-mon[22007]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:54 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1075340748' entity='client.admin' 2024-08-31T04:16:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:54 smithi132 ceph-mon[22335]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:54 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1075340748' entity='client.admin' 2024-08-31T04:16:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:54.997+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fcde019b330 con 0x7fcde01050c0 2024-08-31T04:16:55.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.001+0000 7fcdcf7fe640 1 -- 172.21.15.2:0/2414141886 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fcde019b330 con 0x7fcde01050c0 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 msgr2=0x7fcdc80b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 0x7fcdc80b7080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0005fd0 tx=0x7fcdd0005850 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 msgr2=0x7fcde019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9f0 tx=0x7fcdd400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 shutdown_connections 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdc80b4b70 0x7fcdc80b7080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde01050c0 0x7fcde019a7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde010dbd0 0x7fcde019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 --2- 172.21.15.2:0/2414141886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde0104770 0x7fcde019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 >> 172.21.15.2:0/2414141886 conn(0x7fcde00794e0 msgr2=0x7fcde00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:55.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 shutdown_connections 2024-08-31T04:16:55.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:55.004+0000 7fcde495b640 1 -- 172.21.15.2:0/2414141886 wait complete. 2024-08-31T04:16:55.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:55 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/492048329' entity='client.admin' 2024-08-31T04:16:55.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:55 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2414141886' entity='client.admin' 2024-08-31T04:16:56.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:55 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/492048329' entity='client.admin' 2024-08-31T04:16:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:55 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2414141886' entity='client.admin' 2024-08-31T04:16:56.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:55 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/492048329' entity='client.admin' 2024-08-31T04:16:56.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:55 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2414141886' entity='client.admin' 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 -- 172.21.15.2:0/1761285402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 msgr2=0x7f08d8107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/1761285402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d8107d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009900 tx=0x7f08cc02a410 comp rx=0 tx=0).stop 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 -- 172.21.15.2:0/1761285402 shutdown_connections 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/1761285402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d8107d30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/1761285402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8108270 0x7f08d810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/1761285402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8101fe0 0x7f08d81023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 -- 172.21.15.2:0/1761285402 >> 172.21.15.2:0/1761285402 conn(0x7f08d8079d30 msgr2=0x7f08d807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 -- 172.21.15.2:0/1761285402 shutdown_connections 2024-08-31T04:16:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.713+0000 7f08dd8ee640 1 -- 172.21.15.2:0/1761285402 wait complete. 2024-08-31T04:16:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 Processor -- start 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 -- start start 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 0x7f08d819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8108270 0x7f08d819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f08d81138a0 con 0x7f08d8107920 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8113720 con 0x7f08d8101fe0 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.714+0000 7f08dd8ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8113a20 con 0x7f08d8108270 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50228/0 (socket says 172.21.15.2:50228) 2024-08-31T04:16:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d6ffd640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 0x7f08d819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 -- 172.21.15.2:0/690499288 learned_addr learned my addr 172.21.15.2:0/690499288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d77fe640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8108270 0x7f08d819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 -- 172.21.15.2:0/690499288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8108270 msgr2=0x7f08d819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8108270 0x7f08d819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 -- 172.21.15.2:0/690499288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 msgr2=0x7f08d819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 0x7f08d819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 -- 172.21.15.2:0/690499288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d81a0200 con 0x7f08d8107920 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d6ffd640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 0x7f08d819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08d67fc640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006010 tx=0x7f08cc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc03f030 con 0x7f08d8107920 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08cc003aa0 con 0x7f08d8107920 2024-08-31T04:16:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d81a0490 con 0x7f08d8107920 2024-08-31T04:16:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc035070 con 0x7f08d8107920 2024-08-31T04:16:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.715+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d81a6c50 con 0x7f08d8107920 2024-08-31T04:16:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.717+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d81023f0 con 0x7f08d8107920 2024-08-31T04:16:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.718+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f08cc042030 con 0x7f08d8107920 2024-08-31T04:16:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.719+0000 7f08dc8ec640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 0x7f08c00b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.719+0000 7f08d6ffd640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 0x7f08c00b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.719+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f08cc103930 con 0x7f08d8107920 2024-08-31T04:16:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.719+0000 7f08d6ffd640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 0x7f08c00b7080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005fd0 tx=0x7f08c800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:56.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.724+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f08cc0cc010 con 0x7f08d8107920 2024-08-31T04:16:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:16:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.929+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f08d810a0c0 con 0x7f08d8107920 2024-08-31T04:16:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.933+0000 7f08dc8ec640 1 -- 172.21.15.2:0/690499288 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f08cc0d07d0 con 0x7f08d8107920 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 msgr2=0x7f08c00b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 0x7f08c00b7080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005fd0 tx=0x7f08c800b390 comp rx=0 tx=0).stop 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 msgr2=0x7f08d819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006010 tx=0x7f08cc004060 comp rx=0 tx=0).stop 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 shutdown_connections 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f08c00b4b70 0x7f08c00b7080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d8107920 0x7f08d819a830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d8108270 0x7f08d819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 --2- 172.21.15.2:0/690499288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08d8101fe0 0x7f08d819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.935+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 >> 172.21.15.2:0/690499288 conn(0x7f08d8079d30 msgr2=0x7f08d81059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.936+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 shutdown_connections 2024-08-31T04:16:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:56.936+0000 7f08dd8ee640 1 -- 172.21.15.2:0/690499288 wait complete. 2024-08-31T04:16:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:56 smithi064 ceph-mon[22007]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:56 smithi132 ceph-mon[22335]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:56 smithi002 ceph-mon[18656]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:58.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 -- 172.21.15.2:0/167959431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 msgr2=0x7f0a20103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 --2- 172.21.15.2:0/167959431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a20103d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009900 tx=0x7f0a1402a410 comp rx=0 tx=0).stop 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 -- 172.21.15.2:0/167959431 shutdown_connections 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 --2- 172.21.15.2:0/167959431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a201103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 --2- 172.21.15.2:0/167959431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 0x7f0a20109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 --2- 172.21.15.2:0/167959431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a20103d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 -- 172.21.15.2:0/167959431 >> 172.21.15.2:0/167959431 conn(0x7f0a2007b5f0 msgr2=0x7f0a2007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.053+0000 7f0a27100640 1 -- 172.21.15.2:0/167959431 shutdown_connections 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 -- 172.21.15.2:0/167959431 wait complete. 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 Processor -- start 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 -- start start 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:58.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 0x7f0a2019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a2019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.054+0000 7f0a27100640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20113850 con 0x7f0a20103900 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a27100640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201136d0 con 0x7f0a20109b90 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a27100640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201139d0 con 0x7f0a20109240 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50234/0 (socket says 172.21.15.2:50234) 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 -- 172.21.15.2:0/950943389 learned_addr learned my addr 172.21.15.2:0/950943389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a1ffff640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 0x7f0a2019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a2569d640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a2019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 -- 172.21.15.2:0/950943389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 msgr2=0x7f0a2019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 0x7f0a2019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 -- 172.21.15.2:0/950943389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 msgr2=0x7f0a2019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:58.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a2019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 -- 172.21.15.2:0/950943389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a201a01b0 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a2569d640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a2019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a24e9c640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a14005940 tx=0x7f0a14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1403f030 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a14003aa0 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14035070 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.055+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a201a0440 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.056+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a201a6c00 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.057+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a20103d10 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.058+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f0a14042030 con 0x7f0a20103900 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.059+0000 7f0a1dffb640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 0x7f0a100b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.059+0000 7f0a1ffff640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 0x7f0a100b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:58.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.059+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0a14103fb0 con 0x7f0a20103900 2024-08-31T04:16:58.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.059+0000 7f0a1ffff640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 0x7f0a100b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a20108f40 tx=0x7f0a0c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:58.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.062+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0a140ccce0 con 0x7f0a20103900 2024-08-31T04:16:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/690499288' entity='client.admin' 2024-08-31T04:16:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:16:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:58.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:57 smithi002 ceph-mon[18656]: Reconfiguring daemon mon.c on smithi132 2024-08-31T04:16:58.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.251+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f0a2019b370 con 0x7f0a20103900 2024-08-31T04:16:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.255+0000 7f0a1dffb640 1 -- 172.21.15.2:0/950943389 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f0a140cc5e0 con 0x7f0a20103900 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 msgr2=0x7f0a100b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 0x7f0a100b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a20108f40 tx=0x7f0a0c005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 msgr2=0x7f0a2019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a14005940 tx=0x7f0a14004270 comp rx=0 tx=0).stop 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 shutdown_connections 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a20109b90 0x7f0a2019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a20109240 0x7f0a2019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a100b4af0 0x7f0a100b7000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 --2- 172.21.15.2:0/950943389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a20103900 0x7f0a2019a240 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 >> 172.21.15.2:0/950943389 conn(0x7f0a2007b5f0 msgr2=0x7f0a201072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 shutdown_connections 2024-08-31T04:16:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:58.258+0000 7f0a27100640 1 -- 172.21.15.2:0/950943389 wait complete. 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/690499288' entity='client.admin' 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:16:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:57 smithi064 ceph-mon[22007]: Reconfiguring daemon mon.c on smithi132 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/690499288' entity='client.admin' 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:58.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:16:58.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:16:58.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:16:58.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:58.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:57 smithi132 ceph-mon[22335]: Reconfiguring daemon mon.c on smithi132 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 -- 172.21.15.2:0/1437670820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108a90 msgr2=0x7fedec10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 --2- 172.21.15.2:0/1437670820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108a90 0x7fedec10f2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fede4009ca0 tx=0x7fede402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 -- 172.21.15.2:0/1437670820 shutdown_connections 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 --2- 172.21.15.2:0/1437670820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108a90 0x7fedec10f2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 --2- 172.21.15.2:0/1437670820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec108140 0x7fedec108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 --2- 172.21.15.2:0/1437670820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec102850 0x7fedec102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 -- 172.21.15.2:0/1437670820 >> 172.21.15.2:0/1437670820 conn(0x7fedec079420 msgr2=0x7fedec079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 -- 172.21.15.2:0/1437670820 shutdown_connections 2024-08-31T04:16:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.000+0000 7fedf295e640 1 -- 172.21.15.2:0/1437670820 wait complete. 2024-08-31T04:16:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 Processor -- start 2024-08-31T04:16:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 -- start start 2024-08-31T04:16:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec102850 0x7fedec0ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 0x7fedec0ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedec112790 con 0x7fedec108140 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fedec112610 con 0x7fedec102850 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedf295e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fedec112910 con 0x7fedec108a90 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50262/0 (socket says 172.21.15.2:50262) 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.001+0000 7fedeb7fe640 1 -- 172.21.15.2:0/3436928180 learned_addr learned my addr 172.21.15.2:0/3436928180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedebfff640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec102850 0x7fedec0ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedf0efb640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 0x7fedec0ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 -- 172.21.15.2:0/3436928180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 msgr2=0x7fedec0ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 0x7fedec0ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 -- 172.21.15.2:0/3436928180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec102850 msgr2=0x7fedec0ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec102850 0x7fedec0ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 -- 172.21.15.2:0/3436928180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec1a8510 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedf0efb640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 0x7fedec0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedeb7fe640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fede000e9f0 tx=0x7fede000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede000ccc0 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec1a8800 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fede00108e0 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0018860 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.002+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec1a8d40 con 0x7fedec108140 2024-08-31T04:16:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.003+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec103a80 con 0x7fedec108140 2024-08-31T04:16:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.005+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fede0010430 con 0x7fedec108140 2024-08-31T04:16:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.006+0000 7fede97fa640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 0x7fedd40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.006+0000 7fedebfff640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 0x7fedd40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.006+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fede00e3d00 con 0x7fedec108140 2024-08-31T04:16:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.006+0000 7fedebfff640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 0x7fedd40b7000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedec100eb0 tx=0x7feddc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.009+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fede00aca30 con 0x7fedec108140 2024-08-31T04:16:59.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.194+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fedec102c60 con 0x7fedec108140 2024-08-31T04:16:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.199+0000 7fede97fa640 1 -- 172.21.15.2:0/3436928180 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v33)=0 v33) ==== 116+0+0 (secure 0 0 0) 0x7fede00ac330 con 0x7fedec108140 2024-08-31T04:16:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 msgr2=0x7fedd40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 0x7fedd40b7000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedec100eb0 tx=0x7feddc005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 msgr2=0x7fedec0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fede000e9f0 tx=0x7fede000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 shutdown_connections 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fedd40b4af0 0x7fedd40b7000 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedec108140 0x7fedec0ff9a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec108a90 0x7fedec0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 --2- 172.21.15.2:0/3436928180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedec102850 0x7fedec0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 >> 172.21.15.2:0/3436928180 conn(0x7fedec079420 msgr2=0x7fedec06bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 shutdown_connections 2024-08-31T04:16:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:16:59.201+0000 7fedf295e640 1 -- 172.21.15.2:0/3436928180 wait complete. 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/950943389' entity='client.admin' 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:16:59 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3436928180' entity='client.admin' 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/950943389' entity='client.admin' 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:16:59 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3436928180' entity='client.admin' 2024-08-31T04:16:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/950943389' entity='client.admin' 2024-08-31T04:16:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:16:59.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:16:59 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3436928180' entity='client.admin' 2024-08-31T04:17:00.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:00 smithi002 ceph-mon[18656]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:00 smithi064 ceph-mon[22007]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:01.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:00 smithi132 ceph-mon[22335]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 -- 172.21.15.2:0/3562863377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60109240 msgr2=0x7fbd60109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 --2- 172.21.15.2:0/3562863377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60109240 0x7fbd60109650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009900 tx=0x7fbd5402a410 comp rx=0 tx=0).stop 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 -- 172.21.15.2:0/3562863377 shutdown_connections 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 --2- 172.21.15.2:0/3562863377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60109240 0x7fbd60109650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 --2- 172.21.15.2:0/3562863377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 0x7fbd601103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 --2- 172.21.15.2:0/3562863377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60103900 0x7fbd60103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 -- 172.21.15.2:0/3562863377 >> 172.21.15.2:0/3562863377 conn(0x7fbd6007b5f0 msgr2=0x7fbd6007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 -- 172.21.15.2:0/3562863377 shutdown_connections 2024-08-31T04:17:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.216+0000 7fbd664d6640 1 -- 172.21.15.2:0/3562863377 wait complete. 2024-08-31T04:17:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 Processor -- start 2024-08-31T04:17:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 -- start start 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 0x7fbd6019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 0x7fbd6019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60113850 con 0x7fbd60103900 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601136d0 con 0x7fbd60109240 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd664d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601139d0 con 0x7fbd60109b90 2024-08-31T04:17:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50270/0 (socket says 172.21.15.2:50270) 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd5ffff640 1 -- 172.21.15.2:0/4064215561 learned_addr learned my addr 172.21.15.2:0/4064215561 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd64a73640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 0x7fbd6019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.217+0000 7fbd5f7fe640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 0x7fbd6019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 -- 172.21.15.2:0/4064215561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 msgr2=0x7fbd6019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 0x7fbd6019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 -- 172.21.15.2:0/4064215561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 msgr2=0x7fbd6019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 0x7fbd6019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 -- 172.21.15.2:0/4064215561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd601a0270 con 0x7fbd60103900 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5f7fe640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 0x7fbd6019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5ffff640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e9f0 tx=0x7fbd5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000cd80 con 0x7fbd60103900 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd601a0560 con 0x7fbd60103900 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd500108e0 con 0x7fbd60103900 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50018980 con 0x7fbd60103900 2024-08-31T04:17:01.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.218+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd601a6cc0 con 0x7fbd60103900 2024-08-31T04:17:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.219+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd60103d10 con 0x7fbd60103900 2024-08-31T04:17:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.221+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fbd50010430 con 0x7fbd60103900 2024-08-31T04:17:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.221+0000 7fbd5d7fa640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 0x7fbd480b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.222+0000 7fbd5f7fe640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 0x7fbd480b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.222+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbd500e3910 con 0x7fbd60103900 2024-08-31T04:17:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.222+0000 7fbd5f7fe640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 0x7fbd480b7000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009230 tx=0x7fbd54000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.226+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd500ac640 con 0x7fbd60103900 2024-08-31T04:17:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.418+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fbd6019b430 con 0x7fbd60103900 2024-08-31T04:17:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.422+0000 7fbd5d7fa640 1 -- 172.21.15.2:0/4064215561 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v34)=0 v34) ==== 115+0+0 (secure 0 0 0) 0x7fbd500abf40 con 0x7fbd60103900 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.424+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 msgr2=0x7fbd480b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.424+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 0x7fbd480b7000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009230 tx=0x7fbd54000bc0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.424+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 msgr2=0x7fbd6019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.424+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e9f0 tx=0x7fbd5000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 shutdown_connections 2024-08-31T04:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd60109b90 0x7fbd6019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd60109240 0x7fbd6019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd480b4af0 0x7fbd480b7000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 --2- 172.21.15.2:0/4064215561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd60103900 0x7fbd6019a300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 >> 172.21.15.2:0/4064215561 conn(0x7fbd6007b5f0 msgr2=0x7fbd60105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 shutdown_connections 2024-08-31T04:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:01.425+0000 7fbd664d6640 1 -- 172.21.15.2:0/4064215561 wait complete. 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 -- 172.21.15.2:0/3662708994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360107f50 msgr2=0x7f8360108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 --2- 172.21.15.2:0/3662708994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360107f50 0x7f8360108360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8350009900 tx=0x7f835002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 -- 172.21.15.2:0/3662708994 shutdown_connections 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 --2- 172.21.15.2:0/3662708994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360107f50 0x7f8360108360 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 --2- 172.21.15.2:0/3662708994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83601088a0 0x7f836010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 --2- 172.21.15.2:0/3662708994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8360102610 0x7f8360102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 -- 172.21.15.2:0/3662708994 >> 172.21.15.2:0/3662708994 conn(0x7f83600fe060 msgr2=0x7f83601004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 -- 172.21.15.2:0/3662708994 shutdown_connections 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.037+0000 7f836699e640 1 -- 172.21.15.2:0/3662708994 wait complete. 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 Processor -- start 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- start start 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8360107f50 0x7f836019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83601088a0 0x7f836019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8360112510 con 0x7f8360102610 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8360112390 con 0x7f8360107f50 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8360112690 con 0x7f83601088a0 2024-08-31T04:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50282/0 (socket says 172.21.15.2:50282) 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 -- 172.21.15.2:0/2065799400 learned_addr learned my addr 172.21.15.2:0/2065799400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836519b640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8360107f50 0x7f836019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836619d640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83601088a0 0x7f836019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 -- 172.21.15.2:0/2065799400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83601088a0 msgr2=0x7f836019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83601088a0 0x7f836019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 -- 172.21.15.2:0/2065799400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8360107f50 msgr2=0x7f836019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8360107f50 0x7f836019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 -- 172.21.15.2:0/2065799400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83601a6010 con 0x7f8360102610 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836599c640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c920 tx=0x7f835c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c007c70 con 0x7f8360102610 2024-08-31T04:17:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f835c007e10 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83601a6300 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c018820 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.038+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a6860 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.040+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8360102a20 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.042+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f835c00f450 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.042+0000 7f8356ffd640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 0x7f834c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.044+0000 7f836519b640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 0x7f834c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.044+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f835c0e3970 con 0x7f8360102610 2024-08-31T04:17:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.044+0000 7f836519b640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 0x7f834c0b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8350009230 tx=0x7f8350031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:02.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.047+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f835c014030 con 0x7f8360102610 2024-08-31T04:17:02.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.234+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f836002e430 con 0x7f8360102610 2024-08-31T04:17:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.239+0000 7f8356ffd640 1 -- 172.21.15.2:0/2065799400 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v35)=0 v35) ==== 116+0+0 (secure 0 0 0) 0x7f835c0ac7b0 con 0x7f8360102610 2024-08-31T04:17:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 msgr2=0x7f834c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 0x7f834c0b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8350009230 tx=0x7f8350031400 comp rx=0 tx=0).stop 2024-08-31T04:17:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 msgr2=0x7f836019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f835c00c920 tx=0x7f835c00cde0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 shutdown_connections 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83601088a0 0x7f836019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8360107f50 0x7f836019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f834c0b4b70 0x7f834c0b7080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 --2- 172.21.15.2:0/2065799400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8360102610 0x7f836019ade0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 >> 172.21.15.2:0/2065799400 conn(0x7f83600fe060 msgr2=0x7f8360100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 shutdown_connections 2024-08-31T04:17:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:02.241+0000 7f836699e640 1 -- 172.21.15.2:0/2065799400 wait complete. 2024-08-31T04:17:02.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:02.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4064215561' entity='client.admin' 2024-08-31T04:17:02.528 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:02.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:02.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:02.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:02.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2065799400' entity='client.admin' 2024-08-31T04:17:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4064215561' entity='client.admin' 2024-08-31T04:17:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:02 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2065799400' entity='client.admin' 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4064215561' entity='client.admin' 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:02.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:02 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2065799400' entity='client.admin' 2024-08-31T04:17:03.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4070480a-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-08-31T04:17:03.026 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T04:17:03.027 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:17:03.027 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:17:03.044 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:17:03.044 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-08-31T04:17:03.101 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-31 04:15:44.701747162 +0000 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-31 04:10:05.332955332 +0000 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-31 04:10:05.332955332 +0000 2024-08-31T04:17:03.102 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-31 04:10:05.332955332 +0000 2024-08-31T04:17:03.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:17:03.171 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-31T04:17:03.171 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-31T04:17:03.171 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000120929 s, 4.2 MB/s 2024-08-31T04:17:03.172 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:17:03.231 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-31 04:15:44.735746360 +0000 2024-08-31T04:17:03.289 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-31 04:10:05.641947675 +0000 2024-08-31T04:17:03.290 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-31 04:10:05.641947675 +0000 2024-08-31T04:17:03.290 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-31 04:10:05.641947675 +0000 2024-08-31T04:17:03.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:17:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-31T04:17:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-31T04:17:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000134969 s, 3.8 MB/s 2024-08-31T04:17:03.359 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:17:03.418 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-31 04:15:44.768745581 +0000 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-31 04:10:05.974939423 +0000 2024-08-31T04:17:03.478 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-31 04:10:05.974939423 +0000 2024-08-31T04:17:03.479 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-31 04:10:05.974939423 +0000 2024-08-31T04:17:03.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:17:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-31T04:17:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-31T04:17:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000111359 s, 4.6 MB/s 2024-08-31T04:17:03.548 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:17:03.609 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-31 04:15:44.802744778 +0000 2024-08-31T04:17:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-31 04:10:06.295931468 +0000 2024-08-31T04:17:03.668 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-31 04:10:06.295931468 +0000 2024-08-31T04:17:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-31 04:10:06.295931468 +0000 2024-08-31T04:17:03.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:17:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-31T04:17:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-31T04:17:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000125427 s, 4.1 MB/s 2024-08-31T04:17:03.736 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:17:03.795 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-08-31T04:17:03.795 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:17:03.816 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:17:03.816 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-08-31T04:17:03.874 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:17:03.874 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:03.874 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-31T04:17:03.874 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:03.874 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:03.875 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-08-31 04:16:43.485155428 +0000 2024-08-31T04:17:03.875 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-08-31 04:10:25.557687330 +0000 2024-08-31T04:17:03.875 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-08-31 04:10:25.557687330 +0000 2024-08-31T04:17:03.875 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-08-31 04:10:25.557687330 +0000 2024-08-31T04:17:03.875 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:17:03.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-08-31T04:17:03.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-08-31T04:17:03.944 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000283901 s, 1.8 MB/s 2024-08-31T04:17:03.946 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:17:04.003 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-08-31 04:16:43.485155428 +0000 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-08-31 04:10:25.893680598 +0000 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-08-31 04:10:25.893680598 +0000 2024-08-31T04:17:04.060 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-08-31 04:10:25.893680598 +0000 2024-08-31T04:17:04.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:17:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-08-31T04:17:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-08-31T04:17:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.00021351 s, 2.4 MB/s 2024-08-31T04:17:04.125 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:17:04.182 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-08-31T04:17:04.238 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-08-31 04:16:43.486155408 +0000 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-08-31 04:10:26.229673867 +0000 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-08-31 04:10:26.229673867 +0000 2024-08-31T04:17:04.239 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-08-31 04:10:26.229673867 +0000 2024-08-31T04:17:04.239 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000192058 s, 2.7 MB/s 2024-08-31T04:17:04.303 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:17:04.360 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-08-31 04:16:43.486155408 +0000 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-08-31 04:10:26.553667376 +0000 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-08-31 04:10:26.553667376 +0000 2024-08-31T04:17:04.415 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-08-31 04:10:26.553667376 +0000 2024-08-31T04:17:04.416 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:17:04.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-08-31T04:17:04.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-08-31T04:17:04.479 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.00021412 s, 2.4 MB/s 2024-08-31T04:17:04.480 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:17:04.536 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-08-31T04:17:04.536 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:17:04.556 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:17:04.556 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-08-31T04:17:04.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:04 smithi064 ceph-mon[22007]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:17:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-08-31 04:16:41.122499872 +0000 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-08-31 04:10:20.381666281 +0000 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-08-31 04:10:20.381666281 +0000 2024-08-31T04:17:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-08-31 04:10:20.381666281 +0000 2024-08-31T04:17:04.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:17:04.681 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:04 smithi132 ceph-mon[22335]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-08-31T04:17:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-08-31T04:17:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000259577 s, 2.0 MB/s 2024-08-31T04:17:04.687 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:17:04.746 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-08-31 04:16:41.122499872 +0000 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-08-31 04:10:20.713657466 +0000 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-08-31 04:10:20.713657466 +0000 2024-08-31T04:17:04.803 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-08-31 04:10:20.713657466 +0000 2024-08-31T04:17:04.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:17:04.868 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-08-31T04:17:04.868 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-08-31T04:17:04.869 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000255585 s, 2.0 MB/s 2024-08-31T04:17:04.870 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:17:04.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:04 smithi002 ceph-mon[18656]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:04.928 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-08-31T04:17:04.985 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:17:04.985 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:04.985 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-08-31 04:16:41.123499846 +0000 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-08-31 04:10:21.046648623 +0000 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-08-31 04:10:21.046648623 +0000 2024-08-31T04:17:04.986 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-08-31 04:10:21.046648623 +0000 2024-08-31T04:17:04.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:17:05.050 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-08-31T04:17:05.051 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-08-31T04:17:05.051 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000254114 s, 2.0 MB/s 2024-08-31T04:17:05.052 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:17:05.109 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-08-31T04:17:05.164 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:17:05.164 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:17:05.164 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-31T04:17:05.164 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:17:05.164 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:17:05.165 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-08-31 04:16:41.123499846 +0000 2024-08-31T04:17:05.165 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-08-31 04:10:21.369640046 +0000 2024-08-31T04:17:05.165 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-08-31 04:10:21.369640046 +0000 2024-08-31T04:17:05.165 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-08-31 04:10:21.369640046 +0000 2024-08-31T04:17:05.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:17:05.227 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-08-31T04:17:05.227 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-08-31T04:17:05.227 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000321135 s, 1.6 MB/s 2024-08-31T04:17:05.229 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:17:05.285 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-08-31T04:17:05.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:17:05.545 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:17:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:06 smithi002 ceph-mon[18656]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:06 smithi064 ceph-mon[22007]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:06 smithi132 ceph-mon[22335]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:17:07.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-08-31T04:17:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:17:08.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:08 smithi002 ceph-mon[18656]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:08.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 -- 172.21.15.2:0/1147869206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 msgr2=0x7f5670109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:08.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 --2- 172.21.15.2:0/1147869206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f5670109660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f566c009900 tx=0x7f566c02a410 comp rx=0 tx=0).stop 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 -- 172.21.15.2:0/1147869206 shutdown_connections 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 --2- 172.21.15.2:0/1147869206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f5670109660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 --2- 172.21.15.2:0/1147869206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670109ba0 0x7f56701103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 --2- 172.21.15.2:0/1147869206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670101d10 0x7f5670102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 -- 172.21.15.2:0/1147869206 >> 172.21.15.2:0/1147869206 conn(0x7f5670077a00 msgr2=0x7f5670077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 -- 172.21.15.2:0/1147869206 shutdown_connections 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.504+0000 7f56787f6640 1 -- 172.21.15.2:0/1147869206 wait complete. 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 Processor -- start 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 -- start start 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670101d10 0x7f567019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 0x7f567019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56701138b0 con 0x7f5670109250 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5670113730 con 0x7f5670101d10 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f56787f6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5670113a30 con 0x7f5670109ba0 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f5675d91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f5675d91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60946/0 (socket says 172.21.15.2:60946) 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f5675d91640 1 -- 172.21.15.2:0/4135470313 learned_addr learned my addr 172.21.15.2:0/4135470313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.505+0000 7f5676592640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670101d10 0x7f567019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5676d93640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 0x7f567019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 -- 172.21.15.2:0/4135470313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 msgr2=0x7f567019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 0x7f567019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 -- 172.21.15.2:0/4135470313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670101d10 msgr2=0x7f567019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670101d10 0x7f567019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:08.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 -- 172.21.15.2:0/4135470313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56701a00b0 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5676d93640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 0x7f567019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f5675d91640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f566c005ab0 tx=0x7f566c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c03f070 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56701a0340 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f566c031d60 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c035030 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.506+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56701a0820 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.507+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5670102120 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.509+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f566c042070 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.509+0000 7f56677fe640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 0x7f565c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.509+0000 7f5676592640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 0x7f565c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.509+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f566c1043a0 con 0x7f5670109250 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.510+0000 7f5676592640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 0x7f565c0b7030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f566000bbe0 tx=0x7f566000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:08.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.512+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f566c0cd0d0 con 0x7f5670109250 2024-08-31T04:17:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:08.708+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f56700635a0 con 0x7f565c0b4b20 2024-08-31T04:17:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:08 smithi064 ceph-mon[22007]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:08.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:08 smithi132 ceph-mon[22335]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:09.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:09 smithi002 ceph-mon[18656]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:09.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:09.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:09.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:09.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:09 smithi064 ceph-mon[22007]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:09.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:09.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:09.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:09.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:09 smithi132 ceph-mon[22335]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:09.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:09.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:09.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:10.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:10 smithi002 ceph-mon[18656]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:10.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:10 smithi064 ceph-mon[22007]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:10 smithi132 ceph-mon[22335]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:11.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"} : dispatch 2024-08-31T04:17:11.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"}]': finished 2024-08-31T04:17:11.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:11 smithi002 ceph-mon[18656]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:17:11.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:11.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"} : dispatch 2024-08-31T04:17:11.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"}]': finished 2024-08-31T04:17:11.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:11 smithi064 ceph-mon[22007]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:17:11.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:11.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"} : dispatch 2024-08-31T04:17:11.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3233166409' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b1eadc-fc29-4c3a-b5fc-baf84660347b"}]': finished 2024-08-31T04:17:11.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:11 smithi132 ceph-mon[22335]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:17:11.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:12 smithi064 ceph-mon[22007]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:12 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1229054662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:12 smithi132 ceph-mon[22335]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:12 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1229054662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:12.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:12 smithi002 ceph-mon[18656]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:12.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:12 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1229054662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:14 smithi064 ceph-mon[22007]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:14.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:14 smithi132 ceph-mon[22335]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:14 smithi002 ceph-mon[18656]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:16.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:16 smithi002 ceph-mon[18656]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:16.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:16 smithi064 ceph-mon[22007]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:16 smithi132 ceph-mon[22335]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:18.490 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:18 smithi002 ceph-mon[18656]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:18.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:18 smithi064 ceph-mon[22007]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:18.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:18 smithi132 ceph-mon[22335]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:19.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:17:19.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:19.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:17:19.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:17:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:20.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:20 smithi002 ceph-mon[18656]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:20.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:20 smithi002 ceph-mon[18656]: Deploying daemon osd.0 on smithi002 2024-08-31T04:17:20.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:20 smithi064 ceph-mon[22007]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:20 smithi064 ceph-mon[22007]: Deploying daemon osd.0 on smithi002 2024-08-31T04:17:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:20 smithi132 ceph-mon[22335]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:20 smithi132 ceph-mon[22335]: Deploying daemon osd.0 on smithi002 2024-08-31T04:17:22.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:22 smithi064 ceph-mon[22007]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:22 smithi132 ceph-mon[22335]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:22.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:22 smithi002 ceph-mon[18656]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:24.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:24 smithi002 ceph-mon[18656]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:24.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:24.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:24 smithi064 ceph-mon[22007]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:24 smithi132 ceph-mon[22335]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:24.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:24.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:26.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:26 smithi002 ceph-mon[18656]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:26 smithi064 ceph-mon[22007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:26.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:26 smithi132 ceph-mon[22335]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:27.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:27.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:27.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:27.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:27.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.226+0000 7f56677fe640 1 -- 172.21.15.2:0/4135470313 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f56700635a0 con 0x7f565c0b4b20 2024-08-31T04:17:28.228 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 msgr2=0x7f565c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 0x7f565c0b7030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f566000bbe0 tx=0x7f566000b390 comp rx=0 tx=0).stop 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 msgr2=0x7f567019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f566c005ab0 tx=0x7f566c003cd0 comp rx=0 tx=0).stop 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 shutdown_connections 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f565c0b4b20 0x7f565c0b7030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:28.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5670109250 0x7f567019a7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5670109ba0 0x7f567019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 --2- 172.21.15.2:0/4135470313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5670101d10 0x7f567019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 >> 172.21.15.2:0/4135470313 conn(0x7f5670077a00 msgr2=0x7f5670105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 shutdown_connections 2024-08-31T04:17:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:17:28.229+0000 7f56787f6640 1 -- 172.21.15.2:0/4135470313 wait complete. 2024-08-31T04:17:28.777 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:28 smithi002 ceph-mon[18656]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:28.777 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:28.777 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.777 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.808 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T04:17:28.811 INFO:tasks.cephadm:Deploying osd.1 on smithi064 with /dev/vg_nvme/lv_4... 2024-08-31T04:17:28.811 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:17:28.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:28 smithi064 ceph-mon[22007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:28 smithi132 ceph-mon[22335]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:29.072 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:17:30.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:17:30 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:17:30.142+0000 7ff5c3080640 -1 osd.0 0 log_to_monitors true 2024-08-31T04:17:30.714 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:30 smithi064 ceph-mon[22007]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:30.715 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:30 smithi064 ceph-mon[22007]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:17:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:30 smithi132 ceph-mon[22335]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:30 smithi132 ceph-mon[22335]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:17:30.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:30 smithi002 ceph-mon[18656]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:30.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:30 smithi002 ceph-mon[18656]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:17:31.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:17:31.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_4 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.732 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:31.733 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:31.733 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.733 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:31 smithi064 ceph-mon[22007]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:17:31.747 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:17:31.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:17:31.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:17:31.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:31 smithi132 ceph-mon[22335]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:17:31.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:17:31.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:17:31.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:31.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:31 smithi002 ceph-mon[18656]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 -- 172.21.15.64:0/1863784214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758108ab0 msgr2=0x7fc75810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/1863784214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758108ab0 0x7fc75810f2e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc750009900 tx=0x7fc75002a410 comp rx=0 tx=0).stop 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 -- 172.21.15.64:0/1863784214 shutdown_connections 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/1863784214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758108ab0 0x7fc75810f2e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/1863784214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108160 0x7fc758108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:32.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/1863784214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758102820 0x7fc758102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 -- 172.21.15.64:0/1863784214 >> 172.21.15.64:0/1863784214 conn(0x7fc7580794e0 msgr2=0x7fc7580798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 -- 172.21.15.64:0/1863784214 shutdown_connections 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.220+0000 7fc75d2ca640 1 -- 172.21.15.64:0/1863784214 wait complete. 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.221+0000 7fc75d2ca640 1 Processor -- start 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.221+0000 7fc75d2ca640 1 -- start start 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 0x7fc75819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108ab0 0x7fc75819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc758112710 con 0x7fc758108160 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc758112590 con 0x7fc758102820 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc75d2ca640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc758112890 con 0x7fc758108ab0 2024-08-31T04:17:32.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37714/0 (socket says 172.21.15.64:37714) 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 -- 172.21.15.64:0/2121402087 learned_addr learned my addr 172.21.15.64:0/2121402087 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc7567fc640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 0x7fc75819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc7577fe640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108ab0 0x7fc75819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 -- 172.21.15.64:0/2121402087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108ab0 msgr2=0x7fc75819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108ab0 0x7fc75819ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 -- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 msgr2=0x7fc75819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 0x7fc75819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 -- 172.21.15.64:0/2121402087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581a6250 con 0x7fc758102820 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc7567fc640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 0x7fc75819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc756ffd640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc74800eab0 tx=0x7fc74800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.222+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74800ce40 con 0x7fc758102820 2024-08-31T04:17:32.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.223+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7581a6540 con 0x7fc758102820 2024-08-31T04:17:32.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.223+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc748011920 con 0x7fc758102820 2024-08-31T04:17:32.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.223+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748010a30 con 0x7fc758102820 2024-08-31T04:17:32.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.223+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7581a6ad0 con 0x7fc758102820 2024-08-31T04:17:32.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.224+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc758102c30 con 0x7fc758102820 2024-08-31T04:17:32.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.225+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fc748010bd0 con 0x7fc758102820 2024-08-31T04:17:32.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.226+0000 7fc74ffff640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 0x7fc7440b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:32.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.226+0000 7fc7567fc640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 0x7fc7440b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:32.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.226+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7fc7480e3d30 con 0x7fc758102820 2024-08-31T04:17:32.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.227+0000 7fc7567fc640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 0x7fc7440b7030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc758105c90 tx=0x7fc740005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:32.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.231+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc7480e8070 con 0x7fc758102820 2024-08-31T04:17:32.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:17:32.017+0000 7ff5bf002640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T04:17:32.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:17:32.021+0000 7ff5b6df8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:17:32.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:32.427+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc7580635a0 con 0x7fc7440b4b20 2024-08-31T04:17:32.750 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi002 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi002 to 17092M 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:32.751 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi002 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi002 to 17092M 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' 2024-08-31T04:17:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:32.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi002 2024-08-31T04:17:32.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi002 to 17092M 2024-08-31T04:17:32.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126]' entity='osd.0' 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:32.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:17:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:17:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] boot 2024-08-31T04:17:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] boot 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:17:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: osd.0 [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] boot 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:17:33.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:17:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:34 smithi132 ceph-mon[22335]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:34 smithi132 ceph-mon[22335]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T04:17:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:34 smithi064 ceph-mon[22007]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:34 smithi064 ceph-mon[22007]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T04:17:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:34 smithi002 ceph-mon[18656]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:17:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:34 smithi002 ceph-mon[18656]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T04:17:35.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/2023231185' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"}]': finished 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:35 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/941856036' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/2023231185' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"}]': finished 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:35.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:35 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/941856036' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:35.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/2023231185' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"} : dispatch 2024-08-31T04:17:35.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf40256-b4dc-4669-882b-cb08a7b1871c"}]': finished 2024-08-31T04:17:35.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:17:35.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:35.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:35 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/941856036' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:36 smithi132 ceph-mon[22335]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:36 smithi064 ceph-mon[22007]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:37.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:36 smithi002 ceph-mon[18656]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:39.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:38 smithi064 ceph-mon[22007]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:39.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:38 smithi132 ceph-mon[22335]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:38 smithi002 ceph-mon[18656]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:41.008 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:40 smithi064 ceph-mon[22007]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:41.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:40 smithi132 ceph-mon[22335]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:41.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:40 smithi002 ceph-mon[18656]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:42 smithi064 ceph-mon[22007]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:42 smithi132 ceph-mon[22335]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:43.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:42 smithi002 ceph-mon[18656]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:44.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:43 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:17:44.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:43 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:43 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:17:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:43 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:43 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:17:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:43 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:44 smithi064 ceph-mon[22007]: Deploying daemon osd.1 on smithi064 2024-08-31T04:17:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:44 smithi064 ceph-mon[22007]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:45.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:44 smithi132 ceph-mon[22335]: Deploying daemon osd.1 on smithi064 2024-08-31T04:17:45.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:44 smithi132 ceph-mon[22335]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:44 smithi002 ceph-mon[18656]: Deploying daemon osd.1 on smithi064 2024-08-31T04:17:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:44 smithi002 ceph-mon[18656]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:47.038 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:46 smithi064 ceph-mon[22007]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:46 smithi132 ceph-mon[22335]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:46 smithi002 ceph-mon[18656]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:48.900 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:48 smithi002 ceph-mon[18656]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:48.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:48.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:48.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:49.005 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:48 smithi064 ceph-mon[22007]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:49.006 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:49.006 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:49.006 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:48 smithi132 ceph-mon[22335]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:50 smithi064 ceph-mon[22007]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:51.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:50 smithi132 ceph-mon[22335]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:51.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:50 smithi002 ceph-mon[18656]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:51.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:51.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.404+0000 7fc74ffff640 1 -- 172.21.15.64:0/2121402087 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc7580635a0 con 0x7fc7440b4b20 2024-08-31T04:17:51.408 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 1 on host 'smithi064' 2024-08-31T04:17:51.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 msgr2=0x7fc7440b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 0x7fc7440b7030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc758105c90 tx=0x7fc740005f90 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 msgr2=0x7fc75819afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc74800eab0 tx=0x7fc74800ef70 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 shutdown_connections 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc7440b4b20 0x7fc7440b7030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc758108160 0x7fc75819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc758108ab0 0x7fc75819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 --2- 172.21.15.64:0/2121402087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc758102820 0x7fc75819afc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 >> 172.21.15.64:0/2121402087 conn(0x7fc7580794e0 msgr2=0x7fc758104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:51.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 shutdown_connections 2024-08-31T04:17:51.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:17:51.407+0000 7fc75d2ca640 1 -- 172.21.15.64:0/2121402087 wait complete. 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:51 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:51 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.105 DEBUG:teuthology.orchestra.run.smithi064:osd.1> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T04:17:52.107 INFO:tasks.cephadm:Deploying osd.2 on smithi132 with /dev/vg_nvme/lv_4... 2024-08-31T04:17:52.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:17:52.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:52.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:52.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:52.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:51 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:17:53.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:52 smithi064 ceph-mon[22007]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:53.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:52 smithi132 ceph-mon[22335]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:52 smithi002 ceph-mon[18656]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:54.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:53 smithi132 ceph-mon[22335]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:53 smithi132 ceph-mon[22335]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:53 smithi064 ceph-mon[22007]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:53 smithi064 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.067 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:17:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:17:53.700+0000 7f278a168640 -1 osd.1 0 log_to_monitors true 2024-08-31T04:17:54.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:53 smithi002 ceph-mon[18656]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:53 smithi002 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:17:54.840 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:17:54.868 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_4 2024-08-31T04:17:55.067 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:17:54.800+0000 7f27860ea640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T04:17:55.067 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:17:54.803+0000 7f2781ee8640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:17:55.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:55.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:17:55.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:55.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:54 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:55.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:55.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:54 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.113 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:17:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:17:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:17:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:55.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:54 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:17:55.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- 172.21.15.132:0/3980644490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109240 msgr2=0x7f5eec109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/3980644490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109240 0x7f5eec109650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009900 tx=0x7f5edc02a410 comp rx=0 tx=0).stop 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- 172.21.15.132:0/3980644490 shutdown_connections 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/3980644490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec109b90 0x7f5eec1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/3980644490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109240 0x7f5eec109650 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/3980644490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec103900 0x7f5eec103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- 172.21.15.132:0/3980644490 >> 172.21.15.132:0/3980644490 conn(0x7f5eec07b5f0 msgr2=0x7f5eec07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- 172.21.15.132:0/3980644490 shutdown_connections 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- 172.21.15.132:0/3980644490 wait complete. 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 Processor -- start 2024-08-31T04:17:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.592+0000 7f5ef2c28640 1 -- start start 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 0x7f5eec19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec109240 0x7f5eec19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec113850 con 0x7f5eec103900 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec1136d0 con 0x7f5eec109240 2024-08-31T04:17:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef2c28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec1139d0 con 0x7f5eec109b90 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33070/0 (socket says 172.21.15.132:33070) 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 -- 172.21.15.132:0/2455685693 learned_addr learned my addr 172.21.15.132:0/2455685693 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec109240 0x7f5eec19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef09c4640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 0x7f5eec19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 -- 172.21.15.132:0/2455685693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec109240 msgr2=0x7f5eec19a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec109240 0x7f5eec19a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 -- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 msgr2=0x7f5eec19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 0x7f5eec19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 -- 172.21.15.132:0/2455685693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec1a0290 con 0x7f5eec109b90 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef09c4640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 0x7f5eec19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ef11c5640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400eaa0 tx=0x7f5ee400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.593+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400cdb0 con 0x7f5eec109b90 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.594+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee4005020 con 0x7f5eec109b90 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.594+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40116d0 con 0x7f5eec109b90 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.594+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1a0580 con 0x7f5eec109b90 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.594+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec1a6ce0 con 0x7f5eec109b90 2024-08-31T04:17:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.595+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec103d10 con 0x7f5eec109b90 2024-08-31T04:17:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.596+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f5ee40051d0 con 0x7f5eec109b90 2024-08-31T04:17:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.597+0000 7f5ee1ffb640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 0x7f5ed40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.597+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f5ee40e3a40 con 0x7f5eec109b90 2024-08-31T04:17:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.598+0000 7f5ef09c4640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 0x7f5ed40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.598+0000 7f5ef09c4640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 0x7f5ed40b7000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8005fd0 tx=0x7f5ee800b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.602+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ee4016030 con 0x7f5eec109b90 2024-08-31T04:17:55.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:17:55.787+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5eec0635a0 con 0x7f5ed40b4af0 2024-08-31T04:17:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi064 2024-08-31T04:17:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi064 to 17088M 2024-08-31T04:17:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:17:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T04:17:56.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi064 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi064 to 17088M 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:56.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:56.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi064 2024-08-31T04:17:56.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi064 to 17088M 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:56.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] boot 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:17:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] boot 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:17:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:17:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:17:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:17:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:57.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: osd.1 [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] boot 2024-08-31T04:17:57.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:17:57.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:17:58.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:57 smithi132 ceph-mon[22335]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T04:17:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:57 smithi002 ceph-mon[18656]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T04:17:58.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:57 smithi064 ceph-mon[22007]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: pgmap v45: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/4050655578' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"}]': finished 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:17:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:17:58 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/975585757' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:59.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: pgmap v45: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:17:59.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/4050655578' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"}]': finished 2024-08-31T04:17:59.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:17:59.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:17:59.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:17:58 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/975585757' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: pgmap v45: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/4050655578' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"} : dispatch 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67a3487-d5b9-4171-a372-4746ee7828fe"}]': finished 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:17:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:17:58 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/975585757' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:01.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:00 smithi002 ceph-mon[18656]: pgmap v47: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:01.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:00 smithi064 ceph-mon[22007]: pgmap v47: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:00 smithi132 ceph-mon[22335]: pgmap v47: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:02 smithi002 ceph-mon[18656]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:03.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:02 smithi132 ceph-mon[22335]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:02 smithi064 ceph-mon[22007]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:04.917 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:04 smithi132 ceph-mon[22335]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:04 smithi002 ceph-mon[18656]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:05.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:04 smithi064 ceph-mon[22007]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:07.099 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:06 smithi132 ceph-mon[22335]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:07.099 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:18:07.099 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:06 smithi002 ceph-mon[18656]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:18:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:06 smithi064 ceph-mon[22007]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:18:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:08.134 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:07 smithi132 ceph-mon[22335]: Deploying daemon osd.2 on smithi132 2024-08-31T04:18:08.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:07 smithi002 ceph-mon[18656]: Deploying daemon osd.2 on smithi132 2024-08-31T04:18:08.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:07 smithi064 ceph-mon[22007]: Deploying daemon osd.2 on smithi132 2024-08-31T04:18:09.113 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:08 smithi132 ceph-mon[22335]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:08 smithi002 ceph-mon[18656]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:08 smithi064 ceph-mon[22007]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:10.962 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:10 smithi132 ceph-mon[22335]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:10 smithi002 ceph-mon[18656]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:10 smithi064 ceph-mon[22007]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:12.212 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:12.212 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:12.212 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:12 smithi002 ceph-mon[18656]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:13.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:12 smithi132 ceph-mon[22335]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:12 smithi064 ceph-mon[22007]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:15.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.313 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:15.313 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.313 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:15.313 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:15.314 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:15.314 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:16.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.142+0000 7f5ee1ffb640 1 -- 172.21.15.132:0/2455685693 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5eec0635a0 con 0x7f5ed40b4af0 2024-08-31T04:18:16.144 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 2 on host 'smithi132' 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 msgr2=0x7f5ed40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 0x7f5ed40b7000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8005fd0 tx=0x7f5ee800b5f0 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 msgr2=0x7f5eec19fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400eaa0 tx=0x7f5ee400ef60 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 shutdown_connections 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec109b90 0x7f5eec19fb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5eec109240 0x7f5eec19a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ed40b4af0 0x7f5ed40b7000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 --2- 172.21.15.132:0/2455685693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5eec103900 0x7f5eec19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.144+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 >> 172.21.15.132:0/2455685693 conn(0x7f5eec07b5f0 msgr2=0x7f5eec1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.145+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 shutdown_connections 2024-08-31T04:18:16.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:18:16.145+0000 7f5ef2c28640 1 -- 172.21.15.132:0/2455685693 wait complete. 2024-08-31T04:18:16.836 DEBUG:teuthology.orchestra.run.smithi132:osd.2> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T04:18:16.838 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-08-31T04:18:16.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:18:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:16 smithi132 ceph-mon[22335]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:18:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:16 smithi002 ceph-mon[18656]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:16 smithi064 ceph-mon[22007]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:18.127 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:18:17.910+0000 7f30899ff640 -1 osd.2 0 log_to_monitors true 2024-08-31T04:18:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:18 smithi002 ceph-mon[18656]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:18 smithi002 ceph-mon[18656]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:18 smithi002 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.193 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:18 smithi132 ceph-mon[22335]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:19.193 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:18 smithi132 ceph-mon[22335]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.193 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:18 smithi132 ceph-mon[22335]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:18 smithi064 ceph-mon[22007]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:19.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:18 smithi064 ceph-mon[22007]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:18 smithi064 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:18:19.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:18:19.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-08-31T04:18:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:18:20.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi132 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi132 to 17088M 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:20.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:20.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi132 2024-08-31T04:18:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi132 to 17088M 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:20.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.318 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:18:19.871+0000 7f3085981640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T04:18:20.318 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:18:19.875+0000 7f308177f640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi132 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:20.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi132 to 17088M 2024-08-31T04:18:20.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:20.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:20.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 -- 172.21.15.2:0/3186042144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874103920 msgr2=0x7f1874103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 --2- 172.21.15.2:0/3186042144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874103920 0x7f1874103d30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1868009900 tx=0x7f186802a410 comp rx=0 tx=0).stop 2024-08-31T04:18:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 -- 172.21.15.2:0/3186042144 shutdown_connections 2024-08-31T04:18:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 --2- 172.21.15.2:0/3186042144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 0x7f18741103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 --2- 172.21.15.2:0/3186042144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109260 0x7f1874109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 --2- 172.21.15.2:0/3186042144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874103920 0x7f1874103d30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 -- 172.21.15.2:0/3186042144 >> 172.21.15.2:0/3186042144 conn(0x7f18740ff3b0 msgr2=0x7f1874101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 -- 172.21.15.2:0/3186042144 shutdown_connections 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.456+0000 7f187c2d5640 1 -- 172.21.15.2:0/3186042144 wait complete. 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 Processor -- start 2024-08-31T04:18:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 -- start start 2024-08-31T04:18:20.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874103920 0x7f18740754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 0x7f1874075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18741138b0 con 0x7f1874109260 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1874113730 con 0x7f1874103920 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f187c2d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1874113a30 con 0x7f1874109bb0 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f1879870640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f1879870640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50364/0 (socket says 172.21.15.2:50364) 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.457+0000 7f1879870640 1 -- 172.21.15.2:0/451921872 learned_addr learned my addr 172.21.15.2:0/451921872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f187a071640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874103920 0x7f18740754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f187a872640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 0x7f1874075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 -- 172.21.15.2:0/451921872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 msgr2=0x7f1874075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 0x7f1874075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 -- 172.21.15.2:0/451921872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874103920 msgr2=0x7f18740754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874103920 0x7f18740754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 -- 172.21.15.2:0/451921872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18741a84d0 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f1879870640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f187000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870011830 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1870016070 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870010e00 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18741a87c0 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.458+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18741a8d30 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.459+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1874103d30 con 0x7f1874109260 2024-08-31T04:18:20.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.461+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f187001b460 con 0x7f1874109260 2024-08-31T04:18:20.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.462+0000 7f18677fe640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 0x7f18600b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:20.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.462+0000 7f187a071640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 0x7f18600b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:20.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.462+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f18700e3660 con 0x7f1874109260 2024-08-31T04:18:20.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.462+0000 7f187a071640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 0x7f18600b7080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1868000c00 tx=0x7f1868031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:20.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.465+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18700abe00 con 0x7f1874109260 2024-08-31T04:18:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:20.661+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f18740635a0 con 0x7f18600b4b70 2024-08-31T04:18:21.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:18:21.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T04:18:21.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:21.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:21.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:21.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:22.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:18:22.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:18:22.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] boot 2024-08-31T04:18:22.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:18:22.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:22.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] boot 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: osd.2 [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] boot 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:18:22.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:18:22.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:18:22.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:22.978 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41809]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:22.978 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41809]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:22.978 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:22.978 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41809]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:22.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:22.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:22 smithi002 ceph-mon[18656]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:18:22.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:23.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:23.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:22 smithi132 ceph-mon[22335]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:18:23.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:23.197 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32242]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:23.197 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32242]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.197 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.197 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32242]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.198 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32245]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.198 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32245]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.198 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.198 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32245]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.237 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:23.237 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:22 smithi064 ceph-mon[22007]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:18:23.238 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31376]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31376]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31376]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31379]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31379]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.238 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31379]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.397 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:18:22 smithi002 sudo[41812]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41821]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41821]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41821]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41824]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41824]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 sudo[41824]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31382]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31382]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31385]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31385]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 sudo[31385]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32248]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32248]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32248]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32251]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32251]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:18:23.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 sudo[32251]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:18:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:24.014+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f18700a7990 con 0x7f1874109260 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"} : dispatch 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"}]': finished 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/447174593' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"} : dispatch 2024-08-31T04:18:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"}]': finished 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/447174593' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:18:24.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"} : dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/428913176' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e216ee69-c75f-4ed4-934c-64e65fac20a9"}]': finished 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:18:24.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/447174593' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:25.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:25 smithi064 ceph-mon[22007]: mgrmap e20: x(active, since 111s), standbys: z, y 2024-08-31T04:18:25.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:25 smithi132 ceph-mon[22335]: mgrmap e20: x(active, since 111s), standbys: z, y 2024-08-31T04:18:25.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:25 smithi002 ceph-mon[18656]: mgrmap e20: x(active, since 111s), standbys: z, y 2024-08-31T04:18:26.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:26 smithi064 ceph-mon[22007]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:26.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:26 smithi132 ceph-mon[22335]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:26.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:26 smithi002 ceph-mon[18656]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:28.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:28 smithi064 ceph-mon[22007]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:28.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:28 smithi132 ceph-mon[22335]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:28.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:28 smithi002 ceph-mon[18656]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:30.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:30 smithi002 ceph-mon[18656]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:30 smithi064 ceph-mon[22007]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:30 smithi132 ceph-mon[22335]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:32 smithi002 ceph-mon[18656]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:18:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:32 smithi002 ceph-mon[18656]: Deploying daemon osd.3 on smithi002 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:32 smithi064 ceph-mon[22007]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:32 smithi064 ceph-mon[22007]: Deploying daemon osd.3 on smithi002 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:32 smithi132 ceph-mon[22335]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:32.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:18:32.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:32.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:32 smithi132 ceph-mon[22335]: Deploying daemon osd.3 on smithi002 2024-08-31T04:18:34.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:34 smithi002 ceph-mon[18656]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:34 smithi064 ceph-mon[22007]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:34.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:34 smithi132 ceph-mon[22335]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:36.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:36 smithi064 ceph-mon[22007]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:36.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:36 smithi132 ceph-mon[22335]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:36.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:36 smithi002 ceph-mon[18656]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:37.296 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:37 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:37.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:37 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:37.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:37 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:37 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:37 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:37 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:37 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:37 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:37 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:38.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:38 smithi002 ceph-mon[18656]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:38 smithi064 ceph-mon[22007]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:38 smithi132 ceph-mon[22335]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:40.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:40.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.675+0000 7f18677fe640 1 -- 172.21.15.2:0/451921872 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f18740635a0 con 0x7f18600b4b70 2024-08-31T04:18:40.677 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 msgr2=0x7f18600b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 0x7f18600b7080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1868000c00 tx=0x7f1868031400 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 msgr2=0x7f18740759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f187000b8e0 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 shutdown_connections 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f18600b4b70 0x7f18600b7080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109260 0x7f18740759f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874109bb0 0x7f1874075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 --2- 172.21.15.2:0/451921872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874103920 0x7f18740754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.677+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 >> 172.21.15.2:0/451921872 conn(0x7f18740ff3b0 msgr2=0x7f18741017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.678+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 shutdown_connections 2024-08-31T04:18:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:18:40.678+0000 7f187c2d5640 1 -- 172.21.15.2:0/451921872 wait complete. 2024-08-31T04:18:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.465 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T04:18:41.467 INFO:tasks.cephadm:Deploying osd.4 on smithi064 with /dev/vg_nvme/lv_3... 2024-08-31T04:18:41.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:18:41.495 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:41.496 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.496 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:41.729 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:18:42.545 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:18:42 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:18:42.465+0000 7fa9187ab640 -1 osd.3 0 log_to_monitors true 2024-08-31T04:18:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:42 smithi064 ceph-mon[22007]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:42 smithi064 ceph-mon[22007]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:18:42.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:42 smithi002 ceph-mon[18656]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:42.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:42 smithi002 ceph-mon[18656]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:18:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:42 smithi132 ceph-mon[22335]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:42 smithi132 ceph-mon[22335]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:18:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:43 smithi064 ceph-mon[22007]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:18:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:43 smithi064 ceph-mon[22007]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:18:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:43 smithi064 ceph-mon[22007]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:18:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:43 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:43 smithi064 ceph-mon[22007]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:18:44.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:43 smithi002 ceph-mon[18656]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:18:44.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:43 smithi002 ceph-mon[18656]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:18:44.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:43 smithi002 ceph-mon[18656]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:18:44.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:43 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:43 smithi002 ceph-mon[18656]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:18:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:43 smithi132 ceph-mon[22335]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:18:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:43 smithi132 ceph-mon[22335]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:18:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:43 smithi132 ceph-mon[22335]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:18:44.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:43 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:43 smithi132 ceph-mon[22335]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:18:44.263 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:18:44.289 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_3 2024-08-31T04:18:44.319 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:18:44.238+0000 7fa914f42640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T04:18:44.319 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:18:44.245+0000 7fa90c523640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:18:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:18:44.845 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:44.845 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:18:44.845 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] boot 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:18:44.846 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.969 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] boot 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:18:44.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.066+0000 7f191d217640 1 -- 172.21.15.64:0/2540414581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19181045e0 msgr2=0x7f19181049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.066+0000 7f191d217640 1 --2- 172.21.15.64:0/2540414581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19181045e0 0x7f19181049f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1908009900 tx=0x7f190802a410 comp rx=0 tx=0).stop 2024-08-31T04:18:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 -- 172.21.15.64:0/2540414581 shutdown_connections 2024-08-31T04:18:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 --2- 172.21.15.64:0/2540414581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191810db90 0x7f19181100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 --2- 172.21.15.64:0/2540414581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1918105010 0x7f191810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 --2- 172.21.15.64:0/2540414581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19181045e0 0x7f19181049f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 -- 172.21.15.64:0/2540414581 >> 172.21.15.64:0/2540414581 conn(0x7f19180794d0 msgr2=0x7f19180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 -- 172.21.15.64:0/2540414581 shutdown_connections 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 -- 172.21.15.64:0/2540414581 wait complete. 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.067+0000 7f191d217640 1 Processor -- start 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 -- start start 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19181045e0 0x7f191819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1918105010 0x7f191819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1918113810 con 0x7f1918105010 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1918113690 con 0x7f191810db90 2024-08-31T04:18:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191d217640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1918113990 con 0x7f19181045e0 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60682/0 (socket says 172.21.15.64:60682) 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191759e640 1 -- 172.21.15.64:0/874006144 learned_addr learned my addr 172.21.15.64:0/874006144 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f1916d9d640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19181045e0 0x7f191819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.068+0000 7f191659c640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1918105010 0x7f191819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 -- 172.21.15.64:0/874006144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19181045e0 msgr2=0x7f191819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19181045e0 0x7f191819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 -- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1918105010 msgr2=0x7f191819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1918105010 0x7f191819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 -- 172.21.15.64:0/874006144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19181a01d0 con 0x7f191810db90 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191759e640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f191000eb10 tx=0x7f191000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910004b20 con 0x7f191810db90 2024-08-31T04:18:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19181a04c0 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1910004cc0 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.069+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910010670 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.070+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19181a6c20 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.071+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19181049f0 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.072+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f1910005020 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.073+0000 7f18fffff640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 0x7f19000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.073+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3917+0+0 (secure 0 0 0) 0x7f19100e4650 con 0x7f191810db90 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.073+0000 7f1916d9d640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 0x7f19000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.074+0000 7f1916d9d640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 0x7f19000b7090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908000c00 tx=0x7f1908031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.077+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f19100ac8b0 con 0x7f191810db90 2024-08-31T04:18:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:18:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:18:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868]' entity='osd.3' 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: osd.3 [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] boot 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:18:45.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:18:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:18:45.279+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1918107e40 con 0x7f19000b4b80 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi002 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi002 to 8546M 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:45.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:45 smithi064 ceph-mon[22007]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi002 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi002 to 8546M 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:46.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:46.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:46.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:45 smithi132 ceph-mon[22335]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:18:46.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:18:46.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:18:46.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi002 2024-08-31T04:18:46.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi002 to 8546M 2024-08-31T04:18:46.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:46.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:46.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:46.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:45 smithi002 ceph-mon[18656]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:18:46.980 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:46 smithi064 ceph-mon[22007]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:18:46.980 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:46 smithi064 ceph-mon[22007]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:46.980 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:46 smithi064 ceph-mon[22007]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:18:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:46 smithi132 ceph-mon[22335]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:18:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:46 smithi132 ceph-mon[22335]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:46 smithi132 ceph-mon[22335]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:18:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:46 smithi002 ceph-mon[18656]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:18:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:46 smithi002 ceph-mon[18656]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:46 smithi002 ceph-mon[18656]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:18:48.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-31T04:18:48.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/1796788044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"}]': finished 2024-08-31T04:18:48.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:18:48.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:47 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/1796788044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"}]': finished 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:18:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:47 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:18:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-31T04:18:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/1796788044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"} : dispatch 2024-08-31T04:18:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5585cc1-f8f8-4c13-bffc-893da439f2ff"}]': finished 2024-08-31T04:18:48.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:18:48.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:47 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:18:49.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:48 smithi064 ceph-mon[22007]: pgmap v82: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:49.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:48 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/1135628795' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:48 smithi132 ceph-mon[22335]: pgmap v82: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:48 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/1135628795' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:48 smithi002 ceph-mon[18656]: pgmap v82: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:48 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/1135628795' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:50.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:50 smithi002 ceph-mon[18656]: pgmap v84: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:51.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:50 smithi064 ceph-mon[22007]: pgmap v84: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:51.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:50 smithi132 ceph-mon[22335]: pgmap v84: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:52.918 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:52 smithi064 ceph-mon[22007]: pgmap v85: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:53.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:52 smithi132 ceph-mon[22335]: pgmap v85: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:52 smithi002 ceph-mon[18656]: pgmap v85: 1 pgs: 1 activating+degraded; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-31T04:18:54.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:53 smithi064 ceph-mon[22007]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-31T04:18:54.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:53 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:18:54.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:53 smithi132 ceph-mon[22335]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-31T04:18:54.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:53 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:18:54.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:53 smithi002 ceph-mon[18656]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-31T04:18:54.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:53 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:18:55.051 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:54 smithi064 ceph-mon[22007]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T04:18:55.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:54 smithi132 ceph-mon[22335]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T04:18:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:54 smithi002 ceph-mon[18656]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T04:18:57.019 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:56 smithi064 ceph-mon[22007]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T04:18:57.019 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:18:57.019 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:56 smithi132 ceph-mon[22335]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T04:18:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:18:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:56 smithi002 ceph-mon[18656]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T04:18:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:18:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:57.987 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:57 smithi064 ceph-mon[22007]: Deploying daemon osd.4 on smithi064 2024-08-31T04:18:58.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:57 smithi002 ceph-mon[18656]: Deploying daemon osd.4 on smithi064 2024-08-31T04:18:58.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:57 smithi132 ceph-mon[22335]: Deploying daemon osd.4 on smithi064 2024-08-31T04:18:58.863 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:18:58 smithi064 ceph-mon[22007]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:18:59.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:18:58 smithi002 ceph-mon[18656]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:18:59.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:18:58 smithi132 ceph-mon[22335]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:19:01.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:00 smithi002 ceph-mon[18656]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T04:19:01.222 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:00 smithi064 ceph-mon[22007]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T04:19:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:00 smithi132 ceph-mon[22335]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T04:19:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:02.265 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:02.265 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:02 smithi064 ceph-mon[22007]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:02 smithi002 ceph-mon[18656]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:02 smithi132 ceph-mon[22335]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:04 smithi002 ceph-mon[18656]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.261 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:04 smithi064 ceph-mon[22007]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:05.261 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.262 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:04 smithi132 ceph-mon[22335]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:05.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.872+0000 7f18fffff640 1 -- 172.21.15.64:0/874006144 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1918107e40 con 0x7f19000b4b80 2024-08-31T04:19:05.873 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 4 on host 'smithi064' 2024-08-31T04:19:05.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 msgr2=0x7f19000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:05.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 0x7f19000b7090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908000c00 tx=0x7f1908031400 comp rx=0 tx=0).stop 2024-08-31T04:19:05.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 msgr2=0x7f191819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:05.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f191000eb10 tx=0x7f191000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:19:05.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 shutdown_connections 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19000b4b80 0x7f19000b7090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1918105010 0x7f191819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191810db90 0x7f191819faa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 --2- 172.21.15.64:0/874006144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19181045e0 0x7f191819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.874+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 >> 172.21.15.64:0/874006144 conn(0x7f19180794d0 msgr2=0x7f1918107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.875+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 shutdown_connections 2024-08-31T04:19:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:05.875+0000 7f191d217640 1 -- 172.21.15.64:0/874006144 wait complete. 2024-08-31T04:19:06.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:06.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:06.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:06.179 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:06.180 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:06.180 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:06.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:06.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:06.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:06.491 DEBUG:teuthology.orchestra.run.smithi064:osd.4> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T04:19:06.493 INFO:tasks.cephadm:Deploying osd.5 on smithi132 with /dev/vg_nvme/lv_3... 2024-08-31T04:19:06.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:19:06.745 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:19:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:06 smithi064 ceph-mon[22007]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:07.102 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:06 smithi132 ceph-mon[22335]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:07.102 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:07.102 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:07.103 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:06 smithi002 ceph-mon[18656]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:08.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:19:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:19:08.126+0000 7f02e8939640 -1 osd.4 0 log_to_monitors true 2024-08-31T04:19:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:08 smithi064 ceph-mon[22007]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:08 smithi064 ceph-mon[22007]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:08 smithi064 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:08 smithi002 ceph-mon[18656]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:08 smithi002 ceph-mon[18656]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:08 smithi002 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:08 smithi132 ceph-mon[22335]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:08 smithi132 ceph-mon[22335]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:08 smithi132 ceph-mon[22335]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:19:09.519 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:19:09.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_3 2024-08-31T04:19:09.799 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:19:10.089 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:19:10.091 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:09 smithi132 ceph-mon[22335]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:19:10.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:19:10.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:09 smithi002 ceph-mon[18656]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:19:10.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:19:09.850+0000 7f02e48bb640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T04:19:10.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:19:09.856+0000 7f02e06b9640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:19:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:19:10.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:09 smithi064 ceph-mon[22007]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:19:10.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 -- 172.21.15.132:0/3328812963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc01810dc00 msgr2=0x7fc0181100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:10.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 --2- 172.21.15.132:0/3328812963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc01810dc00 0x7fc0181100d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc010009900 tx=0x7fc01002a410 comp rx=0 tx=0).stop 2024-08-31T04:19:10.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 -- 172.21.15.132:0/3328812963 shutdown_connections 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 --2- 172.21.15.132:0/3328812963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018105120 0x7fc01810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 --2- 172.21.15.132:0/3328812963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc01810dc00 0x7fc0181100d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 --2- 172.21.15.132:0/3328812963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0181047d0 0x7fc018104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 -- 172.21.15.132:0/3328812963 >> 172.21.15.132:0/3328812963 conn(0x7fc018079500 msgr2=0x7fc018079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 -- 172.21.15.132:0/3328812963 shutdown_connections 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 -- 172.21.15.132:0/3328812963 wait complete. 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.314+0000 7fc02016f640 1 Processor -- start 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 -- start start 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0181047d0 0x7fc01819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 0x7fc01819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0181138b0 con 0x7fc0181047d0 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc018113730 con 0x7fc01810dc00 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc02016f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc018113a30 con 0x7fc018105120 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49076/0 (socket says 172.21.15.132:49076) 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 -- 172.21.15.132:0/3352277315 learned_addr learned my addr 172.21.15.132:0/3352277315 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01df0b640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0181047d0 0x7fc01819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 -- 172.21.15.132:0/3352277315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 msgr2=0x7fc01819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01e70c640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 0x7fc01819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 0x7fc01819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 -- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0181047d0 msgr2=0x7fc01819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0181047d0 0x7fc01819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:10.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 -- 172.21.15.132:0/3352277315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0181a0190 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01e70c640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 0x7fc01819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.315+0000 7fc01d70a640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00e9f0 tx=0x7fc00c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.316+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00ccc0 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.316+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0181a0480 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.316+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc00c0108e0 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.316+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c018860 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.316+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a6be0 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.317+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018104be0 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.318+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fc00c010430 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.319+0000 7fc016ffd640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 0x7fc0000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.319+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7fc00c0e48f0 con 0x7fc018105120 2024-08-31T04:19:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.319+0000 7fc01df0b640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 0x7fc0000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.320+0000 7fc01df0b640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 0x7fc0000b7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc01806c630 tx=0x7fc008009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.322+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc00c0acad0 con 0x7fc018105120 2024-08-31T04:19:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:10.516+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc018100a10 con 0x7fc0000b4b80 2024-08-31T04:19:11.073 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:11.073 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi064 2024-08-31T04:19:11.073 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi064 to 8544M 2024-08-31T04:19:11.073 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:11.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:11.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:11.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi064 2024-08-31T04:19:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi064 to 8544M 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:11.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi064 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi064 to 8544M 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:11.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:11.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:12.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:19:12.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:19:12.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:12.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] boot 2024-08-31T04:19:12.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:19:12.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] boot 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:19:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: osd.4 [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] boot 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:19:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:19:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:12 smithi132 ceph-mon[22335]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:12 smithi132 ceph-mon[22335]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:19:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:12 smithi002 ceph-mon[18656]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:12 smithi002 ceph-mon[18656]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:19:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:12 smithi064 ceph-mon[22007]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:19:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:12 smithi064 ceph-mon[22007]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:19:14.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:14.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/1402272330' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"}]': finished 2024-08-31T04:19:14.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:19:14.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:14.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:13 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/3400962292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/1402272330' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"}]': finished 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:19:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:14.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:13 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/3400962292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/1402272330' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"} : dispatch 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c826df0-d572-44f2-950f-9c1d60d195e9"}]': finished 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:13 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/3400962292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:16.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:16 smithi064 ceph-mon[22007]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:16.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:16 smithi132 ceph-mon[22335]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:16.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:16 smithi002 ceph-mon[18656]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:18.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:18 smithi132 ceph-mon[22335]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:18.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:18 smithi002 ceph-mon[18656]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:18.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:18 smithi064 ceph-mon[22007]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:20.234 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:20 smithi132 ceph-mon[22335]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:20.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:20 smithi002 ceph-mon[18656]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:20 smithi064 ceph-mon[22007]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:22.295 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:22 smithi132 ceph-mon[22335]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:22.296 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:19:22.296 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:22.296 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:22 smithi132 ceph-mon[22335]: Deploying daemon osd.5 on smithi132 2024-08-31T04:19:22.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:22 smithi002 ceph-mon[18656]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:22.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:19:22.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:22.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:22 smithi002 ceph-mon[18656]: Deploying daemon osd.5 on smithi132 2024-08-31T04:19:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:22 smithi064 ceph-mon[22007]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:19:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:22 smithi064 ceph-mon[22007]: Deploying daemon osd.5 on smithi132 2024-08-31T04:19:24.110 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:24 smithi132 ceph-mon[22335]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:24.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:24 smithi002 ceph-mon[18656]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:24 smithi064 ceph-mon[22007]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:26.316 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:26 smithi132 ceph-mon[22335]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:26.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:26 smithi002 ceph-mon[18656]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:26.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:26 smithi064 ceph-mon[22007]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:27.390 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:27.390 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:27.390 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:27.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:27.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:27.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:28.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:28 smithi002 ceph-mon[18656]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:28.406 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:28 smithi132 ceph-mon[22335]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:28.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:28 smithi064 ceph-mon[22007]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:30.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.445+0000 7fc016ffd640 1 -- 172.21.15.132:0/3352277315 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc018100a10 con 0x7fc0000b4b80 2024-08-31T04:19:30.447 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 5 on host 'smithi132' 2024-08-31T04:19:30.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 msgr2=0x7fc0000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:30.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 0x7fc0000b7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc01806c630 tx=0x7fc008009500 comp rx=0 tx=0).stop 2024-08-31T04:19:30.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 msgr2=0x7fc01819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:30.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00e9f0 tx=0x7fc00c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:19:30.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 shutdown_connections 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc01810dc00 0x7fc01819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018105120 0x7fc01819a7c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0000b4b80 0x7fc0000b7090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 --2- 172.21.15.132:0/3352277315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0181047d0 0x7fc01819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 >> 172.21.15.132:0/3352277315 conn(0x7fc018079500 msgr2=0x7fc0180ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 shutdown_connections 2024-08-31T04:19:30.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:19:30.448+0000 7fc02016f640 1 -- 172.21.15.132:0/3352277315 wait complete. 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:30 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:30 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.102 DEBUG:teuthology.orchestra.run.smithi132:osd.5> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T04:19:31.105 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-08-31T04:19:31.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:19:31.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:31.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:30 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:32 smithi132 ceph-mon[22335]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:32.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:19:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:19:32.778+0000 7f3ea4e02640 -1 osd.5 0 log_to_monitors true 2024-08-31T04:19:32.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:32 smithi002 ceph-mon[18656]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:33.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:32 smithi064 ceph-mon[22007]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:33.915 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:33 smithi132 ceph-mon[22335]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:33.916 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:33 smithi132 ceph-mon[22335]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:34.049 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:33 smithi002 ceph-mon[18656]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:34.049 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:33 smithi002 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:34.052 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:19:34.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:33 smithi064 ceph-mon[22007]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:34.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:33 smithi064 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:19:34.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-08-31T04:19:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 -- 172.21.15.2:0/1175713250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554109240 msgr2=0x7f9554109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 --2- 172.21.15.2:0/1175713250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554109240 0x7f9554109650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9548009900 tx=0x7f954802a410 comp rx=0 tx=0).stop 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 -- 172.21.15.2:0/1175713250 shutdown_connections 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 --2- 172.21.15.2:0/1175713250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554109240 0x7f9554109650 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 --2- 172.21.15.2:0/1175713250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 0x7f95541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 --2- 172.21.15.2:0/1175713250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554103900 0x7f9554103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.823+0000 7f955b35c640 1 -- 172.21.15.2:0/1175713250 >> 172.21.15.2:0/1175713250 conn(0x7f955407b5f0 msgr2=0x7f955407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.824+0000 7f955b35c640 1 -- 172.21.15.2:0/1175713250 shutdown_connections 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.824+0000 7f955b35c640 1 -- 172.21.15.2:0/1175713250 wait complete. 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.824+0000 7f955b35c640 1 Processor -- start 2024-08-31T04:19:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.824+0000 7f955b35c640 1 -- start start 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554109240 0x7f955419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 0x7f955419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95541138a0 con 0x7f9554103900 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9554113720 con 0x7f9554109b90 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9554113a20 con 0x7f9554109240 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39792/0 (socket says 172.21.15.2:39792) 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 -- 172.21.15.2:0/590067841 learned_addr learned my addr 172.21.15.2:0/590067841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95588f7640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554109240 0x7f955419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95598f9640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 0x7f955419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 -- 172.21.15.2:0/590067841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554109240 msgr2=0x7f955419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554109240 0x7f955419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 -- 172.21.15.2:0/590067841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 msgr2=0x7f955419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 0x7f955419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 -- 172.21.15.2:0/590067841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541a01e0 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95590f8640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f955000e9f0 tx=0x7f955000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955000cd80 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95500054d0 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550010690 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95541a04d0 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.825+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95541a0990 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.827+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9554103d10 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.828+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f9550004e50 con 0x7f9554103900 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.829+0000 7f95467fc640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 0x7f95400b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.829+0000 7f95588f7640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 0x7f95400b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.829+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f95500e47c0 con 0x7f9554103900 2024-08-31T04:19:34.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.829+0000 7f95588f7640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 0x7f95400b70c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f954802aa00 tx=0x7f9548005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:34.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:34.833+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f95500ac750 con 0x7f9554103900 2024-08-31T04:19:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:35.031+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f95540635a0 con 0x7f95400b4bb0 2024-08-31T04:19:35.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:35.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:19:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:19:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:35.780 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:19:35.440+0000 7f3ea1599640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T04:19:35.781 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:19:35.446+0000 7f3e98b7a640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi132 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi132 to 8544M 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:35 smithi064 ceph-mon[22007]: from='osd.5 ' entity='osd.5' 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi132 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi132 to 8544M 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:35 smithi132 ceph-mon[22335]: from='osd.5 ' entity='osd.5' 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi132 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi132 to 8544M 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:36.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:36.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:36.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:35 smithi002 ceph-mon[18656]: from='osd.5 ' entity='osd.5' 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] boot 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:36 smithi064 ceph-mon[22007]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] boot 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:36 smithi132 ceph-mon[22335]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:19:37.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: osd.5 [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] boot 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:19:37.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:36 smithi002 ceph-mon[18656]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:19:38.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:38.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:19:38.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"} : dispatch 2024-08-31T04:19:38.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"}]': finished 2024-08-31T04:19:38.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:19:38.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"} : dispatch 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"}]': finished 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:38.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:19:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"} : dispatch 2024-08-31T04:19:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3310763506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "417ac9aa-e876-4135-be80-ee260fd3d904"}]': finished 2024-08-31T04:19:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:19:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:39.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:39 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3686227968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:39.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:39 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3686227968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:39.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:39 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3686227968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:40.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:40 smithi002 ceph-mon[18656]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:40 smithi064 ceph-mon[22007]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:40.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:40 smithi132 ceph-mon[22335]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:42 smithi002 ceph-mon[18656]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:42 smithi064 ceph-mon[22007]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:42 smithi132 ceph-mon[22335]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:44.369 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:44 smithi132 ceph-mon[22335]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:19:44.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:44 smithi002 ceph-mon[18656]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:19:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:44 smithi064 ceph-mon[22007]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:19:46.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:46 smithi002 ceph-mon[18656]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:19:46.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:19:46.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:46.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:46 smithi002 ceph-mon[18656]: Deploying daemon osd.6 on smithi002 2024-08-31T04:19:46.369 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:46 smithi064 ceph-mon[22007]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:19:46.370 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:19:46.370 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:46.370 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:46 smithi064 ceph-mon[22007]: Deploying daemon osd.6 on smithi002 2024-08-31T04:19:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:46 smithi132 ceph-mon[22335]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:19:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:19:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:46 smithi132 ceph-mon[22335]: Deploying daemon osd.6 on smithi002 2024-08-31T04:19:48.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:48 smithi002 ceph-mon[18656]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:19:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:48 smithi064 ceph-mon[22007]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:19:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:48 smithi132 ceph-mon[22335]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:19:50.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:50 smithi002 ceph-mon[18656]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T04:19:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:50 smithi064 ceph-mon[22007]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T04:19:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:50 smithi132 ceph-mon[22335]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T04:19:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:52 smithi002 ceph-mon[18656]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:52 smithi064 ceph-mon[22007]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:52 smithi132 ceph-mon[22335]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:54.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:54 smithi002 ceph-mon[18656]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:54 smithi064 ceph-mon[22007]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:54 smithi132 ceph-mon[22335]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:55.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:55.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:55.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.374 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-08-31T04:19:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.372+0000 7f95467fc640 1 -- 172.21.15.2:0/590067841 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f95540635a0 con 0x7f95400b4bb0 2024-08-31T04:19:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 msgr2=0x7f95400b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 0x7f95400b70c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f954802aa00 tx=0x7f9548005a20 comp rx=0 tx=0).stop 2024-08-31T04:19:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 msgr2=0x7f955419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f955000e9f0 tx=0x7f955000edf0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 shutdown_connections 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9554109b90 0x7f955419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9554109240 0x7f955419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95400b4bb0 0x7f95400b70c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 --2- 172.21.15.2:0/590067841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9554103900 0x7f955419a330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 >> 172.21.15.2:0/590067841 conn(0x7f955407b5f0 msgr2=0x7f9554105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 shutdown_connections 2024-08-31T04:19:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:19:55.376+0000 7f955b35c640 1 -- 172.21.15.2:0/590067841 wait complete. 2024-08-31T04:19:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:55.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:55.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:55.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.011 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T04:19:56.014 INFO:tasks.cephadm:Deploying osd.7 on smithi064 with /dev/vg_nvme/lv_2... 2024-08-31T04:19:56.014 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:19:56.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:56 smithi002 ceph-mon[18656]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:56.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:56.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.279 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:19:56.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:56 smithi064 ceph-mon[22007]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:56.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:56.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:56 smithi132 ceph-mon[22335]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:57.647 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:19:57 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:19:57.454+0000 7fc6b3b7b640 -1 osd.6 0 log_to_monitors true 2024-08-31T04:19:58.300 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:58 smithi064 ceph-mon[22007]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:58.300 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:58 smithi064 ceph-mon[22007]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:19:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:58 smithi132 ceph-mon[22335]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:58 smithi132 ceph-mon[22335]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:19:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:58 smithi002 ceph-mon[18656]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:19:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:58 smithi002 ceph-mon[18656]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:19:58.760 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:19:58.785 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_2 2024-08-31T04:19:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:19:59.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:19:59.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:19:59.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:19:59.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:59.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:59.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.423 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:59.424 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:19:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 -- 172.21.15.64:0/4243709162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108140 msgr2=0x7eff98108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/4243709162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108140 0x7eff98108550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009900 tx=0x7eff8c02a410 comp rx=0 tx=0).stop 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 -- 172.21.15.64:0/4243709162 shutdown_connections 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/4243709162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98108a90 0x7eff9810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/4243709162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108140 0x7eff98108550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/4243709162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98102800 0x7eff98102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 -- 172.21.15.64:0/4243709162 >> 172.21.15.64:0/4243709162 conn(0x7eff980794d0 msgr2=0x7eff980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 -- 172.21.15.64:0/4243709162 shutdown_connections 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.513+0000 7eff9e1b5640 1 -- 172.21.15.64:0/4243709162 wait complete. 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 Processor -- start 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 -- start start 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98102800 0x7eff98198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98108140 0x7eff98199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff981126e0 con 0x7eff98108140 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff98112560 con 0x7eff98108a90 2024-08-31T04:19:59.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff9e1b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7eff98112860 con 0x7eff98102800 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff97fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff97fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48166/0 (socket says 172.21.15.64:48166) 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff97fff640 1 -- 172.21.15.64:0/2933005688 learned_addr learned my addr 172.21.15.64:0/2933005688 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.514+0000 7eff96ffd640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98108140 0x7eff98199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff977fe640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98102800 0x7eff98198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 -- 172.21.15.64:0/2933005688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98102800 msgr2=0x7eff98198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98102800 0x7eff98198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 -- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98108140 msgr2=0x7eff98199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98108140 0x7eff98199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 -- 172.21.15.64:0/2933005688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff981a84b0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff97fff640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff9000eaa0 tx=0x7eff9000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9000cdb0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff90005020 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff981a87a0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff900116d0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.515+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981a8cb0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.516+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff98102c10 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.518+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7eff900051d0 con 0x7eff98108a90 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.518+0000 7eff94ff9640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 0x7eff800b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.518+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7eff900e4590 con 0x7eff98108a90 2024-08-31T04:19:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.518+0000 7eff977fe640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 0x7eff800b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.519+0000 7eff977fe640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 0x7eff800b7090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff88005fd0 tx=0x7eff88005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.523+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7eff90016030 con 0x7eff98108a90 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:59.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:19:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:19:59.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:19:59.719+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7eff980635a0 con 0x7eff800b4b80 2024-08-31T04:20:00.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:19:59.762+0000 7fc6afafd640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T04:20:00.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:19:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:19:59.771+0000 7fc6a78f3640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:20:00.464 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:00.464 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi002 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi002 to 5697M 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' 2024-08-31T04:20:00.465 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:00 smithi064 ceph-mon[22007]: overall HEALTH_OK 2024-08-31T04:20:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi002 2024-08-31T04:20:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi002 to 5697M 2024-08-31T04:20:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:20:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' 2024-08-31T04:20:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:00 smithi132 ceph-mon[22335]: overall HEALTH_OK 2024-08-31T04:20:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi002 2024-08-31T04:20:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi002 to 5697M 2024-08-31T04:20:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: from='osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183]' entity='osd.6' 2024-08-31T04:20:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:00 smithi002 ceph-mon[18656]: overall HEALTH_OK 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] boot 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:20:01.408 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] boot 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:20:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:20:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:20:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: osd.6 [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] boot 2024-08-31T04:20:01.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:20:01.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/2020373118' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"}]': finished 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T04:20:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/2020373118' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"}]': finished 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T04:20:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:20:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/2020373118' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"} : dispatch 2024-08-31T04:20:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a85816f-eef9-4786-a3ab-29640863c16d"}]': finished 2024-08-31T04:20:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T04:20:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:03 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/1930145119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:04.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:03 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/1930145119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:04.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/1930145119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:05.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:04 smithi064 ceph-mon[22007]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:05.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:04 smithi132 ceph-mon[22335]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:04 smithi002 ceph-mon[18656]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:06 smithi064 ceph-mon[22007]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:07.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:06 smithi132 ceph-mon[22335]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:06 smithi002 ceph-mon[18656]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:08 smithi064 ceph-mon[22007]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:09.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:08 smithi132 ceph-mon[22335]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:08 smithi002 ceph-mon[18656]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:10 smithi064 ceph-mon[22007]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:11.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:10 smithi132 ceph-mon[22335]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:10 smithi002 ceph-mon[18656]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:12.023 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:20:12.023 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:12.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:20:12.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:20:12.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:12.956 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:12 smithi064 ceph-mon[22007]: Deploying daemon osd.7 on smithi064 2024-08-31T04:20:12.956 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:12 smithi064 ceph-mon[22007]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:12 smithi132 ceph-mon[22335]: Deploying daemon osd.7 on smithi064 2024-08-31T04:20:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:12 smithi132 ceph-mon[22335]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:12 smithi002 ceph-mon[18656]: Deploying daemon osd.7 on smithi064 2024-08-31T04:20:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:12 smithi002 ceph-mon[18656]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:14.924 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:14 smithi064 ceph-mon[22007]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:15.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:14 smithi132 ceph-mon[22335]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:14 smithi002 ceph-mon[18656]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:17.049 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:16 smithi064 ceph-mon[22007]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:17.049 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:17.049 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:17.049 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:16 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:16 smithi132 ceph-mon[22335]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:17.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:16 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:16 smithi002 ceph-mon[18656]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:16 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:19.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:18 smithi064 ceph-mon[22007]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:18 smithi132 ceph-mon[22335]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:18 smithi002 ceph-mon[18656]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:20.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.285+0000 7eff94ff9640 1 -- 172.21.15.64:0/2933005688 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7eff980635a0 con 0x7eff800b4b80 2024-08-31T04:20:20.287 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 7 on host 'smithi064' 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 msgr2=0x7eff800b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 0x7eff800b7090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff88005fd0 tx=0x7eff88005c70 comp rx=0 tx=0).stop 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 msgr2=0x7eff98199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff9000eaa0 tx=0x7eff9000ef60 comp rx=0 tx=0).stop 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 shutdown_connections 2024-08-31T04:20:20.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff800b4b80 0x7eff800b7090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98108140 0x7eff98199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff98108a90 0x7eff98199880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 --2- 172.21.15.64:0/2933005688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff98102800 0x7eff98198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 >> 172.21.15.64:0/2933005688 conn(0x7eff980794d0 msgr2=0x7eff98105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.287+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 shutdown_connections 2024-08-31T04:20:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:20:20.288+0000 7eff9e1b5640 1 -- 172.21.15.64:0/2933005688 wait complete. 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:20.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:20.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:20.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:20.938 DEBUG:teuthology.orchestra.run.smithi064:osd.7> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T04:20:20.941 INFO:tasks.cephadm:Deploying osd.8 on smithi132 with /dev/vg_nvme/lv_2... 2024-08-31T04:20:20.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:20:21.197 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:20:21.493 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:21.494 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:21.494 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:21 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:21.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:21.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:21.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:21 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:21.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:21.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:21.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:21 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:22.172 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:20:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:20:22.012+0000 7f97c9d7b640 -1 osd.7 0 log_to_monitors true 2024-08-31T04:20:22.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:22 smithi064 ceph-mon[22007]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:22.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:22 smithi064 ceph-mon[22007]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:22.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:22 smithi064 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:22 smithi132 ceph-mon[22335]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:22 smithi132 ceph-mon[22335]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:22 smithi132 ceph-mon[22335]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:22 smithi002 ceph-mon[18656]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:22 smithi002 ceph-mon[18656]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:22 smithi002 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:20:23.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:23 smithi132 ceph-mon[22335]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:20:23.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:23 smithi132 ceph-mon[22335]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:20:23.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:23.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:23 smithi132 ceph-mon[22335]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:23 smithi132 ceph-mon[22335]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:20:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-mon[22007]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:20:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-mon[22007]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:23 smithi002 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:20:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:23 smithi002 ceph-mon[18656]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:20:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:23 smithi002 ceph-mon[18656]: from='osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:23 smithi002 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:20:23.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:20:23.842 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_2 2024-08-31T04:20:24.099 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:20:24.302 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:20:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:20:23.991+0000 7f97c5cfd640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T04:20:24.302 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:20:24.002+0000 7f97bdaf3640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='osd.7 ' entity='osd.7' 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.486 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:24.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:24 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='osd.7 ' entity='osd.7' 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:24.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:24.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:24 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 -- 172.21.15.132:0/1410884583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70102800 msgr2=0x7f7a70102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1410884583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70102800 0x7f7a70102c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009900 tx=0x7f7a6c02a410 comp rx=0 tx=0).stop 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 -- 172.21.15.132:0/1410884583 shutdown_connections 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1410884583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70108140 0x7f7a70108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1410884583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108a90 0x7f7a7010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1410884583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70102800 0x7f7a70102c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 -- 172.21.15.132:0/1410884583 >> 172.21.15.132:0/1410884583 conn(0x7f7a700794d0 msgr2=0x7f7a700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 -- 172.21.15.132:0/1410884583 shutdown_connections 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.553+0000 7f7a783c9640 1 -- 172.21.15.132:0/1410884583 wait complete. 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.554+0000 7f7a783c9640 1 Processor -- start 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.554+0000 7f7a783c9640 1 -- start start 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 0x7f7a7019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108140 0x7f7a7019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70112710 con 0x7f7a70102800 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70112590 con 0x7f7a70108140 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70112890 con 0x7f7a70108a90 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44678/0 (socket says 172.21.15.132:44678) 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 -- 172.21.15.132:0/1264946145 learned_addr learned my addr 172.21.15.132:0/1264946145 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a75964640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108140 0x7f7a7019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76165640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 0x7f7a7019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 -- 172.21.15.132:0/1264946145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108140 msgr2=0x7f7a7019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108140 0x7f7a7019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 -- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 msgr2=0x7f7a7019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 0x7f7a7019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 -- 172.21.15.132:0/1264946145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a701a0240 con 0x7f7a70108a90 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76165640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 0x7f7a7019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a76966640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800eb10 tx=0x7f7a6800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68004b20 con 0x7f7a70108a90 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a68004cc0 con 0x7f7a70108a90 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a701a0530 con 0x7f7a70108a90 2024-08-31T04:20:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68010670 con 0x7f7a70108a90 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.555+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a701a6c90 con 0x7f7a70108a90 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.556+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a70102c10 con 0x7f7a70108a90 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.558+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f7a68005000 con 0x7f7a70108a90 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.558+0000 7f7a677fe640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 0x7f7a5c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.559+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5645+0+0 (secure 0 0 0) 0x7f7a680e4ea0 con 0x7f7a70108a90 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.559+0000 7f7a76165640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 0x7f7a5c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.559+0000 7f7a76165640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 0x7f7a5c0b7090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0096c0 tx=0x7f7a6c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.562+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a68056130 con 0x7f7a70108a90 2024-08-31T04:20:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:20:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:20:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='osd.7 ' entity='osd.7' 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:24.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:24 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:24.746+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7a7006ac50 con 0x7f7a5c0b4b80 2024-08-31T04:20:25.408 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:20:25.408 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi064 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi064 to 5696M 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] boot 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:25.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi064 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi064 to 5696M 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] boot 2024-08-31T04:20:25.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T04:20:25.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:25.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:25.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:25.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi064 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi064 to 5696M 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: osd.7 [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] boot 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:25.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:26.489 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:26 smithi132 ceph-mon[22335]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:26.489 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:26 smithi132 ceph-mon[22335]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:20:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:26 smithi002 ceph-mon[18656]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:26 smithi002 ceph-mon[18656]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:20:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:26 smithi064 ceph-mon[22007]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:20:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:26 smithi064 ceph-mon[22007]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/705385869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"}]': finished 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:20:27.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:27 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/705385869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"}]': finished 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:20:27.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:27 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:20:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/705385869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"} : dispatch 2024-08-31T04:20:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62ec99e5-2cff-4ab4-984f-bffffd019944"}]': finished 2024-08-31T04:20:27.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:20:27.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:27 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:28 smithi002 ceph-mon[18656]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:28 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/234663358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:28 smithi064 ceph-mon[22007]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:28 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/234663358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:28 smithi132 ceph-mon[22335]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:28 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/234663358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:30 smithi002 ceph-mon[18656]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:30 smithi064 ceph-mon[22007]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:30 smithi132 ceph-mon[22335]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:32.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:32 smithi132 ceph-mon[22335]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:20:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:32 smithi002 ceph-mon[18656]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:20:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:32 smithi064 ceph-mon[22007]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:20:34.548 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:34 smithi132 ceph-mon[22335]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:20:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:34 smithi002 ceph-mon[18656]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:20:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:34 smithi064 ceph-mon[22007]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:20:35.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:20:35.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:35.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:20:35.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:20:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:36.618 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:36 smithi132 ceph-mon[22335]: Deploying daemon osd.8 on smithi132 2024-08-31T04:20:36.618 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:36 smithi132 ceph-mon[22335]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T04:20:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:36 smithi002 ceph-mon[18656]: Deploying daemon osd.8 on smithi132 2024-08-31T04:20:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:36 smithi002 ceph-mon[18656]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T04:20:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:36 smithi064 ceph-mon[22007]: Deploying daemon osd.8 on smithi132 2024-08-31T04:20:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:36 smithi064 ceph-mon[22007]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T04:20:38.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:38 smithi132 ceph-mon[22335]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:20:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:38 smithi002 ceph-mon[18656]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:20:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:38 smithi064 ceph-mon[22007]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:20:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:40 smithi002 ceph-mon[18656]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:20:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:40 smithi064 ceph-mon[22007]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:20:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:40 smithi132 ceph-mon[22335]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:20:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:41 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:41.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:41.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:41.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:41 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:41 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:42.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:42 smithi002 ceph-mon[18656]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:20:43.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:42 smithi132 ceph-mon[22335]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:20:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:42 smithi064 ceph-mon[22007]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:20:44.192 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 8 on host 'smithi132' 2024-08-31T04:20:44.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.191+0000 7f7a677fe640 1 -- 172.21.15.132:0/1264946145 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a7006ac50 con 0x7f7a5c0b4b80 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 msgr2=0x7f7a5c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 0x7f7a5c0b7090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0096c0 tx=0x7f7a6c031400 comp rx=0 tx=0).stop 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 msgr2=0x7f7a7019fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800eb10 tx=0x7f7a6800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 shutdown_connections 2024-08-31T04:20:44.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a70108a90 0x7f7a7019fb10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a70108140 0x7f7a7019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a5c0b4b80 0x7f7a5c0b7090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 --2- 172.21.15.132:0/1264946145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a70102800 0x7f7a7019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 >> 172.21.15.132:0/1264946145 conn(0x7f7a700794d0 msgr2=0x7f7a70101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 shutdown_connections 2024-08-31T04:20:44.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:20:44.194+0000 7f7a783c9640 1 -- 172.21.15.132:0/1264946145 wait complete. 2024-08-31T04:20:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:44 smithi132 ceph-mon[22335]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:44.874 DEBUG:teuthology.orchestra.run.smithi132:osd.8> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T04:20:44.877 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-08-31T04:20:44.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:20:44.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:44 smithi002 ceph-mon[18656]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:44.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:44.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:44 smithi064 ceph-mon[22007]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:46.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:46 smithi064 ceph-mon[22007]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:46.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:46 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:46 smithi132 ceph-mon[22335]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:46.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:46 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:46 smithi002 ceph-mon[18656]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:46.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:46 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:46.699 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:20:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:20:46.463+0000 7f0430a7e640 -1 osd.8 0 log_to_monitors true 2024-08-31T04:20:47.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:47 smithi002 ceph-mon[18656]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:47 smithi002 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:47 smithi132 ceph-mon[22335]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:47 smithi132 ceph-mon[22335]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:47 smithi064 ceph-mon[22007]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:47 smithi064 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:20:47.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:20:47.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-08-31T04:20:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:48.307 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:20:48.073+0000 7f042ca00640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T04:20:48.307 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:20:48.082+0000 7f04287fe640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:48 smithi132 ceph-mon[22335]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:48.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:20:48.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:20:48.366 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:48.366 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.366 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:48 smithi002 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: from='osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:48 smithi064 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 -- 172.21.15.2:0/2488177295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108140 msgr2=0x7f289c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 --2- 172.21.15.2:0/2488177295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108140 0x7f289c108550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2890009900 tx=0x7f289002a410 comp rx=0 tx=0).stop 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 -- 172.21.15.2:0/2488177295 shutdown_connections 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 --2- 172.21.15.2:0/2488177295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108140 0x7f289c108550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 --2- 172.21.15.2:0/2488177295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c108a90 0x7f289c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 --2- 172.21.15.2:0/2488177295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c102800 0x7f289c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 -- 172.21.15.2:0/2488177295 >> 172.21.15.2:0/2488177295 conn(0x7f289c0794d0 msgr2=0x7f289c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 -- 172.21.15.2:0/2488177295 shutdown_connections 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.596+0000 7f28a0c94640 1 -- 172.21.15.2:0/2488177295 wait complete. 2024-08-31T04:20:48.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.597+0000 7f28a0c94640 1 Processor -- start 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.597+0000 7f28a0c94640 1 -- start start 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c102800 0x7f289c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c108140 0x7f289c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f289c1126c0 con 0x7f289c108a90 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f289c112540 con 0x7f289c102800 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f28a0c94640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f289c112840 con 0x7f289c108140 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39994/0 (socket says 172.21.15.2:39994) 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 -- 172.21.15.2:0/859047738 learned_addr learned my addr 172.21.15.2:0/859047738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f2899d9b640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c108140 0x7f289c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289a59c640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c102800 0x7f289c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 -- 172.21.15.2:0/859047738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c108140 msgr2=0x7f289c19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c108140 0x7f289c19b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 -- 172.21.15.2:0/859047738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c102800 msgr2=0x7f289c19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c102800 0x7f289c19b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 -- 172.21.15.2:0/859047738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c1a62d0 con 0x7f289c108a90 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f289ad9d640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f289400eb10 tx=0x7f289400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.598+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894004b20 con 0x7f289c108a90 2024-08-31T04:20:48.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.599+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c1a65c0 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.599+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2894004cc0 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.599+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894010670 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.599+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c1a6ad0 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.600+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c102c10 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.601+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f2894005020 con 0x7f289c108a90 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.602+0000 7f288b7fe640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 0x7f28840b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.602+0000 7f289a59c640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 0x7f28840b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.602+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f28940e4d00 con 0x7f289c108a90 2024-08-31T04:20:48.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.603+0000 7f289a59c640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 0x7f28840b7090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f289c06b780 tx=0x7f288c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:48.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.607+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28940ac820 con 0x7f289c108a90 2024-08-31T04:20:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:20:48.803+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f289c0635a0 con 0x7f28840b4b80 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi132 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi132 to 5696M 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] boot 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:20:49.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:49 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:20:49.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:20:49.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi132 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi132 to 5696M 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] boot 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:49 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:20:49.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi132 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi132 to 5696M 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: osd.8 [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] boot 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:20:49.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:49 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:20:50.251 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:50 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:20:50.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:50 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:20:50.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:50 smithi002 ceph-mon[18656]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:50.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:50 smithi002 ceph-mon[18656]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:20:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:50 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:20:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:50 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:20:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:50 smithi064 ceph-mon[22007]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:50 smithi064 ceph-mon[22007]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:20:50.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:50 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:20:50.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:50 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:20:50.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:50 smithi132 ceph-mon[22335]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:20:50.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:50 smithi132 ceph-mon[22335]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:20:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:20:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"} : dispatch 2024-08-31T04:20:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"}]': finished 2024-08-31T04:20:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:20:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:20:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:52 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4060664179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"} : dispatch 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"}]': finished 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:20:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:52 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4060664179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"} : dispatch 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1035697533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5631cd2a-008f-40a9-b09d-7fa3e05bbddd"}]': finished 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:20:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:52 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4060664179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:20:54.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:54 smithi002 ceph-mon[18656]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:54 smithi064 ceph-mon[22007]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:54 smithi132 ceph-mon[22335]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:56.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:56 smithi002 ceph-mon[18656]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:56.406 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:56 smithi132 ceph-mon[22335]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:56 smithi064 ceph-mon[22007]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:20:58.393 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:20:58 smithi002 ceph-mon[18656]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:20:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:20:58 smithi064 ceph-mon[22007]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:20:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:20:58 smithi132 ceph-mon[22335]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T04:21:00.287 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:00 smithi002 ceph-mon[18656]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:00 smithi064 ceph-mon[22007]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:00 smithi132 ceph-mon[22335]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:21:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:01 smithi002 ceph-mon[18656]: Deploying daemon osd.9 on smithi002 2024-08-31T04:21:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:21:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:01 smithi064 ceph-mon[22007]: Deploying daemon osd.9 on smithi002 2024-08-31T04:21:01.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:21:01.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:01.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:01 smithi132 ceph-mon[22335]: Deploying daemon osd.9 on smithi002 2024-08-31T04:21:02.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:02 smithi002 ceph-mon[18656]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:21:02.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:02 smithi064 ceph-mon[22007]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:21:02.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:02 smithi132 ceph-mon[22335]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:21:04.219 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:04 smithi002 ceph-mon[18656]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:21:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:04 smithi064 ceph-mon[22007]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:21:04.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:04 smithi132 ceph-mon[22335]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:21:06.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:06 smithi002 ceph-mon[18656]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:06.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:06.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:06.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:06 smithi064 ceph-mon[22007]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:06 smithi132 ceph-mon[22335]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:08.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:08 smithi002 ceph-mon[18656]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:08 smithi064 ceph-mon[22007]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:08.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:08 smithi132 ceph-mon[22335]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:09.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.619+0000 7f288b7fe640 1 -- 172.21.15.2:0/859047738 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f289c0635a0 con 0x7f28840b4b80 2024-08-31T04:21:09.621 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-08-31T04:21:09.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 msgr2=0x7f28840b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:09.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 0x7f28840b7090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f289c06b780 tx=0x7f288c00b410 comp rx=0 tx=0).stop 2024-08-31T04:21:09.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 msgr2=0x7f289c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f289400eb10 tx=0x7f289400c2d0 comp rx=0 tx=0).stop 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 shutdown_connections 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f28840b4b80 0x7f28840b7090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f289c108a90 0x7f289c19ba90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f289c108140 0x7f289c19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 --2- 172.21.15.2:0/859047738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f289c102800 0x7f289c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 >> 172.21.15.2:0/859047738 conn(0x7f289c0794d0 msgr2=0x7f289c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 shutdown_connections 2024-08-31T04:21:09.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:21:09.622+0000 7f28a0c94640 1 -- 172.21.15.2:0/859047738 wait complete. 2024-08-31T04:21:10.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:10.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:10.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:10.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:10.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:09 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.295 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T04:21:10.297 INFO:tasks.cephadm:Deploying osd.10 on smithi064 with /dev/vg_nvme/lv_1... 2024-08-31T04:21:10.297 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:09 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:09 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:10.568 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:21:11.613 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:21:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:21:11.252+0000 7f3781e03640 -1 osd.9 0 log_to_monitors true 2024-08-31T04:21:12.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:12 smithi002 ceph-mon[18656]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:12.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:12 smithi002 ceph-mon[18656]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:21:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:12 smithi064 ceph-mon[22007]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:12.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:12 smithi064 ceph-mon[22007]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:21:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:12 smithi132 ceph-mon[22335]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:12 smithi132 ceph-mon[22335]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:21:13.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-mon[18656]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:21:13.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-mon[18656]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:21:13.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-mon[18656]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:21:13.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:13.460 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:13 smithi064 ceph-mon[22007]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:21:13.461 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:13 smithi064 ceph-mon[22007]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:21:13.461 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:13 smithi064 ceph-mon[22007]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:21:13.461 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:13 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:13.463 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-08-31T04:21:13.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_1 2024-08-31T04:21:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:13 smithi132 ceph-mon[22335]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:21:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:13 smithi132 ceph-mon[22335]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:21:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:13 smithi132 ceph-mon[22335]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-08-31T04:21:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:13 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:13.780 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:21:14.108 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:21:13.661+0000 7f377dd85640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T04:21:14.108 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:21:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:21:13.673+0000 7f3775b7b640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:21:14.206 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi002 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.207 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi002 to 4273M 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.208 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:14 smithi064 ceph-mon[22007]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' 2024-08-31T04:21:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- 172.21.15.64:0/1793116938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 msgr2=0x7fd54810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 --2- 172.21.15.64:0/1793116938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd54810f2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd540009ca0 tx=0x7fd54002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- 172.21.15.64:0/1793116938 shutdown_connections 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 --2- 172.21.15.64:0/1793116938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548108140 0x7fd548108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 --2- 172.21.15.64:0/1793116938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd54810f2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 --2- 172.21.15.64:0/1793116938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548102800 0x7fd548102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- 172.21.15.64:0/1793116938 >> 172.21.15.64:0/1793116938 conn(0x7fd5480794d0 msgr2=0x7fd5480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- 172.21.15.64:0/1793116938 shutdown_connections 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- 172.21.15.64:0/1793116938 wait complete. 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 Processor -- start 2024-08-31T04:21:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.300+0000 7fd550364640 1 -- start start 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548102800 0x7fd54810fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548108140 0x7fd548110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd548113820 con 0x7fd548102800 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481136a0 con 0x7fd548108a90 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd550364640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481139a0 con 0x7fd548108140 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59806/0 (socket says 172.21.15.64:59806) 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 -- 172.21.15.64:0/4064831808 learned_addr learned my addr 172.21.15.64:0/4064831808 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e100640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548102800 0x7fd54810fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54d8ff640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548108140 0x7fd548110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 -- 172.21.15.64:0/4064831808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548108140 msgr2=0x7fd548110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548108140 0x7fd548110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 -- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548102800 msgr2=0x7fd54810fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548102800 0x7fd54810fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 -- 172.21.15.64:0/4064831808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5481a83e0 con 0x7fd548108a90 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.301+0000 7fd54e901640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd540005cc0 tx=0x7fd54002f380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.302+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540003bf0 con 0x7fd548108a90 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.302+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5481a8670 con 0x7fd548108a90 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.302+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd540003d90 con 0x7fd548108a90 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.302+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5481a8c00 con 0x7fd548108a90 2024-08-31T04:21:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.302+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54002fb20 con 0x7fd548108a90 2024-08-31T04:21:14.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.303+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd548102c10 con 0x7fd548108a90 2024-08-31T04:21:14.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.305+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fd540004580 con 0x7fd548108a90 2024-08-31T04:21:14.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.306+0000 7fd53f7fe640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 0x7fd5340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.306+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7fd5401060b0 con 0x7fd548108a90 2024-08-31T04:21:14.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.306+0000 7fd54e100640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 0x7fd5340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.307+0000 7fd54e100640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 0x7fd5340b7090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd5481117a0 tx=0x7fd54400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:14.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.309+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5400cda20 con 0x7fd548108a90 2024-08-31T04:21:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:21:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:21:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi002 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi002 to 4273M 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:14 smithi002 ceph-mon[18656]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi002 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi002 to 4273M 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:14.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:14 smithi132 ceph-mon[22335]: from='osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291]' entity='osd.9' 2024-08-31T04:21:14.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:14.503+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd5480635a0 con 0x7fd5340b4b80 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] boot 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:21:15.260 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:15 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:15.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:21:15.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:21:15.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:15.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] boot 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:21:15.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:15 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:15.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: osd.9 [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] boot 2024-08-31T04:21:15.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:21:15.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:15 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:21:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:16 smithi064 ceph-mon[22007]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:16 smithi064 ceph-mon[22007]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:21:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:16 smithi132 ceph-mon[22335]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:16 smithi132 ceph-mon[22335]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:21:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:16 smithi002 ceph-mon[18656]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:21:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:16 smithi002 ceph-mon[18656]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:21:18.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/2653306841' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"}]': finished 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:17 smithi064 ceph-mon[22007]: from='client.? 172.21.15.64:0/1535778720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/2653306841' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"}]': finished 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:21:18.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:18.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:17 smithi132 ceph-mon[22335]: from='client.? 172.21.15.64:0/1535778720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:18.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/2653306841' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"} : dispatch 2024-08-31T04:21:18.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f893c6f-12bd-4afc-8b24-c706cd68cb1b"}]': finished 2024-08-31T04:21:18.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:21:18.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:18.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:17 smithi002 ceph-mon[18656]: from='client.? 172.21.15.64:0/1535778720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:19.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:18 smithi064 ceph-mon[22007]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:18 smithi132 ceph-mon[22335]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:18 smithi002 ceph-mon[18656]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:21.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:20 smithi064 ceph-mon[22007]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:21.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:20 smithi132 ceph-mon[22335]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:21.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:20 smithi002 ceph-mon[18656]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:22.899 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:22 smithi064 ceph-mon[22007]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:23.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:22 smithi132 ceph-mon[22335]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:22 smithi002 ceph-mon[18656]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:24.996 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:24 smithi064 ceph-mon[22007]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:25.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:24 smithi132 ceph-mon[22335]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:25.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:24 smithi002 ceph-mon[18656]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:26.059 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:21:26.060 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:25 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:26.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:21:26.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:25 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:26.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:21:26.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:25 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:27.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:26 smithi064 ceph-mon[22007]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:27.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:26 smithi064 ceph-mon[22007]: Deploying daemon osd.10 on smithi064 2024-08-31T04:21:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:26 smithi132 ceph-mon[22335]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:26 smithi132 ceph-mon[22335]: Deploying daemon osd.10 on smithi064 2024-08-31T04:21:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:26 smithi002 ceph-mon[18656]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:26 smithi002 ceph-mon[18656]: Deploying daemon osd.10 on smithi064 2024-08-31T04:21:28.786 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:28 smithi064 ceph-mon[22007]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:29.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:28 smithi132 ceph-mon[22335]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:28 smithi002 ceph-mon[18656]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:31.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:30 smithi064 ceph-mon[22007]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:31.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:30 smithi132 ceph-mon[22335]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:31.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:30 smithi002 ceph-mon[18656]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:31.988 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:31.988 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:31.988 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:31 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:31 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:31 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:33.012 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:32 smithi064 ceph-mon[22007]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:33.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:32 smithi132 ceph-mon[22335]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:32 smithi002 ceph-mon[18656]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 10 on host 'smithi064' 2024-08-31T04:21:34.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.875+0000 7fd53f7fe640 1 -- 172.21.15.64:0/4064831808 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd5480635a0 con 0x7fd5340b4b80 2024-08-31T04:21:34.877 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:34.878 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:34.878 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:34.878 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:34.878 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:34.878 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:34.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.877+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 msgr2=0x7fd5340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.877+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 0x7fd5340b7090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd5481117a0 tx=0x7fd54400a2d0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.877+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 msgr2=0x7fd5481107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.877+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd540005cc0 tx=0x7fd54002f380 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 shutdown_connections 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd548108a90 0x7fd5481107d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd548108140 0x7fd548110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5340b4b80 0x7fd5340b7090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 --2- 172.21.15.64:0/4064831808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd548102800 0x7fd54810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 >> 172.21.15.64:0/4064831808 conn(0x7fd5480794d0 msgr2=0x7fd548104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 shutdown_connections 2024-08-31T04:21:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-08-31T04:21:34.878+0000 7fd550364640 1 -- 172.21.15.64:0/4064831808 wait complete. 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.557 DEBUG:teuthology.orchestra.run.smithi064:osd.10> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T04:21:35.559 INFO:tasks.cephadm:Deploying osd.11 on smithi132 with /dev/vg_nvme/lv_1... 2024-08-31T04:21:35.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:21:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:21:35.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:35 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:35.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:35.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:35 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:35 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:37.039 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:36 smithi064 ceph-mon[22007]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:37.138 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:36 smithi132 ceph-mon[22335]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:37.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:36 smithi002 ceph-mon[18656]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:38.050 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:37 smithi002 ceph-mon[18656]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:37 smithi002 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:37 smithi064 ceph-mon[22007]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:37 smithi064 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:21:37 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:21:37.651+0000 7f174cc7b640 -1 osd.10 0 log_to_monitors true 2024-08-31T04:21:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:37 smithi132 ceph-mon[22335]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:37 smithi132 ceph-mon[22335]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:21:38.626 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-08-31T04:21:38.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_1 2024-08-31T04:21:38.907 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:21:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:39.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:39.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:38 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.194 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:39.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:39.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:38 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:21:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:21:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:21:39.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:38 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:39.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 -- 172.21.15.132:0/3846943547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109bd0 msgr2=0x7f3a40110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 --2- 172.21.15.132:0/3846943547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109bd0 0x7f3a40110400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009900 tx=0x7f3a3802a410 comp rx=0 tx=0).stop 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 -- 172.21.15.132:0/3846943547 shutdown_connections 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 --2- 172.21.15.132:0/3846943547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109bd0 0x7f3a40110400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 --2- 172.21.15.132:0/3846943547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40109280 0x7f3a40109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 --2- 172.21.15.132:0/3846943547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40103940 0x7f3a40103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 -- 172.21.15.132:0/3846943547 >> 172.21.15.132:0/3846943547 conn(0x7f3a400ff3d0 msgr2=0x7f3a40101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 -- 172.21.15.132:0/3846943547 shutdown_connections 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.420+0000 7f3a48220640 1 -- 172.21.15.132:0/3846943547 wait complete. 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 Processor -- start 2024-08-31T04:21:39.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 -- start start 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40103940 0x7f3a4019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40109bd0 0x7f3a4019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40113890 con 0x7f3a40109bd0 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40113710 con 0x7f3a40103940 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a48220640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40113a10 con 0x7f3a40109280 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a457bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a457bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48930/0 (socket says 172.21.15.132:48930) 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a45fbc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40103940 0x7f3a4019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.421+0000 7f3a457bb640 1 -- 172.21.15.132:0/2164237671 learned_addr learned my addr 172.21.15.132:0/2164237671 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a467bd640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40109bd0 0x7f3a4019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 -- 172.21.15.132:0/2164237671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40103940 msgr2=0x7f3a4019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40103940 0x7f3a4019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 -- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40109bd0 msgr2=0x7f3a4019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40109bd0 0x7f3a4019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 -- 172.21.15.132:0/2164237671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a401a0170 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a457bb640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e9c0 tx=0x7f3a3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400ccc0 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a340054d0 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a401a0460 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34010430 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.422+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a401a6bc0 con 0x7f3a40109280 2024-08-31T04:21:39.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.424+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40103d50 con 0x7f3a40109280 2024-08-31T04:21:39.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.425+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f3a34005000 con 0x7f3a40109280 2024-08-31T04:21:39.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.426+0000 7f3a3effd640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 0x7f3a280b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.426+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7f3a340e4fe0 con 0x7f3a40109280 2024-08-31T04:21:39.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.426+0000 7f3a45fbc640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 0x7f3a280b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.426+0000 7f3a45fbc640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 0x7f3a280b7090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a300099a0 tx=0x7f3a30009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.429+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3a34056130 con 0x7f3a40109280 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:21:39.643+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3a400635a0 con 0x7f3a280b4b80 2024-08-31T04:21:39.892 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:21:39.593+0000 7f1748bfd640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T04:21:39.892 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:21:39.606+0000 7f17409f3640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:21:40.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi064 2024-08-31T04:21:40.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi064 to 4272M 2024-08-31T04:21:40.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='osd.10 ' entity='osd.10' 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:40.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi064 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi064 to 4272M 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='osd.10 ' entity='osd.10' 2024-08-31T04:21:40.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:40.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:40.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi064 2024-08-31T04:21:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi064 to 4272M 2024-08-31T04:21:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-08-31T04:21:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='osd.10 ' entity='osd.10' 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:21:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:41.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:21:41.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:21:41.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:41.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:41.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:41.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] boot 2024-08-31T04:21:41.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:21:41.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:40 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:21:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:21:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] boot 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:40 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:41.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:41.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: osd.10 [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] boot 2024-08-31T04:21:41.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:21:41.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:40 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:21:42.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:41 smithi132 ceph-mon[22335]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:21:42.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:41 smithi132 ceph-mon[22335]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:42.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:41 smithi064 ceph-mon[22007]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:21:42.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:41 smithi064 ceph-mon[22007]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:41 smithi002 ceph-mon[18656]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:21:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:41 smithi002 ceph-mon[18656]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:43.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T04:21:43.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/3995687813' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"}]': finished 2024-08-31T04:21:43.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:21:43.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:21:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T04:21:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/3995687813' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"}]': finished 2024-08-31T04:21:43.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:21:43.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:21:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T04:21:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/3995687813' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"} : dispatch 2024-08-31T04:21:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4c97091-28c9-441a-a030-afe7b066620e"}]': finished 2024-08-31T04:21:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:21:43.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:21:44.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:43 smithi132 ceph-mon[22335]: from='client.? 172.21.15.132:0/1004543428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:44.219 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:43 smithi132 ceph-mon[22335]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:44.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:43 smithi064 ceph-mon[22007]: from='client.? 172.21.15.132:0/1004543428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:44.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:43 smithi064 ceph-mon[22007]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:44.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:43 smithi002 ceph-mon[18656]: from='client.? 172.21.15.132:0/1004543428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:21:44.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:43 smithi002 ceph-mon[18656]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:46.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:46 smithi002 ceph-mon[18656]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:46.401 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:46 smithi064 ceph-mon[22007]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:46 smithi132 ceph-mon[22335]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:21:48.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:48 smithi132 ceph-mon[22335]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T04:21:48.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:48 smithi002 ceph-mon[18656]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T04:21:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:48 smithi064 ceph-mon[22007]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T04:21:50.366 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:50 smithi132 ceph-mon[22335]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:50.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:50 smithi002 ceph-mon[18656]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:50 smithi064 ceph-mon[22007]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:21:52.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:52 smithi132 ceph-mon[22335]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:21:52.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:21:52.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:52.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:52 smithi132 ceph-mon[22335]: Deploying daemon osd.11 on smithi132 2024-08-31T04:21:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:52 smithi002 ceph-mon[18656]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:21:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:21:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:52 smithi002 ceph-mon[18656]: Deploying daemon osd.11 on smithi132 2024-08-31T04:21:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:52 smithi064 ceph-mon[22007]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:21:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:21:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:21:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:52 smithi064 ceph-mon[22007]: Deploying daemon osd.11 on smithi132 2024-08-31T04:21:54.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:54 smithi002 ceph-mon[18656]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:21:54.485 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:54 smithi132 ceph-mon[22335]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:21:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:54 smithi064 ceph-mon[22007]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:21:56.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:56 smithi002 ceph-mon[18656]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:56.432 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:56 smithi132 ceph-mon[22335]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:56 smithi064 ceph-mon[22007]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:57.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:57.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:57.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:57.506 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:57.507 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:57.507 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:21:58.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:21:58 smithi002 ceph-mon[18656]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:58.490 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:21:58 smithi132 ceph-mon[22335]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:21:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:21:58 smithi064 ceph-mon[22007]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:22:00.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:00.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:00.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.899+0000 7f3a3effd640 1 -- 172.21.15.132:0/2164237671 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3a400635a0 con 0x7f3a280b4b80 2024-08-31T04:22:00.900 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 11 on host 'smithi132' 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 msgr2=0x7f3a280b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 0x7f3a280b7090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a300099a0 tx=0x7f3a30009500 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 msgr2=0x7f3a4019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e9c0 tx=0x7f3a3400ee80 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 shutdown_connections 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3a280b4b80 0x7f3a280b7090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a40109bd0 0x7f3a4019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.901+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a40109280 0x7f3a4019a7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.902+0000 7f3a48220640 1 --2- 172.21.15.132:0/2164237671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a40103940 0x7f3a4019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.902+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 >> 172.21.15.132:0/2164237671 conn(0x7f3a400ff3d0 msgr2=0x7f3a40108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:00.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.902+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 shutdown_connections 2024-08-31T04:22:00.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:00.902+0000 7f3a48220640 1 -- 172.21.15.132:0/2164237671 wait complete. 2024-08-31T04:22:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:01.701 DEBUG:teuthology.orchestra.run.smithi132:osd.11> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T04:22:01.703 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T04:22:01.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:22:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:02.220 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:02 smithi132 ceph-mon[22335]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:02.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:02 smithi002 ceph-mon[18656]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 -- 172.21.15.2:0/3544211549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc103900 msgr2=0x7faabc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 --2- 172.21.15.2:0/3544211549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc103900 0x7faabc103d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faab8009900 tx=0x7faab802a410 comp rx=0 tx=0).stop 2024-08-31T04:22:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 -- 172.21.15.2:0/3544211549 shutdown_connections 2024-08-31T04:22:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 --2- 172.21.15.2:0/3544211549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc109b90 0x7faabc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 --2- 172.21.15.2:0/3544211549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109240 0x7faabc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 --2- 172.21.15.2:0/3544211549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc103900 0x7faabc103d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 -- 172.21.15.2:0/3544211549 >> 172.21.15.2:0/3544211549 conn(0x7faabc07b5f0 msgr2=0x7faabc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 -- 172.21.15.2:0/3544211549 shutdown_connections 2024-08-31T04:22:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.435+0000 7faac470e640 1 -- 172.21.15.2:0/3544211549 wait complete. 2024-08-31T04:22:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.436+0000 7faac470e640 1 Processor -- start 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.436+0000 7faac470e640 1 -- start start 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc103900 0x7faabc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109b90 0x7faabc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faabc113850 con 0x7faabc109240 2024-08-31T04:22:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1136d0 con 0x7faabc103900 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac470e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1139d0 con 0x7faabc109b90 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59108/0 (socket says 172.21.15.2:59108) 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 -- 172.21.15.2:0/2978734858 learned_addr learned my addr 172.21.15.2:0/2978734858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac24aa640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc103900 0x7faabc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac2cab640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109b90 0x7faabc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 -- 172.21.15.2:0/2978734858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109b90 msgr2=0x7faabc19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109b90 0x7faabc19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 -- 172.21.15.2:0/2978734858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc103900 msgr2=0x7faabc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc103900 0x7faabc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 -- 172.21.15.2:0/2978734858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc1a01b0 con 0x7faabc109240 2024-08-31T04:22:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faac1ca9640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d950 tx=0x7faaac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.437+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac017070 con 0x7faabc109240 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.438+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc1a04a0 con 0x7faabc109240 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.438+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaac009c30 con 0x7faabc109240 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.438+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac0047a0 con 0x7faabc109240 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.438+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1a6c00 con 0x7faabc109240 2024-08-31T04:22:02.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.439+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc103d10 con 0x7faabc109240 2024-08-31T04:22:02.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.441+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7faaac004020 con 0x7faabc109240 2024-08-31T04:22:02.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.442+0000 7faab37fe640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 0x7faaa80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.442+0000 7faac24aa640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 0x7faaa80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.442+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7faaac0e4ee0 con 0x7faabc109240 2024-08-31T04:22:02.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.443+0000 7faac24aa640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 0x7faaa80b7090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faab8031440 tx=0x7faab8005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:02.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.445+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faaac020020 con 0x7faabc109240 2024-08-31T04:22:02.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:02 smithi064 ceph-mon[22007]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:02.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.636+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faabc19b370 con 0x7faabc109240 2024-08-31T04:22:02.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.636+0000 7faab37fe640 1 -- 172.21.15.2:0/2978734858 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7faabc19b370 con 0x7faabc109240 2024-08-31T04:22:02.638 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 msgr2=0x7faaa80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 0x7faaa80b7090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faab8031440 tx=0x7faab8005d50 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 msgr2=0x7faabc19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d950 tx=0x7faaac00de10 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 shutdown_connections 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faaa80b4b80 0x7faaa80b7090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faabc109240 0x7faabc19a7e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faabc109b90 0x7faabc19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 --2- 172.21.15.2:0/2978734858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc103900 0x7faabc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 >> 172.21.15.2:0/2978734858 conn(0x7faabc07b5f0 msgr2=0x7faabc1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 shutdown_connections 2024-08-31T04:22:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:02.639+0000 7faac470e640 1 -- 172.21.15.2:0/2978734858 wait complete. 2024-08-31T04:22:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:03 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2978734858' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:03.317 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:22:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:22:03.149+0000 7f62b07cf640 -1 osd.11 0 log_to_monitors true 2024-08-31T04:22:03.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2978734858' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:03.542 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1725078099,"num_in_osds":12,"osd_in_since":1725078102,"num_remapped_pgs":0} 2024-08-31T04:22:03.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:03 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2978734858' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:04.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:04 smithi132 ceph-mon[22335]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:04.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:04 smithi132 ceph-mon[22335]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:04 smithi132 ceph-mon[22335]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:04 smithi002 ceph-mon[18656]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:04.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:04 smithi002 ceph-mon[18656]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:04 smithi002 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:22:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:04 smithi064 ceph-mon[22007]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:04 smithi064 ceph-mon[22007]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:04 smithi064 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:22:04.808 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:05.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: Detected new or changed devices on smithi132 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi132 to 4272M 2024-08-31T04:22:05.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:05.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:05.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:05 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 -- 172.21.15.2:0/2374641897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44102840 msgr2=0x7f6d44102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/2374641897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44102840 0x7f6d44102c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009ca0 tx=0x7f6d3402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 -- 172.21.15.2:0/2374641897 shutdown_connections 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/2374641897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108ad0 0x7f6d4410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/2374641897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44108180 0x7f6d44108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/2374641897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44102840 0x7f6d44102c50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 -- 172.21.15.2:0/2374641897 >> 172.21.15.2:0/2374641897 conn(0x7f6d44079580 msgr2=0x7f6d44079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 -- 172.21.15.2:0/2374641897 shutdown_connections 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.336+0000 7f6d4b12c640 1 -- 172.21.15.2:0/2374641897 wait complete. 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 Processor -- start 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 -- start start 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44102840 0x7f6d44199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 0x7f6d441996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d44112730 con 0x7f6d44108ad0 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6d441125b0 con 0x7f6d44108180 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d4b12c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6d441128b0 con 0x7f6d44102840 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57354/0 (socket says 172.21.15.2:57354) 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 -- 172.21.15.2:0/219119357 learned_addr learned my addr 172.21.15.2:0/219119357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d48ec8640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44102840 0x7f6d44199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d43fff640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 0x7f6d441996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 -- 172.21.15.2:0/219119357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44102840 msgr2=0x7f6d44199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44102840 0x7f6d44199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 -- 172.21.15.2:0/219119357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 msgr2=0x7f6d441996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 0x7f6d441996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d496c9640 1 -- 172.21.15.2:0/219119357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4419f090 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.337+0000 7f6d43fff640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 0x7f6d441996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d496c9640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d750 tx=0x7f6d3c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c017070 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d3c0054d0 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c004c60 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4419f380 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.338+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d441a5ae0 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.339+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d44102c50 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.340+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f6d3c009bd0 con 0x7f6d44108ad0 2024-08-31T04:22:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.341+0000 7f6d41ffb640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 0x7f6d2c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.341+0000 7f6d48ec8640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 0x7f6d2c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.341+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7062+0+0 (secure 0 0 0) 0x7f6d3c0e45e0 con 0x7f6d44108ad0 2024-08-31T04:22:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.342+0000 7f6d48ec8640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 0x7f6d2c0b7110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005e30 tx=0x7f6d34009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.346+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6d3c0abbf0 con 0x7f6d44108ad0 2024-08-31T04:22:05.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.531+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6d4402e430 con 0x7f6d44108ad0 2024-08-31T04:22:05.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.532+0000 7f6d41ffb640 1 -- 172.21.15.2:0/219119357 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f6d3c0ab4f0 con 0x7f6d44108ad0 2024-08-31T04:22:05.534 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 msgr2=0x7f6d2c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 0x7f6d2c0b7110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005e30 tx=0x7f6d34009360 comp rx=0 tx=0).stop 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 msgr2=0x7f6d4419e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d750 tx=0x7f6d3c00dc10 comp rx=0 tx=0).stop 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 shutdown_connections 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d2c0b4c00 0x7f6d2c0b7110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44108ad0 0x7f6d4419e960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d44108180 0x7f6d441996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 --2- 172.21.15.2:0/219119357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d44102840 0x7f6d44199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.534+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 >> 172.21.15.2:0/219119357 conn(0x7f6d44079580 msgr2=0x7f6d441011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:05.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.535+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 shutdown_connections 2024-08-31T04:22:05.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:05.535+0000 7f6d4b12c640 1 -- 172.21.15.2:0/219119357 wait complete. 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: Detected new or changed devices on smithi132 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi132 to 4272M 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:05.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:05 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: Detected new or changed devices on smithi132 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:22:05.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi132 to 4272M 2024-08-31T04:22:05.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:05.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:05.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:05.570 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:06.148 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:22:05.876+0000 7f62ac751640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T04:22:06.148 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:22:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:22:05.888+0000 7f62a4547640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.227 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/219119357' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:06.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:06 smithi002 ceph-mon[18656]: from='osd.11 ' entity='osd.11' 2024-08-31T04:22:06.254 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1725078099,"num_in_osds":12,"osd_in_since":1725078102,"num_remapped_pgs":0} 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/219119357' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:06 smithi064 ceph-mon[22007]: from='osd.11 ' entity='osd.11' 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/219119357' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:06.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:06 smithi132 ceph-mon[22335]: from='osd.11 ' entity='osd.11' 2024-08-31T04:22:07.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:22:07.518 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: purged_snaps scrub starts 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: purged_snaps scrub ok 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] boot 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:07 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: purged_snaps scrub starts 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: purged_snaps scrub ok 2024-08-31T04:22:07.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:07.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] boot 2024-08-31T04:22:07.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:22:07.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:07 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: purged_snaps scrub starts 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: purged_snaps scrub ok 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: osd.11 [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] boot 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:22:07.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:07 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 -- 172.21.15.2:0/1940765378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf341081c0 msgr2=0x7faf341085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/1940765378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf341081c0 0x7faf341085d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf20009900 tx=0x7faf2002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 -- 172.21.15.2:0/1940765378 shutdown_connections 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/1940765378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf341081c0 0x7faf341085d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/1940765378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf34108b10 0x7faf3410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/1940765378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 0x7faf34102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 -- 172.21.15.2:0/1940765378 >> 172.21.15.2:0/1940765378 conn(0x7faf34079510 msgr2=0x7faf34079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 -- 172.21.15.2:0/1940765378 shutdown_connections 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.002+0000 7faf3b1b3640 1 -- 172.21.15.2:0/1940765378 wait complete. 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 Processor -- start 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 -- start start 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 0x7faf3410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 0x7faf34110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf341138f0 con 0x7faf34108b10 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faf34113770 con 0x7faf341081c0 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf3b1b3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faf34113a70 con 0x7faf34102880 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf39750640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf39750640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57384/0 (socket says 172.21.15.2:57384) 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf39750640 1 -- 172.21.15.2:0/509908844 learned_addr learned my addr 172.21.15.2:0/509908844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf38f4f640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 0x7faf3410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.003+0000 7faf33fff640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 0x7faf34110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 -- 172.21.15.2:0/509908844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 msgr2=0x7faf3410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 0x7faf3410fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 -- 172.21.15.2:0/509908844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 msgr2=0x7faf34110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 0x7faf34110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 -- 172.21.15.2:0/509908844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf341a8680 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf33fff640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 0x7faf34110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf39750640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cad0 tx=0x7faf2c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00ad60 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf2c005020 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf341a8970 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00f6b0 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.004+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341a8e80 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.005+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf34103b00 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.007+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7faf2c0051d0 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.008+0000 7faf31ffb640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 0x7faf240b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.008+0000 7faf38f4f640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 0x7faf240b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.008+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7faf2c0e4d80 con 0x7faf34108b10 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.008+0000 7faf38f4f640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 0x7faf240b7110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf34111870 tx=0x7faf28009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.012+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faf2c014030 con 0x7faf34108b10 2024-08-31T04:22:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.200+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faf3410a350 con 0x7faf34108b10 2024-08-31T04:22:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.201+0000 7faf31ffb640 1 -- 172.21.15.2:0/509908844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7faf2c0ac280 con 0x7faf34108b10 2024-08-31T04:22:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 msgr2=0x7faf240b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 0x7faf240b7110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf34111870 tx=0x7faf28009110 comp rx=0 tx=0).stop 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 msgr2=0x7faf341108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cad0 tx=0x7faf2c00ced0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 shutdown_connections 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7faf240b4c00 0x7faf240b7110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf34108b10 0x7faf341108a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf341081c0 0x7faf34110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 --2- 172.21.15.2:0/509908844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf34102880 0x7faf3410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:08.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 >> 172.21.15.2:0/509908844 conn(0x7faf34079510 msgr2=0x7faf341062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:08.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 shutdown_connections 2024-08-31T04:22:08.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:08.203+0000 7faf3b1b3640 1 -- 172.21.15.2:0/509908844 wait complete. 2024-08-31T04:22:09.015 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1725078126,"num_in_osds":12,"osd_in_since":1725078102,"num_remapped_pgs":0} 2024-08-31T04:22:09.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:22:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:08 smithi002 ceph-mon[18656]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:08 smithi002 ceph-mon[18656]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:22:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:08 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/509908844' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:08 smithi064 ceph-mon[22007]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:08 smithi064 ceph-mon[22007]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:22:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:08 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/509908844' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:08 smithi132 ceph-mon[22335]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:22:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:08 smithi132 ceph-mon[22335]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:22:09.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:08 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/509908844' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:22:09.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 -- 172.21.15.2:0/3541490106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 msgr2=0x7f02e0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 --2- 172.21.15.2:0/3541490106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0102c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009900 tx=0x7f02d402a410 comp rx=0 tx=0).stop 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 -- 172.21.15.2:0/3541490106 shutdown_connections 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 --2- 172.21.15.2:0/3541490106 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 --2- 172.21.15.2:0/3541490106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 --2- 172.21.15.2:0/3541490106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0102c10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 -- 172.21.15.2:0/3541490106 >> 172.21.15.2:0/3541490106 conn(0x7f02e00794d0 msgr2=0x7f02e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 -- 172.21.15.2:0/3541490106 shutdown_connections 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.766+0000 7f02e7075640 1 -- 172.21.15.2:0/3541490106 wait complete. 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 Processor -- start 2024-08-31T04:22:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 -- start start 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e0104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01126f0 con 0x7f02e0102800 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0112570 con 0x7f02e0108a90 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e7075640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0112870 con 0x7f02e0108140 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e4e11640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e4e11640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57404/0 (socket says 172.21.15.2:57404) 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.767+0000 7f02e4e11640 1 -- 172.21.15.2:0/559575278 learned_addr learned my addr 172.21.15.2:0/559575278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02dffff640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e5612640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e0104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 -- 172.21.15.2:0/559575278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 msgr2=0x7f02e0104530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0104530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 -- 172.21.15.2:0/559575278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 msgr2=0x7f02e0104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e0104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 -- 172.21.15.2:0/559575278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e01a84d0 con 0x7f02e0102800 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e5612640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e0104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02dffff640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e4e11640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f02d4005940 tx=0x7f02d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d403f030 con 0x7f02e0102800 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02d4003cb0 con 0x7f02e0102800 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e01a8760 con 0x7f02e0102800 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4035070 con 0x7f02e0102800 2024-08-31T04:22:09.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.768+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e01a8c40 con 0x7f02e0102800 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.769+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e0102c10 con 0x7f02e0102800 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.771+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f02d4042030 con 0x7f02e0102800 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.772+0000 7f02ddffb640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 0x7f02d00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.772+0000 7f02dffff640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 0x7f02d00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.772+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f02d41059e0 con 0x7f02e0102800 2024-08-31T04:22:09.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.773+0000 7f02dffff640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 0x7f02d00b7090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0058c0 tx=0x7f02cc005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:09.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.775+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02d40ccec0 con 0x7f02e0102800 2024-08-31T04:22:09.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.960+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02e01a9000 con 0x7f02e0102800 2024-08-31T04:22:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.961+0000 7f02ddffb640 1 -- 172.21.15.2:0/559575278 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18693 (secure 0 0 0) 0x7f02d40cc7c0 con 0x7f02e0102800 2024-08-31T04:22:09.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:09.963 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:22:07.882643+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 msgr2=0x7f02d00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 0x7f02d00b7090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0058c0 tx=0x7f02cc005850 comp rx=0 tx=0).stop 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 msgr2=0x7f02e0103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f02d4005940 tx=0x7f02d40042f0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 shutdown_connections 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e0108a90 0x7f02e0104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e0108140 0x7f02e0104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f02d00b4b80 0x7f02d00b7090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 --2- 172.21.15.2:0/559575278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e0102800 0x7f02e0103ff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.964+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 >> 172.21.15.2:0/559575278 conn(0x7f02e00794d0 msgr2=0x7f02e0101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.965+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 shutdown_connections 2024-08-31T04:22:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:09.965+0000 7f02e7075640 1 -- 172.21.15.2:0/559575278 wait complete. 2024-08-31T04:22:10.687 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T04:18:21.427633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T04:22:10.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T04:22:10.943 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:11.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:10 smithi002 ceph-mon[18656]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:11.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:10 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/559575278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:10 smithi064 ceph-mon[22007]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:10 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/559575278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:11.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:10 smithi132 ceph-mon[22335]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:11.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:10 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/559575278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 -- 172.21.15.2:0/3071730056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109240 msgr2=0x7f4700109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 --2- 172.21.15.2:0/3071730056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109240 0x7f4700109650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 -- 172.21.15.2:0/3071730056 shutdown_connections 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 --2- 172.21.15.2:0/3071730056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109240 0x7f4700109650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 --2- 172.21.15.2:0/3071730056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700109b90 0x7f47001103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 --2- 172.21.15.2:0/3071730056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700103900 0x7f4700103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 -- 172.21.15.2:0/3071730056 >> 172.21.15.2:0/3071730056 conn(0x7f470007b5f0 msgr2=0x7f470007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 -- 172.21.15.2:0/3071730056 shutdown_connections 2024-08-31T04:22:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.443+0000 7f470856b640 1 -- 172.21.15.2:0/3071730056 wait complete. 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 Processor -- start 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 -- start start 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700103900 0x7f470019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700109240 0x7f470019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4700113850 con 0x7f4700109b90 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47001136d0 con 0x7f4700109240 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f470856b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f47001139d0 con 0x7f4700103900 2024-08-31T04:22:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57410/0 (socket says 172.21.15.2:57410) 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 -- 172.21.15.2:0/3896489754 learned_addr learned my addr 172.21.15.2:0/3896489754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706307640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700103900 0x7f470019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4705b06640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700109240 0x7f470019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 -- 172.21.15.2:0/3896489754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700103900 msgr2=0x7f470019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700103900 0x7f470019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 -- 172.21.15.2:0/3896489754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700109240 msgr2=0x7f470019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700109240 0x7f470019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.444+0000 7f4706b08640 1 -- 172.21.15.2:0/3896489754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001a0110 con 0x7f4700109b90 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f4706b08640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46f800cce0 tx=0x7f46f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f800f450 con 0x7f4700109b90 2024-08-31T04:22:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001a0400 con 0x7f4700109b90 2024-08-31T04:22:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f800faa0 con 0x7f4700109b90 2024-08-31T04:22:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8018b70 con 0x7f4700109b90 2024-08-31T04:22:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.445+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47001a6c20 con 0x7f4700109b90 2024-08-31T04:22:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.446+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4700103d10 con 0x7f4700109b90 2024-08-31T04:22:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.447+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f46f800f5f0 con 0x7f4700109b90 2024-08-31T04:22:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.448+0000 7f46f77fe640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 0x7f46ec0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.448+0000 7f4706307640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 0x7f46ec0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.448+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f46f80e50e0 con 0x7f4700109b90 2024-08-31T04:22:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.449+0000 7f4706307640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 0x7f46ec0b70c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005d00 tx=0x7f46fc00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.453+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f46f8014030 con 0x7f4700109b90 2024-08-31T04:22:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.638+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f470010b9e0 con 0x7f4700109b90 2024-08-31T04:22:11.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.638+0000 7f46f77fe640 1 -- 172.21.15.2:0/3896489754 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f46f80ac540 con 0x7f4700109b90 2024-08-31T04:22:11.640 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-31T04:22:11.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 msgr2=0x7f46ec0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 0x7f46ec0b70c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005d00 tx=0x7f46fc00b410 comp rx=0 tx=0).stop 2024-08-31T04:22:11.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 msgr2=0x7f470019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46f800cce0 tx=0x7f46f800a620 comp rx=0 tx=0).stop 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 shutdown_connections 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46ec0b4bb0 0x7f46ec0b70c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4700109b90 0x7f470019faa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4700109240 0x7f470019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 --2- 172.21.15.2:0/3896489754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4700103900 0x7f470019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 >> 172.21.15.2:0/3896489754 conn(0x7f470007b5f0 msgr2=0x7f4700107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 shutdown_connections 2024-08-31T04:22:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:11.641+0000 7f470856b640 1 -- 172.21.15.2:0/3896489754 wait complete. 2024-08-31T04:22:12.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3896489754' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.b on smithi064 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.e on smithi064 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.h on smithi064 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.k on smithi064 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.c on smithi132 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.f on smithi132 2024-08-31T04:22:12.301 INFO:tasks.cephadm:Adding mds.i on smithi132 2024-08-31T04:22:12.302 INFO:tasks.cephadm:Adding mds.l on smithi132 2024-08-31T04:22:12.302 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l' 2024-08-31T04:22:12.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3896489754' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:22:12.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3896489754' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:22:12.560 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:22:12.977 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:12 smithi132 ceph-mon[22335]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 -- 172.21.15.132:0/1434561127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8109bb0 msgr2=0x7f9ce81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1434561127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8109bb0 0x7f9ce81103e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009ca0 tx=0x7f9ce002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 -- 172.21.15.132:0/1434561127 shutdown_connections 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1434561127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109260 0x7f9ce8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1434561127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8109bb0 0x7f9ce81103e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1434561127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8103920 0x7f9ce8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 -- 172.21.15.132:0/1434561127 >> 172.21.15.132:0/1434561127 conn(0x7f9ce80ff3b0 msgr2=0x7f9ce8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 -- 172.21.15.132:0/1434561127 shutdown_connections 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 -- 172.21.15.132:0/1434561127 wait complete. 2024-08-31T04:22:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.073+0000 7f9ced75a640 1 Processor -- start 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 -- start start 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8109260 0x7f9ce819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109bb0 0x7f9ce819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce8113870 con 0x7f9ce8109bb0 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce81136f0 con 0x7f9ce8109260 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ced75a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce81139f0 con 0x7f9ce8103920 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51664/0 (socket says 172.21.15.132:51664) 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 -- 172.21.15.132:0/1298591859 learned_addr learned my addr 172.21.15.132:0/1298591859 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce77fe640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109bb0 0x7f9ce819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce67fc640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8109260 0x7f9ce819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 -- 172.21.15.132:0/1298591859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8109260 msgr2=0x7f9ce819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8109260 0x7f9ce819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 -- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109bb0 msgr2=0x7f9ce819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.074+0000 7f9ce6ffd640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109bb0 0x7f9ce819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ce6ffd640 1 -- 172.21.15.132:0/1298591859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce81a01b0 con 0x7f9ce8103920 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ce6ffd640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d770 tx=0x7f9cdc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc017070 con 0x7f9ce8103920 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce81a04a0 con 0x7f9ce8103920 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cdc0054d0 con 0x7f9ce8103920 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc004c30 con 0x7f9ce8103920 2024-08-31T04:22:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.075+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce81a6c00 con 0x7f9ce8103920 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.076+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce8103d30 con 0x7f9ce8103920 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.078+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f9cdc004dd0 con 0x7f9ce8103920 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.078+0000 7f9ccffff640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 0x7f9cd00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.079+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f9cdc0e4bc0 con 0x7f9ce8103920 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.079+0000 7f9ce67fc640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 0x7f9cd00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.079+0000 7f9ce67fc640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 0x7f9cd00b7090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102c00 tx=0x7f9cd800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.086+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9cdc0aba70 con 0x7f9ce8103920 2024-08-31T04:22:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.278+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}) -- 0x7f9ce80635a0 con 0x7f9cd00b4b80 2024-08-31T04:22:13.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.286+0000 7f9ccffff640 1 -- 172.21.15.132:0/1298591859 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9ce80635a0 con 0x7f9cd00b4b80 2024-08-31T04:22:13.289 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mds.all update... 2024-08-31T04:22:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 msgr2=0x7f9cd00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 0x7f9cd00b7090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102c00 tx=0x7f9cd800b390 comp rx=0 tx=0).stop 2024-08-31T04:22:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 msgr2=0x7f9ce819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d770 tx=0x7f9cdc00dc30 comp rx=0 tx=0).stop 2024-08-31T04:22:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 shutdown_connections 2024-08-31T04:22:13.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9cd00b4b80 0x7f9cd00b7090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ce8109bb0 0x7f9ce819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ce8109260 0x7f9ce819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 --2- 172.21.15.132:0/1298591859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce8103920 0x7f9ce819a240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 >> 172.21.15.132:0/1298591859 conn(0x7f9ce80ff3b0 msgr2=0x7f9ce81088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:13.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 shutdown_connections 2024-08-31T04:22:13.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-08-31T04:22:13.289+0000 7f9ced75a640 1 -- 172.21.15.132:0/1298591859 wait complete. 2024-08-31T04:22:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:12 smithi064 ceph-mon[22007]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:13.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:12 smithi002 ceph-mon[18656]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:14.111 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T04:22:14.114 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T04:22:14.157 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T04:22:14.200 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T04:22:14.243 DEBUG:teuthology.orchestra.run.smithi064:mds.b> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T04:22:14.246 DEBUG:teuthology.orchestra.run.smithi064:mds.e> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T04:22:14.290 DEBUG:teuthology.orchestra.run.smithi064:mds.h> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T04:22:14.332 DEBUG:teuthology.orchestra.run.smithi064:mds.k> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T04:22:14.376 DEBUG:teuthology.orchestra.run.smithi132:mds.c> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T04:22:14.379 DEBUG:teuthology.orchestra.run.smithi132:mds.f> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T04:22:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-08-31T04:22:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:14 smithi002 ceph-mon[18656]: Deploying daemon mds.l on smithi132 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:14.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:14.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:14 smithi132 ceph-mon[22335]: Deploying daemon mds.l on smithi132 2024-08-31T04:22:14.401 DEBUG:teuthology.orchestra.run.smithi132:mds.i> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T04:22:14.445 DEBUG:teuthology.orchestra.run.smithi132:mds.l> sudo journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T04:22:14.488 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T04:22:14.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-08-31T04:22:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:14 smithi064 ceph-mon[22007]: Deploying daemon mds.l on smithi132 2024-08-31T04:22:14.738 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:15.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 -- 172.21.15.2:0/2812335074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8103920 msgr2=0x7f62b8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/2812335074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8103920 0x7f62b8103d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009900 tx=0x7f62b402a410 comp rx=0 tx=0).stop 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 -- 172.21.15.2:0/2812335074 shutdown_connections 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/2812335074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8109bb0 0x7f62b81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/2812335074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/2812335074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8103920 0x7f62b8103d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.206+0000 7f62bf8bd640 1 -- 172.21.15.2:0/2812335074 >> 172.21.15.2:0/2812335074 conn(0x7f62b80ff370 msgr2=0x7f62b81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- 172.21.15.2:0/2812335074 shutdown_connections 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- 172.21.15.2:0/2812335074 wait complete. 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 Processor -- start 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- start start 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8103920 0x7f62b819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8113870 con 0x7f62b8109bb0 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81136f0 con 0x7f62b8109260 2024-08-31T04:22:15.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.207+0000 7f62bf8bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81139f0 con 0x7f62b8103920 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57430/0 (socket says 172.21.15.2:57430) 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 -- 172.21.15.2:0/952079687 learned_addr learned my addr 172.21.15.2:0/952079687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bd659640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8103920 0x7f62b819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bce58640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 -- 172.21.15.2:0/952079687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8103920 msgr2=0x7f62b819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8103920 0x7f62b819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 -- 172.21.15.2:0/952079687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 msgr2=0x7f62b819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 -- 172.21.15.2:0/952079687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b81a01b0 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bce58640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bde5a640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62b000eaa0 tx=0x7f62b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b000cdb0 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62b0005020 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b81a04a0 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00116d0 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.208+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b81a6c00 con 0x7f62b8109bb0 2024-08-31T04:22:15.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.209+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b8103d30 con 0x7f62b8109bb0 2024-08-31T04:22:15.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.211+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f62b00051d0 con 0x7f62b8109bb0 2024-08-31T04:22:15.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.212+0000 7f62ae7fc640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 0x7f62a40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.212+0000 7f62bd659640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 0x7f62a40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.212+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f62b00e53b0 con 0x7f62b8109bb0 2024-08-31T04:22:15.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.212+0000 7f62bd659640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 0x7f62a40b7110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62b4031440 tx=0x7f62b4009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.215+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f62b0016030 con 0x7f62b8109bb0 2024-08-31T04:22:15.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.437+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62b819b370 con 0x7f62b8109bb0 2024-08-31T04:22:15.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.438+0000 7f62ae7fc640 1 -- 172.21.15.2:0/952079687 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f62b819b370 con 0x7f62b8109bb0 2024-08-31T04:22:15.440 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:15.440 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-08-31T04:14:46:409940+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T04:22:15.440 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-08-31T04:22:15.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 msgr2=0x7f62a40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 0x7f62a40b7110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62b4031440 tx=0x7f62b4009560 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 msgr2=0x7f62b819fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62b000eaa0 tx=0x7f62b000ef60 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 shutdown_connections 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f62a40b4c00 0x7f62a40b7110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62b8109bb0 0x7f62b819fa80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b8109260 0x7f62b819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 --2- 172.21.15.2:0/952079687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b8103920 0x7f62b819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 >> 172.21.15.2:0/952079687 conn(0x7f62b80ff370 msgr2=0x7f62b8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 shutdown_connections 2024-08-31T04:22:15.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:15.440+0000 7f62bf8bd640 1 -- 172.21.15.2:0/952079687 wait complete. 2024-08-31T04:22:16.067 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:15 smithi132 systemd[1]: Starting Ceph mds.l for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:16.372 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:16 smithi132 ceph-mon[22335]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:16.373 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:16 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/952079687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:16.373 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 podman[52991]: 2024-08-31 04:22:15.99806194 +0000 UTC m=+0.016070160 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:16.373 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 podman[52991]: 2024-08-31 04:22:16.126872644 +0000 UTC m=+0.144880864 container create f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-31T04:22:16.373 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 podman[52991]: 2024-08-31 04:22:16.372036821 +0000 UTC m=+0.390045042 container init f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:22:16.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:16 smithi064 ceph-mon[22007]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:16.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:16 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/952079687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:16 smithi002 ceph-mon[18656]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:16 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/952079687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:16.817 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 podman[52991]: 2024-08-31 04:22:16.375647362 +0000 UTC m=+0.393655585 container start f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T04:22:16.817 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 ceph-mds[53010]: -- 172.21.15.132:0/4257654267 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dea6c69860 con 0x55deaae0f600 2024-08-31T04:22:16.817 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l[53006]: starting mds.l at 2024-08-31T04:22:16.818 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 bash[52991]: f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 2024-08-31T04:22:16.818 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:22:16 smithi132 systemd[1]: Started Ceph mds.l for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:17.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6832/4201237499,v1:172.21.15.132:6833/4201237499] up:boot 2024-08-31T04:22:17.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: fsmap 1 up:standby 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:17.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:17 smithi064 ceph-mon[22007]: Deploying daemon mds.k on smithi064 2024-08-31T04:22:17.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6832/4201237499,v1:172.21.15.132:6833/4201237499] up:boot 2024-08-31T04:22:17.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: fsmap 1 up:standby 2024-08-31T04:22:17.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:22:17.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:17 smithi132 ceph-mon[22335]: Deploying daemon mds.k on smithi064 2024-08-31T04:22:17.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6832/4201237499,v1:172.21.15.132:6833/4201237499] up:boot 2024-08-31T04:22:17.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: fsmap 1 up:standby 2024-08-31T04:22:17.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:22:17.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:17.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:17 smithi002 ceph-mon[18656]: Deploying daemon mds.k on smithi064 2024-08-31T04:22:18.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:18.600 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:18 smithi064 ceph-mon[22007]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:18.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:18 smithi002 ceph-mon[18656]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:18.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:18 smithi132 ceph-mon[22335]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3404589092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac109b90 msgr2=0x7fb9ac1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3404589092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac109b90 0x7fb9ac1103c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009ca0 tx=0x7fb9a402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3404589092 shutdown_connections 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3404589092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac109b90 0x7fb9ac1103c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3404589092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109240 0x7fb9ac109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3404589092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac103900 0x7fb9ac103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.830+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3404589092 >> 172.21.15.2:0/3404589092 conn(0x7fb9ac07b5f0 msgr2=0x7fb9ac07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.831+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3404589092 shutdown_connections 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.831+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3404589092 wait complete. 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.831+0000 7fb9b3f2b640 1 Processor -- start 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.831+0000 7fb9b3f2b640 1 -- start start 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac109240 0x7fb9ac0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:18.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 0x7fb9ac075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac113850 con 0x7fb9ac103900 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac1136d0 con 0x7fb9ac109240 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b3f2b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac1139d0 con 0x7fb9ac109b90 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54296/0 (socket says 172.21.15.2:54296) 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 -- 172.21.15.2:0/3249396959 learned_addr learned my addr 172.21.15.2:0/3249396959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b24c8640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 0x7fb9ac075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b14c6640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac109240 0x7fb9ac0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 -- 172.21.15.2:0/3249396959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 msgr2=0x7fb9ac075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 0x7fb9ac075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 -- 172.21.15.2:0/3249396959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac109240 msgr2=0x7fb9ac0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac109240 0x7fb9ac0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 -- 172.21.15.2:0/3249396959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac1a83f0 con 0x7fb9ac103900 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b24c8640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 0x7fb9ac075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.832+0000 7fb9b1cc7640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e9f0 tx=0x7fb9a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.833+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800ccc0 con 0x7fb9ac103900 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.833+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac1a86e0 con 0x7fb9ac103900 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.833+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9a80108e0 con 0x7fb9ac103900 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.833+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8018880 con 0x7fb9ac103900 2024-08-31T04:22:18.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.833+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac1a8c70 con 0x7fb9ac103900 2024-08-31T04:22:18.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.834+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac103d10 con 0x7fb9ac103900 2024-08-31T04:22:18.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.836+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fb9a8010430 con 0x7fb9ac103900 2024-08-31T04:22:18.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.837+0000 7fb9a2ffd640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 0x7fb9980b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:18.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.837+0000 7fb9b14c6640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 0x7fb9980b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:18.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.837+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb9a80e57b0 con 0x7fb9ac103900 2024-08-31T04:22:18.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.837+0000 7fb9b14c6640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 0x7fb9980b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac106d60 tx=0x7fb99c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:18.840+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb9a80acc10 con 0x7fb9ac103900 2024-08-31T04:22:19.010 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:18 smithi064 systemd[1]: Starting Ceph mds.k for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.064+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9ac0767b0 con 0x7fb9ac103900 2024-08-31T04:22:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.064+0000 7fb9a2ffd640 1 -- 172.21.15.2:0/3249396959 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fb9a80ac510 con 0x7fb9ac103900 2024-08-31T04:22:19.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:19.066 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-08-31T04:22:16:414547+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T04:22:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 msgr2=0x7fb9980b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 0x7fb9980b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac106d60 tx=0x7fb99c00a2d0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 msgr2=0x7fb9ac0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e9f0 tx=0x7fb9a800edf0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 shutdown_connections 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ac109b90 0x7fb9ac075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac109240 0x7fb9ac0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb9980b4b80 0x7fb9980b7090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 --2- 172.21.15.2:0/3249396959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9ac103900 0x7fb9ac0754b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 >> 172.21.15.2:0/3249396959 conn(0x7fb9ac07b5f0 msgr2=0x7fb9ac105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 shutdown_connections 2024-08-31T04:22:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:19.066+0000 7fb9b3f2b640 1 -- 172.21.15.2:0/3249396959 wait complete. 2024-08-31T04:22:19.301 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 podman[52469]: 2024-08-31 04:22:18.911592002 +0000 UTC m=+0.016287748 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:19.301 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 podman[52469]: 2024-08-31 04:22:19.018751936 +0000 UTC m=+0.123447670 container create add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-31T04:22:19.302 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 podman[52469]: 2024-08-31 04:22:19.300757598 +0000 UTC m=+0.405453332 container init add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, io.buildah.version=1.37.1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T04:22:19.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3249396959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:19.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 podman[52469]: 2024-08-31 04:22:19.303867844 +0000 UTC m=+0.408563585 container start add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-mds[52488]: -- 172.21.15.64:0/1898977454 <== mon.2 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c45ec3860 con 0x556c4a069180 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: starting mds.k at 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 bash[52469]: add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea 2024-08-31T04:22:19.568 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:22:19 smithi064 systemd[1]: Started Ceph mds.k for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3249396959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:19.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:19.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:19 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3249396959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:19.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:19 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:20 smithi064 ceph-mon[22007]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:20 smithi064 ceph-mon[22007]: Deploying daemon mds.j on smithi002 2024-08-31T04:22:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:20 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6832/3514773724,v1:172.21.15.64:6833/3514773724] up:boot 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:20 smithi064 ceph-mon[22007]: fsmap 2 up:standby 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:20 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:20 smithi132 ceph-mon[22335]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:20 smithi132 ceph-mon[22335]: Deploying daemon mds.j on smithi002 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:20 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6832/3514773724,v1:172.21.15.64:6833/3514773724] up:boot 2024-08-31T04:22:20.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:20 smithi132 ceph-mon[22335]: fsmap 2 up:standby 2024-08-31T04:22:20.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:20 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:22:20.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:20 smithi002 ceph-mon[18656]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:20.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:20 smithi002 ceph-mon[18656]: Deploying daemon mds.j on smithi002 2024-08-31T04:22:20.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:20 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6832/3514773724,v1:172.21.15.64:6833/3514773724] up:boot 2024-08-31T04:22:20.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:20 smithi002 ceph-mon[18656]: fsmap 2 up:standby 2024-08-31T04:22:20.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:20 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:22:21.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:21 smithi002 systemd[1]: Starting Ceph mds.j for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:21.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:22.046 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:21 smithi002 podman[63020]: 2024-08-31 04:22:21.672454654 +0000 UTC m=+0.016321825 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:22.046 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:21 smithi002 podman[63020]: 2024-08-31 04:22:21.792740358 +0000 UTC m=+0.136607577 container create 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T04:22:22.046 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 podman[63020]: 2024-08-31 04:22:22.045428988 +0000 UTC m=+0.389296159 container init 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:22:22.206 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:22.329 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 podman[63020]: 2024-08-31 04:22:22.048775918 +0000 UTC m=+0.392643097 container start 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:22:22.329 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mds[63069]: -- 172.21.15.2:0/2799619816 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56173edc3860 con 0x561742f69a80 2024-08-31T04:22:22.329 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j[63053]: starting mds.j at 2024-08-31T04:22:22.329 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 bash[63020]: 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 2024-08-31T04:22:22.329 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:22:22 smithi002 systemd[1]: Started Ceph mds.j for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:22.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:22.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.626 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:22.626 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:22.626 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:22 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:22.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 -- 172.21.15.2:0/3020717817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f828410dba0 msgr2=0x7f82841100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 --2- 172.21.15.2:0/3020717817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f828410dba0 0x7f82841100b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f827c009ca0 tx=0x7f827c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 -- 172.21.15.2:0/3020717817 shutdown_connections 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 --2- 172.21.15.2:0/3020717817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f828410dba0 0x7f82841100b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 --2- 172.21.15.2:0/3020717817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8284105020 0x7f828410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 --2- 172.21.15.2:0/3020717817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82841045f0 0x7f8284104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 -- 172.21.15.2:0/3020717817 >> 172.21.15.2:0/3020717817 conn(0x7f82840794b0 msgr2=0x7f82840798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 -- 172.21.15.2:0/3020717817 shutdown_connections 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.716+0000 7f828ab27640 1 -- 172.21.15.2:0/3020717817 wait complete. 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 Processor -- start 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 -- start start 2024-08-31T04:22:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82841045f0 0x7f828419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828410dba0 0x7f828419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8284113850 con 0x7f8284105020 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82841136d0 con 0x7f828410dba0 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f828ab27640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82841139d0 con 0x7f82841045f0 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54328/0 (socket says 172.21.15.2:54328) 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f82888c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82841045f0 0x7f828419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 -- 172.21.15.2:0/1757735120 learned_addr learned my addr 172.21.15.2:0/1757735120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f82890c4640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828410dba0 0x7f828419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 -- 172.21.15.2:0/1757735120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82841045f0 msgr2=0x7f828419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82841045f0 0x7f828419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 -- 172.21.15.2:0/1757735120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828410dba0 msgr2=0x7f828419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828410dba0 0x7f828419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.717+0000 7f8283fff640 1 -- 172.21.15.2:0/1757735120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841a0110 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f8283fff640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f827800c970 tx=0x7f827800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278004220 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82780043c0 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841a0400 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278004a00 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.718+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841a6b60 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.719+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f828406bfc0 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.721+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f82780079b0 con 0x7f8284105020 2024-08-31T04:22:22.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.721+0000 7f8281ffb640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 0x7f826c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:22.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.721+0000 7f82888c3640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 0x7f826c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:22.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.721+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f82780e4dd0 con 0x7f8284105020 2024-08-31T04:22:22.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.722+0000 7f82888c3640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 0x7f826c0b7090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8274005d00 tx=0x7f827400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:22.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.724+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8278014030 con 0x7f8284105020 2024-08-31T04:22:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:22 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:22.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:22.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:22.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:22 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.956+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8284104a00 con 0x7f8284105020 2024-08-31T04:22:22.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.956+0000 7f8281ffb640 1 -- 172.21.15.2:0/1757735120 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f8284104a00 con 0x7f8284105020 2024-08-31T04:22:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:22.958 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-08-31T04:22:22:547949+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T04:22:22.958 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.958+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 msgr2=0x7f826c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.958+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 0x7f826c0b7090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8274005d00 tx=0x7f827400b410 comp rx=0 tx=0).stop 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.958+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 msgr2=0x7f828419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.958+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f827800c970 tx=0x7f827800ce30 comp rx=0 tx=0).stop 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.958+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 shutdown_connections 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f826c0b4b80 0x7f826c0b7090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8284105020 0x7f828419a740 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828410dba0 0x7f828419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 --2- 172.21.15.2:0/1757735120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82841045f0 0x7f828419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:22.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 >> 172.21.15.2:0/1757735120 conn(0x7f82840794b0 msgr2=0x7f8284105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:22.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 shutdown_connections 2024-08-31T04:22:22.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:22.959+0000 7f828ab27640 1 -- 172.21.15.2:0/1757735120 wait complete. 2024-08-31T04:22:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:23 smithi064 ceph-mon[22007]: Deploying daemon mds.d on smithi002 2024-08-31T04:22:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:23 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.2:6834/3395319824,v1:172.21.15.2:6835/3395319824] up:boot 2024-08-31T04:22:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:23 smithi064 ceph-mon[22007]: fsmap 3 up:standby 2024-08-31T04:22:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:23 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:22:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1757735120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:23.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:23 smithi132 ceph-mon[22335]: Deploying daemon mds.d on smithi002 2024-08-31T04:22:23.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:23 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.2:6834/3395319824,v1:172.21.15.2:6835/3395319824] up:boot 2024-08-31T04:22:23.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:23 smithi132 ceph-mon[22335]: fsmap 3 up:standby 2024-08-31T04:22:23.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:23 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:22:23.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1757735120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:23.892 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:23 smithi002 ceph-mon[18656]: Deploying daemon mds.d on smithi002 2024-08-31T04:22:23.892 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:23 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.2:6834/3395319824,v1:172.21.15.2:6835/3395319824] up:boot 2024-08-31T04:22:23.893 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:23 smithi002 ceph-mon[18656]: fsmap 3 up:standby 2024-08-31T04:22:23.893 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:23 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:22:23.893 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1757735120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:24 smithi002 ceph-mon[18656]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:24 smithi064 ceph-mon[22007]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:24 smithi132 ceph-mon[22335]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:25.398 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 systemd[1]: Starting Ceph mds.d for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:25.720 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 podman[63435]: 2024-08-31 04:22:25.346902214 +0000 UTC m=+0.015817244 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:25.720 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 podman[63435]: 2024-08-31 04:22:25.47516421 +0000 UTC m=+0.144079219 container create a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T04:22:25.720 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 podman[63435]: 2024-08-31 04:22:25.719580966 +0000 UTC m=+0.388495985 container init a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-31T04:22:25.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:26.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:26.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 podman[63435]: 2024-08-31 04:22:25.722304725 +0000 UTC m=+0.391219743 container start a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T04:22:26.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 ceph-mds[63454]: -- 172.21.15.2:0/166511399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577beac7860 con 0x5577c2c6d180 2024-08-31T04:22:26.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d[63450]: starting mds.d at 2024-08-31T04:22:26.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 bash[63435]: a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 2024-08-31T04:22:26.148 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:22:25 smithi002 systemd[1]: Started Ceph mds.d for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 -- 172.21.15.2:0/460577857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 msgr2=0x7fb10c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 --2- 172.21.15.2:0/460577857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c109650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb100009900 tx=0x7fb10002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 -- 172.21.15.2:0/460577857 shutdown_connections 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 --2- 172.21.15.2:0/460577857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c109650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 --2- 172.21.15.2:0/460577857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c109b90 0x7fb10c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 --2- 172.21.15.2:0/460577857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c103900 0x7fb10c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 -- 172.21.15.2:0/460577857 >> 172.21.15.2:0/460577857 conn(0x7fb10c07b5f0 msgr2=0x7fb10c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 -- 172.21.15.2:0/460577857 shutdown_connections 2024-08-31T04:22:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 -- 172.21.15.2:0/460577857 wait complete. 2024-08-31T04:22:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.532+0000 7fb111eb3640 1 Processor -- start 2024-08-31T04:22:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 -- start start 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c103900 0x7fb10c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 0x7fb10c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c113850 con 0x7fb10c109240 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c1136d0 con 0x7fb10c109b90 2024-08-31T04:22:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb111eb3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c1139d0 con 0x7fb10c103900 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55446/0 (socket says 172.21.15.2:55446) 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 -- 172.21.15.2:0/3174688902 learned_addr learned my addr 172.21.15.2:0/3174688902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10bfff640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 0x7fb10c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10b7fe640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c103900 0x7fb10c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 -- 172.21.15.2:0/3174688902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c103900 msgr2=0x7fb10c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c103900 0x7fb10c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 -- 172.21.15.2:0/3174688902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 msgr2=0x7fb10c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 0x7fb10c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10affd640 1 -- 172.21.15.2:0/3174688902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1a0150 con 0x7fb10c109240 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.533+0000 7fb10bfff640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 0x7fb10c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb10affd640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb10002a930 tx=0x7fb100004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10003f030 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1a03e0 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb100003aa0 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100035070 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.534+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1a08c0 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.535+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c103d10 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.536+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fb100042030 con 0x7fb10c109240 2024-08-31T04:22:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.537+0000 7fb108ff9640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 0x7fb0f40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.537+0000 7fb10b7fe640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 0x7fb0f40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.537+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb100105900 con 0x7fb10c109240 2024-08-31T04:22:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.538+0000 7fb10b7fe640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 0x7fb0f40b70c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00abe0 tx=0x7fb0fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.541+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb1000cce00 con 0x7fb10c109240 2024-08-31T04:22:26.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.764+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb10c19b3d0 con 0x7fb10c109240 2024-08-31T04:22:26.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.765+0000 7fb108ff9640 1 -- 172.21.15.2:0/3174688902 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fb1000c6e20 con 0x7fb10c109240 2024-08-31T04:22:26.767 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:26.767 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-08-31T04:22:26:564525+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T04:22:26.767 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-08-31T04:22:26.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 msgr2=0x7fb0f40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 0x7fb0f40b70c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00abe0 tx=0x7fb0fc00a2d0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 msgr2=0x7fb10c19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb10002a930 tx=0x7fb100004270 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 shutdown_connections 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0f40b4bb0 0x7fb0f40b70c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb10c109240 0x7fb10c19a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb10c109b90 0x7fb10c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 --2- 172.21.15.2:0/3174688902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10c103900 0x7fb10c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 >> 172.21.15.2:0/3174688902 conn(0x7fb10c07b5f0 msgr2=0x7fb10c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 shutdown_connections 2024-08-31T04:22:26.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:26.767+0000 7fb111eb3640 1 -- 172.21.15.2:0/3174688902 wait complete. 2024-08-31T04:22:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.2:6836/1100615699,v1:172.21.15.2:6837/1100615699] up:boot 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: fsmap 4 up:standby 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:22:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:26 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3174688902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.2:6836/1100615699,v1:172.21.15.2:6837/1100615699] up:boot 2024-08-31T04:22:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: fsmap 4 up:standby 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:26 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3174688902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:27.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.2:6836/1100615699,v1:172.21.15.2:6837/1100615699] up:boot 2024-08-31T04:22:27.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: fsmap 4 up:standby 2024-08-31T04:22:27.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:22:27.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:26 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3174688902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:27.887 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:27 smithi064 systemd[1]: Starting Ceph mds.e for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:28.137 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:27 smithi064 ceph-mon[22007]: Deploying daemon mds.e on smithi064 2024-08-31T04:22:28.138 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 podman[52767]: 2024-08-31 04:22:27.908216478 +0000 UTC m=+0.015809663 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:28.138 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 podman[52767]: 2024-08-31 04:22:28.023571042 +0000 UTC m=+0.131164208 container create 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T04:22:28.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:27 smithi002 ceph-mon[18656]: Deploying daemon mds.e on smithi064 2024-08-31T04:22:28.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:27 smithi132 ceph-mon[22335]: Deploying daemon mds.e on smithi064 2024-08-31T04:22:28.567 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 podman[52767]: 2024-08-31 04:22:28.276295321 +0000 UTC m=+0.383888487 container init 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:22:28.567 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 podman[52767]: 2024-08-31 04:22:28.279091519 +0000 UTC m=+0.386684686 container start 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-08-31T04:22:28.567 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mds[52786]: -- 172.21.15.64:0/4242609313 <== mon.2 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc1eb01c20 con 0x55dc22ca7180 2024-08-31T04:22:28.567 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: starting mds.e at 2024-08-31T04:22:28.568 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 bash[52767]: 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e 2024-08-31T04:22:28.568 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:22:28 smithi064 systemd[1]: Started Ceph mds.e for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:29.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:29.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:28 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:29.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:28 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:28 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:29.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:29.882 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:30.161 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:29 smithi002 ceph-mon[18656]: Deploying daemon mds.f on smithi132 2024-08-31T04:22:30.161 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:29 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6834/3881208235,v1:172.21.15.64:6835/3881208235] up:boot 2024-08-31T04:22:30.161 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:29 smithi002 ceph-mon[18656]: fsmap 5 up:standby 2024-08-31T04:22:30.161 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:29 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:22:30.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:29 smithi132 ceph-mon[22335]: Deploying daemon mds.f on smithi132 2024-08-31T04:22:30.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:29 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6834/3881208235,v1:172.21.15.64:6835/3881208235] up:boot 2024-08-31T04:22:30.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:29 smithi132 ceph-mon[22335]: fsmap 5 up:standby 2024-08-31T04:22:30.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:29 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:22:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:29 smithi064 ceph-mon[22007]: Deploying daemon mds.f on smithi132 2024-08-31T04:22:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:29 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6834/3881208235,v1:172.21.15.64:6835/3881208235] up:boot 2024-08-31T04:22:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:29 smithi064 ceph-mon[22007]: fsmap 5 up:standby 2024-08-31T04:22:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:29 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:22:30.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 -- 172.21.15.2:0/435960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 msgr2=0x7f1314102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 --2- 172.21.15.2:0/435960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f1314102c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f131002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 -- 172.21.15.2:0/435960109 shutdown_connections 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 --2- 172.21.15.2:0/435960109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1314108b10 0x7f131410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 --2- 172.21.15.2:0/435960109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13141081c0 0x7f13141085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 --2- 172.21.15.2:0/435960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f1314102c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 -- 172.21.15.2:0/435960109 >> 172.21.15.2:0/435960109 conn(0x7f1314079510 msgr2=0x7f1314079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 -- 172.21.15.2:0/435960109 shutdown_connections 2024-08-31T04:22:30.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.364+0000 7f131c039640 1 -- 172.21.15.2:0/435960109 wait complete. 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 Processor -- start 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 -- start start 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13141081c0 0x7f131419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1314108b10 0x7f131419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1314112830 con 0x7f1314102880 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13141126b0 con 0x7f1314108b10 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f131c039640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f13141129b0 con 0x7f13141081c0 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f1319dd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f1319dd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55468/0 (socket says 172.21.15.2:55468) 2024-08-31T04:22:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f1319dd5640 1 -- 172.21.15.2:0/3966617473 learned_addr learned my addr 172.21.15.2:0/3966617473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.365+0000 7f13195d4640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13141081c0 0x7f131419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f131a5d6640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1314108b10 0x7f131419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 -- 172.21.15.2:0/3966617473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13141081c0 msgr2=0x7f131419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13141081c0 0x7f131419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 -- 172.21.15.2:0/3966617473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1314108b10 msgr2=0x7f131419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1314108b10 0x7f131419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 -- 172.21.15.2:0/3966617473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13141a0340 con 0x7f1314102880 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1319dd5640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1310005940 tx=0x7f1310004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131003f030 con 0x7f1314102880 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13141a05d0 con 0x7f1314102880 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1310003aa0 con 0x7f1314102880 2024-08-31T04:22:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310035070 con 0x7f1314102880 2024-08-31T04:22:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.366+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141a6d90 con 0x7f1314102880 2024-08-31T04:22:30.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.367+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1314103b00 con 0x7f1314102880 2024-08-31T04:22:30.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.369+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f1310042030 con 0x7f1314102880 2024-08-31T04:22:30.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.369+0000 7f1306ffd640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 0x7f13000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.369+0000 7f13195d4640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 0x7f13000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.370+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f1310105770 con 0x7f1314102880 2024-08-31T04:22:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.370+0000 7f13195d4640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 0x7f13000b7090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1314105330 tx=0x7f1308005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.373+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13100ccc70 con 0x7f1314102880 2024-08-31T04:22:30.567 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 systemd[1]: Starting Ceph mds.f for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.594+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1314102c90 con 0x7f1314102880 2024-08-31T04:22:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.595+0000 7f1306ffd640 1 -- 172.21.15.2:0/3966617473 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f13100cc570 con 0x7f1314102880 2024-08-31T04:22:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:30.597 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"btime":"2024-08-31T04:22:28:886550+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T04:22:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-08-31T04:22:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 msgr2=0x7f13000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 0x7f13000b7090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1314105330 tx=0x7f1308005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 msgr2=0x7f131419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1310005940 tx=0x7f1310004270 comp rx=0 tx=0).stop 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 shutdown_connections 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1314108b10 0x7f131419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13141081c0 0x7f131419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13000b4b80 0x7f13000b7090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 --2- 172.21.15.2:0/3966617473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314102880 0x7f131419a3d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 >> 172.21.15.2:0/3966617473 conn(0x7f1314079510 msgr2=0x7f1314101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 shutdown_connections 2024-08-31T04:22:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:30.598+0000 7f131c039640 1 -- 172.21.15.2:0/3966617473 wait complete. 2024-08-31T04:22:30.878 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 podman[53290]: 2024-08-31 04:22:30.523766204 +0000 UTC m=+0.015883617 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:30.878 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 podman[53290]: 2024-08-31 04:22:30.649459592 +0000 UTC m=+0.141576993 container create ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:22:30.878 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 podman[53290]: 2024-08-31 04:22:30.877259514 +0000 UTC m=+0.369376915 container init ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T04:22:31.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:30 smithi002 ceph-mon[18656]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:31.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:30 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3966617473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:30 smithi064 ceph-mon[22007]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:30 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3966617473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:31.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:30 smithi132 ceph-mon[22335]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:31.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:30 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3966617473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:31.318 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 podman[53290]: 2024-08-31 04:22:30.880192613 +0000 UTC m=+0.372310014 container start ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T04:22:31.318 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 ceph-mds[53309]: -- 172.21.15.132:0/3410291872 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d5366b860 con 0x561d57811180 2024-08-31T04:22:31.318 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f[53305]: starting mds.f at 2024-08-31T04:22:31.318 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 bash[53290]: ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d 2024-08-31T04:22:31.318 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:22:30 smithi132 systemd[1]: Started Ceph mds.f for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: Deploying daemon mds.c on smithi132 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6834/355644328,v1:172.21.15.132:6835/355644328] up:boot 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: fsmap 6 up:standby 2024-08-31T04:22:32.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:32 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:32.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: Deploying daemon mds.c on smithi132 2024-08-31T04:22:32.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6834/355644328,v1:172.21.15.132:6835/355644328] up:boot 2024-08-31T04:22:32.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: fsmap 6 up:standby 2024-08-31T04:22:32.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:32 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:22:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: Deploying daemon mds.c on smithi132 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6834/355644328,v1:172.21.15.132:6835/355644328] up:boot 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: fsmap 6 up:standby 2024-08-31T04:22:32.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:32 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:22:33.067 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:32 smithi132 systemd[1]: Starting Ceph mds.c for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:33.460 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 podman[53591]: 2024-08-31 04:22:33.106326363 +0000 UTC m=+0.015680061 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:33.460 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 podman[53591]: 2024-08-31 04:22:33.214203085 +0000 UTC m=+0.123556769 container create 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-31T04:22:33.460 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 podman[53591]: 2024-08-31 04:22:33.459071613 +0000 UTC m=+0.368425303 container init 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T04:22:33.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:33.817 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 podman[53591]: 2024-08-31 04:22:33.462285087 +0000 UTC m=+0.371638783 container start 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:22:33.817 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 ceph-mds[53611]: -- 172.21.15.132:0/1212133822 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b3248d860 con 0x562b36633600 2024-08-31T04:22:33.817 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: starting mds.c at 2024-08-31T04:22:33.818 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 bash[53591]: 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 2024-08-31T04:22:33.818 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:22:33 smithi132 systemd[1]: Started Ceph mds.c for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:33.846 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3897948317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108ac0 msgr2=0x7fdb7810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3897948317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108ac0 0x7fdb7810f2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009ca0 tx=0x7fdb7002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3897948317 shutdown_connections 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3897948317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108ac0 0x7fdb7810f2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3897948317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108170 0x7fdb78108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3897948317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb78102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3897948317 >> 172.21.15.2:0/3897948317 conn(0x7fdb78079530 msgr2=0x7fdb78079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3897948317 shutdown_connections 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.357+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3897948317 wait complete. 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.358+0000 7fdb7cc94640 1 Processor -- start 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.358+0000 7fdb7cc94640 1 -- start start 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.358+0000 7fdb7cc94640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb7819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.358+0000 7fdb7cc94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7cc94640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108ac0 0x7fdb7819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7cc94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78112770 con 0x7fdb78108170 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7cc94640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb781125f0 con 0x7fdb78102880 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7cc94640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdb781128f0 con 0x7fdb78108ac0 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55482/0 (socket says 172.21.15.2:55482) 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 -- 172.21.15.2:0/3638124614 learned_addr learned my addr 172.21.15.2:0/3638124614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7659c640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb7819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb76d9d640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108ac0 0x7fdb7819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 -- 172.21.15.2:0/3638124614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108ac0 msgr2=0x7fdb7819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108ac0 0x7fdb7819ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 -- 172.21.15.2:0/3638124614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 msgr2=0x7fdb7819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb7819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 -- 172.21.15.2:0/3638124614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb781a6280 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb7659c640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb7819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb75d9b640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00d950 tx=0x7fdb6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.359+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c017070 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.360+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c009c30 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.360+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb781a6570 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.360+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0047a0 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.360+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb781a6ab0 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.361+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb78102c90 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.362+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fdb6c004020 con 0x7fdb78108170 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.363+0000 7fdb677fe640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 0x7fdb600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.363+0000 7fdb7659c640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 0x7fdb600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.363+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fdb6c0e4b20 con 0x7fdb78108170 2024-08-31T04:22:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.363+0000 7fdb7659c640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 0x7fdb600b7090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806c140 tx=0x7fdb68005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.367+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb6c020020 con 0x7fdb78108170 2024-08-31T04:22:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.601+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb7802e430 con 0x7fdb78108170 2024-08-31T04:22:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.602+0000 7fdb677fe640 1 -- 172.21.15.2:0/3638124614 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6382 (secure 0 0 0) 0x7fdb6c009de0 con 0x7fdb78108170 2024-08-31T04:22:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:34.604 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"btime":"2024-08-31T04:22:34:105614+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T04:22:34.604 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 msgr2=0x7fdb600b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 0x7fdb600b7090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806c140 tx=0x7fdb68005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 msgr2=0x7fdb7819b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00d950 tx=0x7fdb6c00de10 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 shutdown_connections 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb600b4b80 0x7fdb600b7090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb78108170 0x7fdb7819b500 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb78108ac0 0x7fdb7819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 --2- 172.21.15.2:0/3638124614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102880 0x7fdb7819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 >> 172.21.15.2:0/3638124614 conn(0x7fdb78079530 msgr2=0x7fdb78106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 shutdown_connections 2024-08-31T04:22:34.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:34.604+0000 7fdb7cc94640 1 -- 172.21.15.2:0/3638124614 wait complete. 2024-08-31T04:22:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:34.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: Deploying daemon mds.h on smithi064 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6836/209815036,v1:172.21.15.132:6837/209815036] up:boot 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: fsmap 7 up:standby 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:22:34.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:34 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3638124614' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: Deploying daemon mds.h on smithi064 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6836/209815036,v1:172.21.15.132:6837/209815036] up:boot 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: fsmap 7 up:standby 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:22:35.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:34 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3638124614' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: Deploying daemon mds.h on smithi064 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6836/209815036,v1:172.21.15.132:6837/209815036] up:boot 2024-08-31T04:22:35.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: fsmap 7 up:standby 2024-08-31T04:22:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:22:35.070 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:34 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3638124614' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:35.790 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:35 smithi064 systemd[1]: Starting Ceph mds.h for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:35.790 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:35 smithi064 podman[53068]: 2024-08-31 04:22:35.691306981 +0000 UTC m=+0.015942131 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:36.067 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:35 smithi064 podman[53068]: 2024-08-31 04:22:35.812853824 +0000 UTC m=+0.137488959 container create f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:22:36.567 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 podman[53068]: 2024-08-31 04:22:36.073753183 +0000 UTC m=+0.398388319 container init f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:22:36.567 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 podman[53068]: 2024-08-31 04:22:36.076590598 +0000 UTC m=+0.401225733 container start f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:22:36.567 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mds[53088]: -- 172.21.15.64:0/3551685112 <== mon.2 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bf4e75860 con 0x563bf901b180 2024-08-31T04:22:36.568 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: starting mds.h at 2024-08-31T04:22:36.568 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 bash[53068]: f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 2024-08-31T04:22:36.568 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:22:36 smithi064 systemd[1]: Started Ceph mds.h for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:36.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:36 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:36.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:36 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:36 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:37.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:37.702 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:37 smithi132 ceph-mon[22335]: Deploying daemon mds.i on smithi132 2024-08-31T04:22:37.702 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:37 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:boot 2024-08-31T04:22:37.702 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:37 smithi132 ceph-mon[22335]: fsmap 8 up:standby 2024-08-31T04:22:37.702 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:37 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:22:37.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:37 smithi002 ceph-mon[18656]: Deploying daemon mds.i on smithi132 2024-08-31T04:22:37.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:37 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:boot 2024-08-31T04:22:37.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:37 smithi002 ceph-mon[18656]: fsmap 8 up:standby 2024-08-31T04:22:37.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:37 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:22:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 -- 172.21.15.2:0/868396915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff134105120 msgr2=0x7ff13410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 --2- 172.21.15.2:0/868396915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff134105120 0x7ff13410d670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff128009900 tx=0x7ff12802a410 comp rx=0 tx=0).stop 2024-08-31T04:22:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 -- 172.21.15.2:0/868396915 shutdown_connections 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 --2- 172.21.15.2:0/868396915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff134105120 0x7ff13410d670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 --2- 172.21.15.2:0/868396915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff13410dc30 0x7ff134110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 --2- 172.21.15.2:0/868396915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1341047d0 0x7ff134104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.024+0000 7ff1399b8640 1 -- 172.21.15.2:0/868396915 >> 172.21.15.2:0/868396915 conn(0x7ff134079510 msgr2=0x7ff134079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.025+0000 7ff1399b8640 1 -- 172.21.15.2:0/868396915 shutdown_connections 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.025+0000 7ff1399b8640 1 -- 172.21.15.2:0/868396915 wait complete. 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.025+0000 7ff1399b8640 1 Processor -- start 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.025+0000 7ff1399b8640 1 -- start start 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 0x7ff134102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 0x7ff134102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff134113890 con 0x7ff1341047d0 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff134113710 con 0x7ff13410dc30 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1399b8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff134113a10 con 0x7ff134105120 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38858/0 (socket says 172.21.15.2:38858) 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 -- 172.21.15.2:0/3689299919 learned_addr learned my addr 172.21.15.2:0/3689299919 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1327fc640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 0x7ff134102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1337fe640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 0x7ff134102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 -- 172.21.15.2:0/3689299919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 msgr2=0x7ff134102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 0x7ff134102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 -- 172.21.15.2:0/3689299919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 msgr2=0x7ff134102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 0x7ff134102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 -- 172.21.15.2:0/3689299919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1341a8560 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1337fe640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 0x7ff134102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1327fc640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 0x7ff134102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff132ffd640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c890 tx=0x7ff12400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004220 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.026+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1240043c0 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.027+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004a00 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.027+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1341a8850 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.027+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1341a8d10 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.028+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13406c000 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.029+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7ff1240079b0 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.030+0000 7ff1389b6640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 0x7ff11c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.030+0000 7ff1327fc640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 0x7ff11c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.030+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff1240e4fe0 con 0x7ff1341047d0 2024-08-31T04:22:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.031+0000 7ff1327fc640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 0x7ff11c0b7090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff128009230 tx=0x7ff128031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:38.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.033+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff124014030 con 0x7ff1341047d0 2024-08-31T04:22:38.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:37 smithi064 ceph-mon[22007]: Deploying daemon mds.i on smithi132 2024-08-31T04:22:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:37 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:boot 2024-08-31T04:22:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:37 smithi064 ceph-mon[22007]: fsmap 8 up:standby 2024-08-31T04:22:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:37 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:22:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.255+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff134104be0 con 0x7ff1341047d0 2024-08-31T04:22:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.256+0000 7ff1389b6640 1 -- 172.21.15.2:0/3689299919 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7ff1240ac4e0 con 0x7ff1341047d0 2024-08-31T04:22:38.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:38.259 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-08-31T04:22:36:612127+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T04:22:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-08-31T04:22:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.258+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 msgr2=0x7ff11c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.258+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 0x7ff11c0b7090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff128009230 tx=0x7ff128031400 comp rx=0 tx=0).stop 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.258+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 msgr2=0x7ff134102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.258+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c890 tx=0x7ff12400cd50 comp rx=0 tx=0).stop 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 shutdown_connections 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff13410dc30 0x7ff134102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff134105120 0x7ff134102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff11c0b4b80 0x7ff11c0b7090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 --2- 172.21.15.2:0/3689299919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1341047d0 0x7ff134102510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 >> 172.21.15.2:0/3689299919 conn(0x7ff134079510 msgr2=0x7ff1341005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 shutdown_connections 2024-08-31T04:22:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:38.259+0000 7ff1399b8640 1 -- 172.21.15.2:0/3689299919 wait complete. 2024-08-31T04:22:38.317 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 systemd[1]: Starting Ceph mds.i for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:38.674 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:38 smithi132 ceph-mon[22335]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:38.675 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3689299919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:38.675 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 podman[53891]: 2024-08-31 04:22:38.296672179 +0000 UTC m=+0.015817369 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:38.675 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 podman[53891]: 2024-08-31 04:22:38.412624012 +0000 UTC m=+0.131769185 container create 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T04:22:38.675 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 podman[53891]: 2024-08-31 04:22:38.674049188 +0000 UTC m=+0.393194365 container init 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T04:22:38.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:38 smithi002 ceph-mon[18656]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:38.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3689299919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:38 smithi064 ceph-mon[22007]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3689299919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:39.067 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 podman[53891]: 2024-08-31 04:22:38.677106468 +0000 UTC m=+0.396251651 container start 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T04:22:39.068 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 ceph-mds[53910]: -- 172.21.15.132:0/2849549132 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564248e6b860 con 0x56424d011a80 2024-08-31T04:22:39.068 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: starting mds.i at 2024-08-31T04:22:39.068 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 bash[53891]: 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 2024-08-31T04:22:39.068 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:22:38 smithi132 systemd[1]: Started Ceph mds.i for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:40.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: Deploying daemon mds.g on smithi002 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:boot 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: fsmap 9 up:standby 2024-08-31T04:22:40.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:39 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: Deploying daemon mds.g on smithi002 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:boot 2024-08-31T04:22:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: fsmap 9 up:standby 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:39 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: Deploying daemon mds.g on smithi002 2024-08-31T04:22:40.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:boot 2024-08-31T04:22:40.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: fsmap 9 up:standby 2024-08-31T04:22:40.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:39 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:22:40.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:40 smithi002 ceph-mon[18656]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:40.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:40 smithi064 ceph-mon[22007]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:41.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:40 smithi132 ceph-mon[22335]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:41.540 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:22:41 smithi002 systemd[1]: Started Ceph mds.g for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 -- 172.21.15.2:0/1493299024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0108ab0 msgr2=0x7ff9e010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/1493299024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0108ab0 0x7ff9e010f2e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009ca0 tx=0x7ff9d802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 -- 172.21.15.2:0/1493299024 shutdown_connections 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/1493299024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0108ab0 0x7ff9e010f2e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/1493299024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9e0108160 0x7ff9e0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/1493299024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0102820 0x7ff9e0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 -- 172.21.15.2:0/1493299024 >> 172.21.15.2:0/1493299024 conn(0x7ff9e00794e0 msgr2=0x7ff9e00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.947+0000 7ff9e62cb640 1 -- 172.21.15.2:0/1493299024 shutdown_connections 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.948+0000 7ff9e62cb640 1 -- 172.21.15.2:0/1493299024 wait complete. 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.948+0000 7ff9e62cb640 1 Processor -- start 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.948+0000 7ff9e62cb640 1 -- start start 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9e0108160 0x7ff9e019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 0x7ff9e019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112710 con 0x7ff9e0102820 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112590 con 0x7ff9e0108ab0 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e62cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112890 con 0x7ff9e0108160 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38882/0 (socket says 172.21.15.2:38882) 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 -- 172.21.15.2:0/3499145781 learned_addr learned my addr 172.21.15.2:0/3499145781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e4868640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 0x7ff9e019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 -- 172.21.15.2:0/3499145781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9e0108160 msgr2=0x7ff9e019b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9e0108160 0x7ff9e019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 -- 172.21.15.2:0/3499145781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 msgr2=0x7ff9e019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 0x7ff9e019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 -- 172.21.15.2:0/3499145781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01a62d0 con 0x7ff9e0102820 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9e4868640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 0x7ff9e019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dffff640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000d950 tx=0x7ff9d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.949+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0017070 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.950+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9d0009c30 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.950+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e01a65c0 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.950+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000f620 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.950+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e01a6b00 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.951+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0103aa0 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.952+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7ff9d0010460 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.953+0000 7ff9dd7fa640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 0x7ff9c80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.953+0000 7ff9df7fe640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 0x7ff9c80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.953+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff9d00e4ad0 con 0x7ff9e0102820 2024-08-31T04:22:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.953+0000 7ff9df7fe640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 0x7ff9c80b7090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0079ae0 tx=0x7ff9d4005bf0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:41.957+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff9d00abfd0 con 0x7ff9e0102820 2024-08-31T04:22:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.186+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e006bd50 con 0x7ff9e0102820 2024-08-31T04:22:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.186+0000 7ff9dd7fa640 1 -- 172.21.15.2:0/3499145781 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8860 (secure 0 0 0) 0x7ff9d0009de0 con 0x7ff9e0102820 2024-08-31T04:22:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"btime":"2024-08-31T04:22:41:839301+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T04:22:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2024-08-31T04:22:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 msgr2=0x7ff9c80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 0x7ff9c80b7090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0079ae0 tx=0x7ff9d4005bf0 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 msgr2=0x7ff9e019afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000d950 tx=0x7ff9d000de10 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 shutdown_connections 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0108ab0 0x7ff9e019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9e0108160 0x7ff9e019b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff9c80b4b80 0x7ff9c80b7090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 --2- 172.21.15.2:0/3499145781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e0102820 0x7ff9e019afc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 >> 172.21.15.2:0/3499145781 conn(0x7ff9e00794e0 msgr2=0x7ff9e0105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 shutdown_connections 2024-08-31T04:22:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:42.189+0000 7ff9e62cb640 1 -- 172.21.15.2:0/3499145781 wait complete. 2024-08-31T04:22:42.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:42.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: Deploying daemon mds.a on smithi002 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.2:6838/1028238905,v1:172.21.15.2:6839/1028238905] up:boot 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: fsmap 10 up:standby 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:22:42.656 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3499145781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: Deploying daemon mds.a on smithi002 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.2:6838/1028238905,v1:172.21.15.2:6839/1028238905] up:boot 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: fsmap 10 up:standby 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3499145781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:42.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: Deploying daemon mds.a on smithi002 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.2:6838/1028238905,v1:172.21.15.2:6839/1028238905] up:boot 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: fsmap 10 up:standby 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:22:42.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3499145781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:44.397 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 systemd[1]: Starting Ceph mds.a for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:44.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:44 smithi002 ceph-mon[18656]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:44.687 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 podman[64621]: 2024-08-31 04:22:44.314262068 +0000 UTC m=+0.015683309 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:44.687 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 podman[64621]: 2024-08-31 04:22:44.42500896 +0000 UTC m=+0.126430250 container create 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:22:44.687 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 podman[64621]: 2024-08-31 04:22:44.686025774 +0000 UTC m=+0.387447006 container init 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:22:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:44 smithi064 ceph-mon[22007]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:44 smithi132 ceph-mon[22335]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:45.147 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 podman[64621]: 2024-08-31 04:22:44.689191549 +0000 UTC m=+0.390612781 container start 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:22:45.147 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 ceph-mds[64641]: -- 172.21.15.2:0/3662711599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562decded860 con 0x562df0f93a80 2024-08-31T04:22:45.147 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a[64637]: starting mds.a at 2024-08-31T04:22:45.148 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 bash[64621]: 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 2024-08-31T04:22:45.148 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:22:44 smithi002 systemd[1]: Started Ceph mds.a for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:45.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:45.573 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: Deploying daemon mds.b on smithi064 2024-08-31T04:22:45.890 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.2:6840/3442554545,v1:172.21.15.2:6841/3442554545] up:boot 2024-08-31T04:22:45.891 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: fsmap 11 up:standby 2024-08-31T04:22:45.891 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:45 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:22:45.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:45.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:45.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:46.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:46.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: Deploying daemon mds.b on smithi064 2024-08-31T04:22:46.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.2:6840/3442554545,v1:172.21.15.2:6841/3442554545] up:boot 2024-08-31T04:22:46.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: fsmap 11 up:standby 2024-08-31T04:22:46.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:45 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: Deploying daemon mds.b on smithi064 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.2:6840/3442554545,v1:172.21.15.2:6841/3442554545] up:boot 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: fsmap 11 up:standby 2024-08-31T04:22:46.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:45 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:22:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 -- 172.21.15.2:0/2329801653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 msgr2=0x7fcde410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 --2- 172.21.15.2:0/2329801653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde410f300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009900 tx=0x7fcddc02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 -- 172.21.15.2:0/2329801653 shutdown_connections 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 --2- 172.21.15.2:0/2329801653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde410f300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 --2- 172.21.15.2:0/2329801653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 --2- 172.21.15.2:0/2329801653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 0x7fcde4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 -- 172.21.15.2:0/2329801653 >> 172.21.15.2:0/2329801653 conn(0x7fcde40794f0 msgr2=0x7fcde4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 -- 172.21.15.2:0/2329801653 shutdown_connections 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.089+0000 7fcdeb236640 1 -- 172.21.15.2:0/2329801653 wait complete. 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 Processor -- start 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 -- start start 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 0x7fcde419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcde41127a0 con 0x7fcde4108ad0 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4112620 con 0x7fcde4102840 2024-08-31T04:22:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcdeb236640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4112920 con 0x7fcde4108180 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcde97d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcde3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcde8fd2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 0x7fcde419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcde97d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57520/0 (socket says 172.21.15.2:57520) 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.090+0000 7fcde3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:41066/0 (socket says 172.21.15.2:41066) 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde97d3640 1 -- 172.21.15.2:0/760053427 learned_addr learned my addr 172.21.15.2:0/760053427 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 -- 172.21.15.2:0/760053427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 msgr2=0x7fcde419b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 0x7fcde419b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 -- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 msgr2=0x7fcde419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 -- 172.21.15.2:0/760053427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde41a62c0 con 0x7fcde4108180 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde97d3640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde3fff640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcde406b310 tx=0x7fcdd400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400cd50 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd4005020 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde41a65b0 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.091+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40116d0 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.092+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41a6aa0 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.092+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde4102c50 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.094+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fcdd40054d0 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.094+0000 7fcde1ffb640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 0x7fcdd00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.095+0000 7fcde8fd2640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 0x7fcdd00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.095+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcdd40e5290 con 0x7fcde4108180 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.095+0000 7fcde8fd2640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 0x7fcdd00b70c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde406c440 tx=0x7fcdcc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.098+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcdd4016030 con 0x7fcde4108180 2024-08-31T04:22:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.320+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde406bcf0 con 0x7fcde4108180 2024-08-31T04:22:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.320+0000 7fcde1ffb640 1 -- 172.21.15.2:0/760053427 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7fcdd40ac0a0 con 0x7fcde4108180 2024-08-31T04:22:46.322 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:46.322 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-08-31T04:22:45:441263+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T04:22:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-08-31T04:22:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 msgr2=0x7fcdd00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 0x7fcdd00b70c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde406c440 tx=0x7fcdcc00b390 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 msgr2=0x7fcde419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcde406b310 tx=0x7fcdd400ee80 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 shutdown_connections 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdd00b4bb0 0x7fcdd00b70c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde4108ad0 0x7fcde419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde4108180 0x7fcde419b570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 --2- 172.21.15.2:0/760053427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde4102840 0x7fcde419b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 >> 172.21.15.2:0/760053427 conn(0x7fcde40794f0 msgr2=0x7fcde41061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 shutdown_connections 2024-08-31T04:22:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:46.323+0000 7fcdeb236640 1 -- 172.21.15.2:0/760053427 wait complete. 2024-08-31T04:22:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:46 smithi064 ceph-mon[22007]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:46 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/760053427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:47.067 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:46 smithi064 systemd[1]: Starting Ceph mds.b for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:22:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:46 smithi002 ceph-mon[18656]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:46 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/760053427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:47.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:46 smithi132 ceph-mon[22335]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:47.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:46 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/760053427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:47.471 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 podman[53371]: 2024-08-31 04:22:47.061094823 +0000 UTC m=+0.016030410 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:22:47.471 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 podman[53371]: 2024-08-31 04:22:47.192592725 +0000 UTC m=+0.147528300 container create 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:22:47.471 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 podman[53371]: 2024-08-31 04:22:47.470589755 +0000 UTC m=+0.425525328 container init 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T04:22:47.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 podman[53371]: 2024-08-31 04:22:47.473635224 +0000 UTC m=+0.428570804 container start 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T04:22:47.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 ceph-mds[53391]: -- 172.21.15.64:0/3014107028 <== mon.2 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55edc5ca1860 con 0x55edc9e47180 2024-08-31T04:22:47.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: starting mds.b at 2024-08-31T04:22:47.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 bash[53371]: 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae 2024-08-31T04:22:47.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:22:47 smithi064 systemd[1]: Started Ceph mds.b for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:boot 2024-08-31T04:22:48.618 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: fsmap 12 up:standby 2024-08-31T04:22:48.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:22:48.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:48 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:48.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:boot 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: fsmap 12 up:standby 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:22:48.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:48 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:48.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:boot 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: fsmap 12 up:standby 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:22:49.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:48 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 -- 172.21.15.2:0/832761816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 msgr2=0x7f89e010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 --2- 172.21.15.2:0/832761816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e010d5f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009900 tx=0x7f89d402a410 comp rx=0 tx=0).stop 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 -- 172.21.15.2:0/832761816 shutdown_connections 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 --2- 172.21.15.2:0/832761816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e010d5f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 --2- 172.21.15.2:0/832761816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e010dbb0 0x7f89e01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 --2- 172.21.15.2:0/832761816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e0104750 0x7f89e0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 -- 172.21.15.2:0/832761816 >> 172.21.15.2:0/832761816 conn(0x7f89e00794d0 msgr2=0x7f89e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 -- 172.21.15.2:0/832761816 shutdown_connections 2024-08-31T04:22:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 -- 172.21.15.2:0/832761816 wait complete. 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.765+0000 7f89e60d7640 1 Processor -- start 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 -- start start 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 0x7f89e0102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 0x7f89e0102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01137f0 con 0x7f89e01050a0 2024-08-31T04:22:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0113670 con 0x7f89e010dbb0 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89e60d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0113970 con 0x7f89e0104750 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89deffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89deffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57542/0 (socket says 172.21.15.2:57542) 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89deffd640 1 -- 172.21.15.2:0/2053684019 learned_addr learned my addr 172.21.15.2:0/2053684019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89df7fe640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 0x7f89e0102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.766+0000 7f89dffff640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 0x7f89e0102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 -- 172.21.15.2:0/2053684019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 msgr2=0x7f89e0102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 0x7f89e0102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 -- 172.21.15.2:0/2053684019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 msgr2=0x7f89e0102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 0x7f89e0102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 -- 172.21.15.2:0/2053684019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e01a8520 con 0x7f89e01050a0 2024-08-31T04:22:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89dffff640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 0x7f89e0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89df7fe640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 0x7f89e0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89deffd640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89d402a930 tx=0x7f89d4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d403f030 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89d4004490 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4035070 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e01a87b0 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.767+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01a8c90 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.768+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e0104b60 con 0x7f89e01050a0 2024-08-31T04:22:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.770+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f89d4042030 con 0x7f89e01050a0 2024-08-31T04:22:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.772+0000 7f89dcff9640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 0x7f89c80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.772+0000 7f89df7fe640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 0x7f89c80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.772+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f89d4105530 con 0x7f89e01050a0 2024-08-31T04:22:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.772+0000 7f89df7fe640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 0x7f89c80b7110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89e0103ee0 tx=0x7f89d0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:49.775+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f89d40cc340 con 0x7f89e01050a0 2024-08-31T04:22:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.022+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89e002e430 con 0x7f89e01050a0 2024-08-31T04:22:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.023+0000 7f89dcff9640 1 -- 172.21.15.2:0/2053684019 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f89d40d0b00 con 0x7f89e01050a0 2024-08-31T04:22:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:50.025 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-08-31T04:22:47:858157+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-31T04:22:50.025 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-08-31T04:22:50.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 msgr2=0x7f89c80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 0x7f89c80b7110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89e0103ee0 tx=0x7f89d0005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 msgr2=0x7f89e01029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89d402a930 tx=0x7f89d4031a20 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 shutdown_connections 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89c80b4c00 0x7f89c80b7110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e01050a0 0x7f89e01029d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e010dbb0 0x7f89e0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 --2- 172.21.15.2:0/2053684019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89e0104750 0x7f89e0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 >> 172.21.15.2:0/2053684019 conn(0x7f89e00794d0 msgr2=0x7f89e0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 shutdown_connections 2024-08-31T04:22:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:50.026+0000 7f89e60d7640 1 -- 172.21.15.2:0/2053684019 wait complete. 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:50.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:50 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2053684019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:50.487 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.488 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:50.488 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:50 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2053684019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:50.520 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:50.520 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.520 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.520 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:22:50.521 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:50 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2053684019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:50.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T04:22:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 -- 172.21.15.2:0/1624803844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8108ab0 msgr2=0x7f77e810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/1624803844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8108ab0 0x7f77e810f2e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009ca0 tx=0x7f77e002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 -- 172.21.15.2:0/1624803844 shutdown_connections 2024-08-31T04:22:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/1624803844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8108ab0 0x7f77e810f2e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/1624803844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108160 0x7f77e8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/1624803844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8102820 0x7f77e8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 -- 172.21.15.2:0/1624803844 >> 172.21.15.2:0/1624803844 conn(0x7f77e80794e0 msgr2=0x7f77e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 -- 172.21.15.2:0/1624803844 shutdown_connections 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.014+0000 7f77ed4d9640 1 -- 172.21.15.2:0/1624803844 wait complete. 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 Processor -- start 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 -- start start 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 0x7f77e819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 0x7f77e819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8113880 con 0x7f77e8102820 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8113700 con 0x7f77e8108160 2024-08-31T04:22:52.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77ed4d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8113a00 con 0x7f77e8108ab0 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57562/0 (socket says 172.21.15.2:57562) 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.015+0000 7f77e6ffd640 1 -- 172.21.15.2:0/630808684 learned_addr learned my addr 172.21.15.2:0/630808684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e77fe640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 0x7f77e819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e67fc640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 0x7f77e819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 -- 172.21.15.2:0/630808684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 msgr2=0x7f77e819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 0x7f77e819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 -- 172.21.15.2:0/630808684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 msgr2=0x7f77e819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 0x7f77e819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 -- 172.21.15.2:0/630808684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e81a00e0 con 0x7f77e8102820 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e67fc640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 0x7f77e819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e77fe640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 0x7f77e819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77e6ffd640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c920 tx=0x7f77d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8007c70 con 0x7f77e8102820 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e81a03d0 con 0x7f77e8102820 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d8007e10 con 0x7f77e8102820 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8018820 con 0x7f77e8102820 2024-08-31T04:22:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.016+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81a6bf0 con 0x7f77e8102820 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.017+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8103aa0 con 0x7f77e8102820 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.019+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f77d800f450 con 0x7f77e8102820 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.020+0000 7f77dffff640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 0x7f77d40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.020+0000 7f77e67fc640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 0x7f77d40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.021+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f77d80e52f0 con 0x7f77e8102820 2024-08-31T04:22:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.021+0000 7f77e67fc640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 0x7f77d40b70c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006fd0 tx=0x7f77d0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.024+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f77d8014030 con 0x7f77e8102820 2024-08-31T04:22:52.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.239+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f77e8102c30 con 0x7f77e8102820 2024-08-31T04:22:52.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.240+0000 7f77dffff640 1 -- 172.21.15.2:0/630808684 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f77d80ac7e0 con 0x7f77e8102820 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:22:52.242 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-31T04:22:52.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.242+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 msgr2=0x7f77d40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:52.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.242+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 0x7f77d40b70c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006fd0 tx=0x7f77d0008040 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.242+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 msgr2=0x7f77e819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.242+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c920 tx=0x7f77d800cde0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 shutdown_connections 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e8108ab0 0x7f77e819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e8108160 0x7f77e819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d40b4bb0 0x7f77d40b70c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 --2- 172.21.15.2:0/630808684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e8102820 0x7f77e819a230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 >> 172.21.15.2:0/630808684 conn(0x7f77e80794e0 msgr2=0x7f77e8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 shutdown_connections 2024-08-31T04:22:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:52.243+0000 7f77ed4d9640 1 -- 172.21.15.2:0/630808684 wait complete. 2024-08-31T04:22:52.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:52 smithi002 ceph-mon[18656]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:52.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:52 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:52 smithi064 ceph-mon[22007]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:52 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:52 smithi132 ceph-mon[22335]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:52 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:52.867 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T04:22:52.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T04:22:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:53.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/630808684' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:22:53.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:53.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:53.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/630808684' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/630808684' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:53.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:22:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 -- 172.21.15.2:0/1433667376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109240 msgr2=0x7f722c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1433667376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109240 0x7f722c109650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7220009900 tx=0x7f722002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 -- 172.21.15.2:0/1433667376 shutdown_connections 2024-08-31T04:22:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1433667376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109240 0x7f722c109650 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1433667376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c109b90 0x7f722c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1433667376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c103900 0x7f722c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 -- 172.21.15.2:0/1433667376 >> 172.21.15.2:0/1433667376 conn(0x7f722c07b5f0 msgr2=0x7f722c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 -- 172.21.15.2:0/1433667376 shutdown_connections 2024-08-31T04:22:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.620+0000 7f7231a4c640 1 -- 172.21.15.2:0/1433667376 wait complete. 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 Processor -- start 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 -- start start 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c103900 0x7f722c076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 0x7f722c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f722c113870 con 0x7f722c109b90 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f722c1136f0 con 0x7f722c103900 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f7231a4c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f722c1139f0 con 0x7f722c109240 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f722b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f722b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57580/0 (socket says 172.21.15.2:57580) 2024-08-31T04:22:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f722b7fe640 1 -- 172.21.15.2:0/1637542073 learned_addr learned my addr 172.21.15.2:0/1637542073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f722affd640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c103900 0x7f722c076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.621+0000 7f722a7fc640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 0x7f722c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 -- 172.21.15.2:0/1637542073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 msgr2=0x7f722c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 0x7f722c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 -- 172.21.15.2:0/1637542073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c103900 msgr2=0x7f722c076ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c103900 0x7f722c076ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 -- 172.21.15.2:0/1637542073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c076180 con 0x7f722c109b90 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722a7fc640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 0x7f722c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f722b7fe640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f722400cce0 tx=0x7f722400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722400f450 con 0x7f722c109b90 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c1acc40 con 0x7f722c109b90 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f722400faa0 con 0x7f722c109b90 2024-08-31T04:22:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224018a80 con 0x7f722c109b90 2024-08-31T04:22:53.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.622+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1ad100 con 0x7f722c109b90 2024-08-31T04:22:53.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.623+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c103d10 con 0x7f722c109b90 2024-08-31T04:22:53.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.626+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f722400fc50 con 0x7f722c109b90 2024-08-31T04:22:53.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.626+0000 7f7230a4a640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 0x7f72140b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.626+0000 7f722affd640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 0x7f72140b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.627+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f72240e5700 con 0x7f722c109b90 2024-08-31T04:22:53.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.627+0000 7f722affd640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 0x7f72140b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f722c19e1b0 tx=0x7f721c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.630+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7224014030 con 0x7f722c109b90 2024-08-31T04:22:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:53.819+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f722c0767b0 con 0x7f722c109b90 2024-08-31T04:22:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.206+0000 7f7230a4a640 1 -- 172.21.15.2:0/1637542073 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f722c0767b0 con 0x7f722c109b90 2024-08-31T04:22:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 msgr2=0x7f72140b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 0x7f72140b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f722c19e1b0 tx=0x7f721c009110 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 msgr2=0x7f722c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f722400cce0 tx=0x7f722400a620 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 shutdown_connections 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72140b4b80 0x7f72140b7090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f722c109b90 0x7f722c0759f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f722c109240 0x7f722c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 --2- 172.21.15.2:0/1637542073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f722c103900 0x7f722c076ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 >> 172.21.15.2:0/1637542073 conn(0x7f722c07b5f0 msgr2=0x7f722c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 shutdown_connections 2024-08-31T04:22:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:54.209+0000 7f7231a4c640 1 -- 172.21.15.2:0/1637542073 wait complete. 2024-08-31T04:22:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:54 smithi064 ceph-mon[22007]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:54 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:22:54.568 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:54 smithi002 ceph-mon[18656]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:54.568 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:54 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:22:54.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:54 smithi132 ceph-mon[22335]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:54.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:54 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:22:54.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-31T04:22:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:55.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:55 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:22:55.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:55 smithi002 ceph-mon[18656]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:22:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:55 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:22:55.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:55 smithi064 ceph-mon[22007]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:22:55.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:55 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1637542073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:22:55.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:55 smithi132 ceph-mon[22335]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:22:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 -- 172.21.15.2:0/3429202140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210102820 msgr2=0x7f3210102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 --2- 172.21.15.2:0/3429202140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210102820 0x7f3210102c30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3200009900 tx=0x7f320002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 -- 172.21.15.2:0/3429202140 shutdown_connections 2024-08-31T04:22:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 --2- 172.21.15.2:0/3429202140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108ab0 0x7f321010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 --2- 172.21.15.2:0/3429202140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210108160 0x7f3210108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 --2- 172.21.15.2:0/3429202140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210102820 0x7f3210102c30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 -- 172.21.15.2:0/3429202140 >> 172.21.15.2:0/3429202140 conn(0x7f32100794e0 msgr2=0x7f32100798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 -- 172.21.15.2:0/3429202140 shutdown_connections 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.737+0000 7f3216e56640 1 -- 172.21.15.2:0/3429202140 wait complete. 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 Processor -- start 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 -- start start 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210102820 0x7f321019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108160 0x7f321019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3210112710 con 0x7f3210108ab0 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3210112590 con 0x7f3210108160 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f3216e56640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3210112890 con 0x7f3210102820 2024-08-31T04:22:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f32153f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f32153f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60242/0 (socket says 172.21.15.2:60242) 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f32153f3640 1 -- 172.21.15.2:0/1288020913 learned_addr learned my addr 172.21.15.2:0/1288020913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.738+0000 7f320ffff640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108160 0x7f321019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f3214bf2640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210102820 0x7f321019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 -- 172.21.15.2:0/1288020913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210102820 msgr2=0x7f321019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210102820 0x7f321019b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 -- 172.21.15.2:0/1288020913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108160 msgr2=0x7f321019b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108160 0x7f321019b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 -- 172.21.15.2:0/1288020913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32101a6270 con 0x7f3210108ab0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f32153f3640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f320800eaa0 tx=0x7f320800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208004d20 con 0x7f3210108ab0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3208005020 con 0x7f3210108ab0 2024-08-31T04:22:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32101a6560 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080116b0 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.739+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32101a6a50 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.741+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3210103aa0 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.742+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f32080051d0 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.743+0000 7f320dffb640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 0x7f31f80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.743+0000 7f3214bf2640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 0x7f31f80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.743+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7f32080e5510 con 0x7f3210108ab0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.744+0000 7f3214bf2640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 0x7f31f80b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3200000c00 tx=0x7f3200031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.747+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3208016030 con 0x7f3210108ab0 2024-08-31T04:22:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:55.933+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f3210102c30 con 0x7f3210108ab0 2024-08-31T04:22:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.219+0000 7f320dffb640 1 -- 172.21.15.2:0/1288020913 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v73) ==== 171+0+0 (secure 0 0 0) 0x7f32080ac8a0 con 0x7f3210108ab0 2024-08-31T04:22:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 msgr2=0x7f31f80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 0x7f31f80b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3200000c00 tx=0x7f3200031400 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 msgr2=0x7f321019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f320800eaa0 tx=0x7f320800eea0 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 shutdown_connections 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31f80b4b80 0x7f31f80b7090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3210108ab0 0x7f321019bac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210108160 0x7f321019b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 --2- 172.21.15.2:0/1288020913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3210102820 0x7f321019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 >> 172.21.15.2:0/1288020913 conn(0x7f32100794e0 msgr2=0x7f32101011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 shutdown_connections 2024-08-31T04:22:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:56.222+0000 7f3216e56640 1 -- 172.21.15.2:0/1288020913 wait complete. 2024-08-31T04:22:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:56 smithi064 ceph-mon[22007]: pgmap v250: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:56 smithi064 ceph-mon[22007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:22:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:56 smithi064 ceph-mon[22007]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:22:56.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:56 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T04:22:56.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:56 smithi132 ceph-mon[22335]: pgmap v250: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:56.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:56 smithi132 ceph-mon[22335]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:22:56.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:56 smithi132 ceph-mon[22335]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:22:56.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:56 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T04:22:56.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:56 smithi002 ceph-mon[18656]: pgmap v250: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:56.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:56 smithi002 ceph-mon[18656]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:22:56.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:56 smithi002 ceph-mon[18656]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:22:56.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:56 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T04:22:56.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T04:22:57.221 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:57.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:57 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T04:22:57.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:57 smithi002 ceph-mon[18656]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:22:57.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:57 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T04:22:57.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:57 smithi064 ceph-mon[22007]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:22:57.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:57 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1288020913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T04:22:57.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:57 smithi132 ceph-mon[22335]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:22:57.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 -- 172.21.15.2:0/2727962259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109b90 msgr2=0x7f18741103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 --2- 172.21.15.2:0/2727962259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109b90 0x7f18741103c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f186c009ca0 tx=0x7f186c02a8e0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 -- 172.21.15.2:0/2727962259 shutdown_connections 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 --2- 172.21.15.2:0/2727962259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109b90 0x7f18741103c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 --2- 172.21.15.2:0/2727962259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109240 0x7f1874109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 --2- 172.21.15.2:0/2727962259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f1874103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 -- 172.21.15.2:0/2727962259 >> 172.21.15.2:0/2727962259 conn(0x7f187407b5f0 msgr2=0x7f187407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 -- 172.21.15.2:0/2727962259 shutdown_connections 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.705+0000 7f187a82c640 1 -- 172.21.15.2:0/2727962259 wait complete. 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 Processor -- start 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 -- start start 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f18740754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109b90 0x7f1874075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.706+0000 7f187a82c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1874113890 con 0x7f1874109240 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f187a82c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1874113710 con 0x7f1874109b90 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f187a82c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1874113a10 con 0x7f1874103900 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60252/0 (socket says 172.21.15.2:60252) 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 -- 172.21.15.2:0/2917031042 learned_addr learned my addr 172.21.15.2:0/2917031042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f1873fff640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f18740754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f1878dc9640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109b90 0x7f1874075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 -- 172.21.15.2:0/2917031042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 msgr2=0x7f18740754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f18740754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 -- 172.21.15.2:0/2917031042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109b90 msgr2=0x7f1874075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109b90 0x7f1874075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 -- 172.21.15.2:0/2917031042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18741a8520 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f1873fff640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f18740754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18737fe640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1868006fd0 tx=0x7f186800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868011830 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1868016070 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18741a8810 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868010e00 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.707+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18741a8dd0 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.708+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1874103d10 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.710+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f186801b460 con 0x7f1874109240 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.711+0000 7f18717fa640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 0x7f185c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.711+0000 7f1873fff640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 0x7f185c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.711+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7f18680e4d40 con 0x7f1874109240 2024-08-31T04:22:57.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.711+0000 7f1873fff640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 0x7f185c0b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1864005fd0 tx=0x7f1864005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:57.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.714+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18680abf50 con 0x7f1874109240 2024-08-31T04:22:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:57.943+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f18740767b0 con 0x7f1874109240 2024-08-31T04:22:58.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.227+0000 7f18717fa640 1 -- 172.21.15.2:0/2917031042 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f18740767b0 con 0x7f1874109240 2024-08-31T04:22:58.229 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 msgr2=0x7f185c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 0x7f185c0b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1864005fd0 tx=0x7f1864005ec0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 msgr2=0x7f18740759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1868006fd0 tx=0x7f186800b8e0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 shutdown_connections 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f185c0b4b80 0x7f185c0b7090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1874109240 0x7f18740759f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1874109b90 0x7f1874075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 --2- 172.21.15.2:0/2917031042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1874103900 0x7f18740754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:58.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 >> 172.21.15.2:0/2917031042 conn(0x7f187407b5f0 msgr2=0x7f1874107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:58.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 shutdown_connections 2024-08-31T04:22:58.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:58.230+0000 7f187a82c640 1 -- 172.21.15.2:0/2917031042 wait complete. 2024-08-31T04:22:58.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:58 smithi002 ceph-mon[18656]: pgmap v253: 97 pgs: 22 active+clean, 28 creating+peering, 47 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:58.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:58 smithi002 ceph-mon[18656]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:22:58.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:58 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:22:58.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:58 smithi002 ceph-mon[18656]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:22:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:58 smithi064 ceph-mon[22007]: pgmap v253: 97 pgs: 22 active+clean, 28 creating+peering, 47 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:58 smithi064 ceph-mon[22007]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:22:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:58 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:22:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:58 smithi064 ceph-mon[22007]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:22:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:58 smithi132 ceph-mon[22335]: pgmap v253: 97 pgs: 22 active+clean, 28 creating+peering, 47 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:22:58.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:58 smithi132 ceph-mon[22335]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:22:58.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:58 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:22:58.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:58 smithi132 ceph-mon[22335]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:22:58.901 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-31T04:22:58.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-31T04:22:59.161 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:59.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:59 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:22:59.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:59 smithi002 ceph-mon[18656]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:22:59.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:59 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:22:59.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:22:59 smithi002 ceph-mon[18656]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:22:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:59 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:22:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:59 smithi064 ceph-mon[22007]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:22:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:59 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:22:59.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:22:59 smithi064 ceph-mon[22007]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:22:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:59 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2917031042' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:22:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:59 smithi132 ceph-mon[22335]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:22:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:59 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:22:59.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:22:59 smithi132 ceph-mon[22335]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:22:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.739+0000 7f8808d52640 1 -- 172.21.15.2:0/2535609146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8804102880 msgr2=0x7f8804102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.739+0000 7f8808d52640 1 --2- 172.21.15.2:0/2535609146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8804102880 0x7f8804102c90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009900 tx=0x7f87f402a410 comp rx=0 tx=0).stop 2024-08-31T04:22:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 -- 172.21.15.2:0/2535609146 shutdown_connections 2024-08-31T04:22:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 --2- 172.21.15.2:0/2535609146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 0x7f880410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 --2- 172.21.15.2:0/2535609146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88041081c0 0x7f88041085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 --2- 172.21.15.2:0/2535609146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8804102880 0x7f8804102c90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 -- 172.21.15.2:0/2535609146 >> 172.21.15.2:0/2535609146 conn(0x7f8804079510 msgr2=0x7f8804079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 -- 172.21.15.2:0/2535609146 shutdown_connections 2024-08-31T04:22:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 -- 172.21.15.2:0/2535609146 wait complete. 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.740+0000 7f8808d52640 1 Processor -- start 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 -- start start 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8804102880 0x7f8804198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 0x7f8804199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88041127e0 con 0x7f88041081c0 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8804112660 con 0x7f8804108b10 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8808d52640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8804112960 con 0x7f8804102880 2024-08-31T04:22:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60262/0 (socket says 172.21.15.2:60262) 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 -- 172.21.15.2:0/837353728 learned_addr learned my addr 172.21.15.2:0/837353728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8802d9d640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 0x7f8804199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f880259c640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8804102880 0x7f8804198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 -- 172.21.15.2:0/837353728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8804102880 msgr2=0x7f8804198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8804102880 0x7f8804198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 -- 172.21.15.2:0/837353728 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 msgr2=0x7f8804199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 0x7f8804199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 -- 172.21.15.2:0/837353728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88041a8570 con 0x7f88041081c0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.741+0000 7f8801d9b640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d750 tx=0x7f87f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.742+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8017070 con 0x7f88041081c0 2024-08-31T04:22:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.742+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88041a8860 con 0x7f88041081c0 2024-08-31T04:22:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.742+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f80054d0 con 0x7f88041081c0 2024-08-31T04:22:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.742+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8004c30 con 0x7f88041081c0 2024-08-31T04:22:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.742+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041a8d50 con 0x7f88041081c0 2024-08-31T04:22:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.743+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8804103b00 con 0x7f88041081c0 2024-08-31T04:22:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.745+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f87f8004dd0 con 0x7f88041081c0 2024-08-31T04:22:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.745+0000 7f87f37fe640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 0x7f87ec0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.745+0000 7f880259c640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 0x7f87ec0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.745+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f87f80e4ff0 con 0x7f88041081c0 2024-08-31T04:22:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.746+0000 7f880259c640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 0x7f87ec0b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000c00 tx=0x7f87f4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.749+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f87f80ac140 con 0x7f88041081c0 2024-08-31T04:22:59.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:22:59.942+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f8804102c90 con 0x7f88041081c0 2024-08-31T04:23:00.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.248+0000 7f87f37fe640 1 -- 172.21.15.2:0/837353728 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v76) ==== 157+0+0 (secure 0 0 0) 0x7f87f80ce070 con 0x7f88041081c0 2024-08-31T04:23:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 msgr2=0x7f87ec0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 0x7f87ec0b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000c00 tx=0x7f87f4031400 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 msgr2=0x7f8804199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d750 tx=0x7f87f800dc10 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 shutdown_connections 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87ec0b4b80 0x7f87ec0b7090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88041081c0 0x7f8804199400 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8804108b10 0x7f8804199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 --2- 172.21.15.2:0/837353728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8804102880 0x7f8804198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 >> 172.21.15.2:0/837353728 conn(0x7f8804079510 msgr2=0x7f8804106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 shutdown_connections 2024-08-31T04:23:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:00.251+0000 7f8808d52640 1 -- 172.21.15.2:0/837353728 wait complete. 2024-08-31T04:23:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: pgmap v256: 97 pgs: 30 active+clean, 35 creating+peering, 32 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:23:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:23:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:active 2024-08-31T04:23:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:00 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: pgmap v256: 97 pgs: 30 active+clean, 35 creating+peering, 32 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:active 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:00 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T04:23:00.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: pgmap v256: 97 pgs: 30 active+clean, 35 creating+peering, 32 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:00.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:23:00.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:23:00.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] up:active 2024-08-31T04:23:00.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:00.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:00 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T04:23:00.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T04:23:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:01 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T04:23:01.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:01 smithi064 ceph-mon[22007]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:23:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:01 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T04:23:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:01 smithi132 ceph-mon[22335]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:23:01.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:01 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/837353728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T04:23:01.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:01 smithi002 ceph-mon[18656]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 -- 172.21.15.2:0/3235072024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36781088d0 msgr2=0x7f367810f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3235072024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36781088d0 0x7f367810f100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3670009ca0 tx=0x7f367002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 -- 172.21.15.2:0/3235072024 shutdown_connections 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3235072024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36781088d0 0x7f367810f100 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3235072024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678107f80 0x7f3678108390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3235072024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3678102640 0x7f3678102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 -- 172.21.15.2:0/3235072024 >> 172.21.15.2:0/3235072024 conn(0x7f36780fe0d0 msgr2=0x7f3678100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 -- 172.21.15.2:0/3235072024 shutdown_connections 2024-08-31T04:23:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.870+0000 7f367cf9e640 1 -- 172.21.15.2:0/3235072024 wait complete. 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 Processor -- start 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 -- start start 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678102640 0x7f367810fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 0x7f3678110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36781136b0 con 0x7f3678107f80 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113530 con 0x7f36781088d0 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f367cf9e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113830 con 0x7f3678102640 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60282/0 (socket says 172.21.15.2:60282) 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 -- 172.21.15.2:0/3762052695 learned_addr learned my addr 172.21.15.2:0/3762052695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f36777fe640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678102640 0x7f367810fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3677fff640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 0x7f3678110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 -- 172.21.15.2:0/3762052695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678102640 msgr2=0x7f367810fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678102640 0x7f367810fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 -- 172.21.15.2:0/3762052695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 msgr2=0x7f3678110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 0x7f3678110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.871+0000 7f3676ffd640 1 -- 172.21.15.2:0/3762052695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36781a81f0 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f3677fff640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 0x7f3678110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f3676ffd640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c8c0 tx=0x7f366c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c007bb0 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f366c007d50 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36781a84e0 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0187c0 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.872+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781a8a20 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.873+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36781038c0 con 0x7f3678107f80 2024-08-31T04:23:01.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.875+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f366c00fa20 con 0x7f3678107f80 2024-08-31T04:23:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.875+0000 7f3674ff9640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 0x7f36600b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.875+0000 7f36777fe640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 0x7f36600b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.875+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8492+0+0 (secure 0 0 0) 0x7f366c0e56a0 con 0x7f3678107f80 2024-08-31T04:23:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.876+0000 7f36777fe640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 0x7f36600b7080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3678111630 tx=0x7f366800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:01.879+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f366c014030 con 0x7f3678107f80 2024-08-31T04:23:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:02.064+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3678102a50 con 0x7f3678107f80 2024-08-31T04:23:02.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:02 smithi064 ceph-mon[22007]: pgmap v258: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-08-31T04:23:02.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:02 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:23:02.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:02 smithi132 ceph-mon[22335]: pgmap v258: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-08-31T04:23:02.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:02 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:23:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:02 smithi002 ceph-mon[18656]: pgmap v258: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-08-31T04:23:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:02 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:23:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.259+0000 7f3674ff9640 1 -- 172.21.15.2:0/3762052695 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v78) ==== 228+0+0 (secure 0 0 0) 0x7f366c0ac760 con 0x7f3678107f80 2024-08-31T04:23:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' created 2024-08-31T04:23:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 msgr2=0x7f36600b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 0x7f36600b7080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3678111630 tx=0x7f366800b390 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 msgr2=0x7f3678110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c8c0 tx=0x7f366c00cd80 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 shutdown_connections 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f36600b4b70 0x7f36600b7080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3678107f80 0x7f3678110120 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36781088d0 0x7f3678110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 --2- 172.21.15.2:0/3762052695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3678102640 0x7f367810fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 >> 172.21.15.2:0/3762052695 conn(0x7f36780fe0d0 msgr2=0x7f36781004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 shutdown_connections 2024-08-31T04:23:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:03.263+0000 7f367cf9e640 1 -- 172.21.15.2:0/3762052695 wait complete. 2024-08-31T04:23:03.282 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:23:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: 2024-08-31T04:23:02.875+0000 7f181c79b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:03 smithi064 ceph-mon[22007]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:03 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:03 smithi064 ceph-mon[22007]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:03 smithi132 ceph-mon[22335]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:03 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:23:03.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:03 smithi132 ceph-mon[22335]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:23:03.593 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:03 smithi002 ceph-mon[18656]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:23:03.593 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3762052695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:23:03.593 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:03 smithi002 ceph-mon[18656]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:23:03.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-31T04:23:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:04.565 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:04 smithi002 ceph-mon[18656]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-31T04:23:04.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:04 smithi002 ceph-mon[18656]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:23:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:04 smithi064 ceph-mon[22007]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-31T04:23:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:04 smithi064 ceph-mon[22007]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:23:04.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:04 smithi132 ceph-mon[22335]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-31T04:23:04.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:04 smithi132 ceph-mon[22335]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 -- 172.21.15.2:0/409251158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c103900 msgr2=0x7fa10c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 --2- 172.21.15.2:0/409251158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c103900 0x7fa10c103d10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009900 tx=0x7fa0fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 -- 172.21.15.2:0/409251158 shutdown_connections 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 --2- 172.21.15.2:0/409251158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c109b90 0x7fa10c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 --2- 172.21.15.2:0/409251158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109240 0x7fa10c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 --2- 172.21.15.2:0/409251158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c103900 0x7fa10c103d10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 -- 172.21.15.2:0/409251158 >> 172.21.15.2:0/409251158 conn(0x7fa10c07b5f0 msgr2=0x7fa10c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 -- 172.21.15.2:0/409251158 shutdown_connections 2024-08-31T04:23:04.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.658+0000 7fa112627640 1 -- 172.21.15.2:0/409251158 wait complete. 2024-08-31T04:23:04.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 Processor -- start 2024-08-31T04:23:04.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 -- start start 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c103900 0x7fa10c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109b90 0x7fa10c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c113850 con 0x7fa10c109240 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1136d0 con 0x7fa10c103900 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa112627640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1139d0 con 0x7fa10c109b90 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa103fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa103fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60304/0 (socket says 172.21.15.2:60304) 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa103fff640 1 -- 172.21.15.2:0/1214720947 learned_addr learned my addr 172.21.15.2:0/1214720947 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.659+0000 7fa10bfff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c103900 0x7fa10c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa110bc4640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109b90 0x7fa10c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 -- 172.21.15.2:0/1214720947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109b90 msgr2=0x7fa10c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109b90 0x7fa10c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 -- 172.21.15.2:0/1214720947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c103900 msgr2=0x7fa10c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c103900 0x7fa10c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 -- 172.21.15.2:0/1214720947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c1a01b0 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa103fff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d950 tx=0x7fa0f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0f4009c30 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40047a0 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c1a04a0 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.660+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c1a6c00 con 0x7fa10c109240 2024-08-31T04:23:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.661+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c103d10 con 0x7fa10c109240 2024-08-31T04:23:04.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.663+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fa0f4004020 con 0x7fa10c109240 2024-08-31T04:23:04.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.663+0000 7fa109ffb640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 0x7fa0f80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.663+0000 7fa10bfff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 0x7fa0f80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.664+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8985+0+0 (secure 0 0 0) 0x7fa0f40e50f0 con 0x7fa10c109240 2024-08-31T04:23:04.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.664+0000 7fa10bfff640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 0x7fa0f80b7110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc031440 tx=0x7fa0fc009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:04.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.668+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0f4020020 con 0x7fa10c109240 2024-08-31T04:23:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:04.853+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa10c10b960 con 0x7fa10c109240 2024-08-31T04:23:05.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.262+0000 7fa109ffb640 1 -- 172.21.15.2:0/1214720947 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v80) ==== 169+0+0 (secure 0 0 0) 0x7fa0f40abf30 con 0x7fa10c109240 2024-08-31T04:23:05.264 INFO:teuthology.orchestra.run.smithi002.stderr:set pool 4 allow_ec_overwrites to true 2024-08-31T04:23:05.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 msgr2=0x7fa0f80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 0x7fa0f80b7110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc031440 tx=0x7fa0fc009560 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 msgr2=0x7fa10c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d950 tx=0x7fa0f400de10 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 shutdown_connections 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0f80b4c00 0x7fa0f80b7110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c109240 0x7fa10c19a7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa10c109b90 0x7fa10c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 --2- 172.21.15.2:0/1214720947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa10c103900 0x7fa10c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 >> 172.21.15.2:0/1214720947 conn(0x7fa10c07b5f0 msgr2=0x7fa10c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 shutdown_connections 2024-08-31T04:23:05.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:05.265+0000 7fa112627640 1 -- 172.21.15.2:0/1214720947 wait complete. 2024-08-31T04:23:05.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:05 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T04:23:05.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:05 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T04:23:05.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:05 smithi002 ceph-mon[18656]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:23:05.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:05 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T04:23:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:05 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T04:23:05.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:05 smithi064 ceph-mon[22007]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:23:05.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:05 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T04:23:05.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:05 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1214720947' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T04:23:05.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:05 smithi132 ceph-mon[22335]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:23:05.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-31T04:23:06.189 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:06.565 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:06 smithi002 ceph-mon[18656]: pgmap v263: 129 pgs: 3 creating+peering, 27 unknown, 99 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T04:23:06.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:06 smithi002 ceph-mon[18656]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:23:06.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:06 smithi064 ceph-mon[22007]: pgmap v263: 129 pgs: 3 creating+peering, 27 unknown, 99 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T04:23:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:06 smithi064 ceph-mon[22007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:23:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:06 smithi132 ceph-mon[22335]: pgmap v263: 129 pgs: 3 creating+peering, 27 unknown, 99 active+clean; 579 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T04:23:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:06 smithi132 ceph-mon[22335]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:23:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.744+0000 7f0706756640 1 -- 172.21.15.2:0/548893435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700102820 msgr2=0x7f0700102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 --2- 172.21.15.2:0/548893435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700102820 0x7f0700102c30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009900 tx=0x7f06f002a410 comp rx=0 tx=0).stop 2024-08-31T04:23:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 -- 172.21.15.2:0/548893435 shutdown_connections 2024-08-31T04:23:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 --2- 172.21.15.2:0/548893435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700108ab0 0x7f070010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 --2- 172.21.15.2:0/548893435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108160 0x7f0700108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 --2- 172.21.15.2:0/548893435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700102820 0x7f0700102c30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 -- 172.21.15.2:0/548893435 >> 172.21.15.2:0/548893435 conn(0x7f07000794e0 msgr2=0x7f07000798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 -- 172.21.15.2:0/548893435 shutdown_connections 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 -- 172.21.15.2:0/548893435 wait complete. 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 Processor -- start 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.745+0000 7f0706756640 1 -- start start 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700102820 0x7f0700104010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 0x7f0700104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0700112730 con 0x7f0700108160 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f07001125b0 con 0x7f0700102820 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0706756640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f07001128b0 con 0x7f0700108ab0 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37642/0 (socket says 172.21.15.2:37642) 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 -- 172.21.15.2:0/7442381 learned_addr learned my addr 172.21.15.2:0/7442381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06fffff640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700102820 0x7f0700104010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0704cf3640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 0x7f0700104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 -- 172.21.15.2:0/7442381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 msgr2=0x7f0700104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 0x7f0700104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 -- 172.21.15.2:0/7442381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700102820 msgr2=0x7f0700104010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700102820 0x7f0700104010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 -- 172.21.15.2:0/7442381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07001a84f0 con 0x7f0700108160 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f0704cf3640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 0x7f0700104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.746+0000 7f06ff7fe640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06f400d740 tx=0x7f06f400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.747+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4017070 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.747+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f400de50 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.747+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4004ce0 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.747+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07001a87e0 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.747+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07001a8d20 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.748+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0700103aa0 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.749+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f06f4004e80 con 0x7f0700108160 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.750+0000 7f06fd7fa640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 0x7f06e80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.750+0000 7f06fffff640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 0x7f06e80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.750+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8985+0+0 (secure 0 0 0) 0x7f06f40e5280 con 0x7f0700108160 2024-08-31T04:23:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.750+0000 7f06fffff640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 0x7f06e80b7110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.753+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06f40ac140 con 0x7f0700108160 2024-08-31T04:23:06.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:06.978+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f07001a9060 con 0x7f0700108160 2024-08-31T04:23:07.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.295+0000 7f06fd7fa640 1 -- 172.21.15.2:0/7442381 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f06f40aba40 con 0x7f0700108160 2024-08-31T04:23:07.296 INFO:teuthology.orchestra.run.smithi002.stderr:added data pool 4 to fsmap 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 msgr2=0x7f06e80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 0x7f06e80b7110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0031400 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 msgr2=0x7f0700104550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06f400d740 tx=0x7f06f400dc00 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 shutdown_connections 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f06e80b4c00 0x7f06e80b7110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0700108160 0x7f0700104550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0700108ab0 0x7f0700104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 --2- 172.21.15.2:0/7442381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0700102820 0x7f0700104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 >> 172.21.15.2:0/7442381 conn(0x7f07000794e0 msgr2=0x7f0700101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 shutdown_connections 2024-08-31T04:23:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:07.297+0000 7f0706756640 1 -- 172.21.15.2:0/7442381 wait complete. 2024-08-31T04:23:07.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:07 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T04:23:07.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:07 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T04:23:07.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:07 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T04:23:07.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:08 smithi064 ceph-mon[22007]: pgmap v265: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:08 smithi064 ceph-mon[22007]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:23:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:08 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T04:23:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:08 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:08.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:08 smithi132 ceph-mon[22335]: pgmap v265: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:08.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:08 smithi132 ceph-mon[22335]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:23:08.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:08 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T04:23:08.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:08 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:08 smithi002 ceph-mon[18656]: pgmap v265: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:08 smithi002 ceph-mon[18656]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:23:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:08 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/7442381' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T04:23:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:08 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 -- 172.21.15.2:0/2482350604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 msgr2=0x7f87f01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 --2- 172.21.15.2:0/2482350604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f01100a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009ca0 tx=0x7f87e802a8e0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 -- 172.21.15.2:0/2482350604 shutdown_connections 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 --2- 172.21.15.2:0/2482350604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f01100a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 --2- 172.21.15.2:0/2482350604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f01050a0 0x7f87f010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 --2- 172.21.15.2:0/2482350604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f0104750 0x7f87f0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 -- 172.21.15.2:0/2482350604 >> 172.21.15.2:0/2482350604 conn(0x7f87f00794d0 msgr2=0x7f87f00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 -- 172.21.15.2:0/2482350604 shutdown_connections 2024-08-31T04:23:08.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.800+0000 7f87f6913640 1 -- 172.21.15.2:0/2482350604 wait complete. 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 Processor -- start 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 -- start start 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f0104750 0x7f87f0102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f01050a0 0x7f87f01029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0113870 con 0x7f87f010dbb0 2024-08-31T04:23:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01136f0 con 0x7f87f01050a0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f6913640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01139f0 con 0x7f87f0104750 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f4eb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f4eb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37654/0 (socket says 172.21.15.2:37654) 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.801+0000 7f87f4eb0640 1 -- 172.21.15.2:0/3585523256 learned_addr learned my addr 172.21.15.2:0/3585523256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87ef7fe640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f01050a0 0x7f87f01029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87effff640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f0104750 0x7f87f0102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 -- 172.21.15.2:0/3585523256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f0104750 msgr2=0x7f87f0102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f0104750 0x7f87f0102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 -- 172.21.15.2:0/3585523256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f01050a0 msgr2=0x7f87f01029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f01050a0 0x7f87f01029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 -- 172.21.15.2:0/3585523256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01a8640 con 0x7f87f010dbb0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f4eb0640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005cc0 tx=0x7f87e80039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8003de0 con 0x7f87f010dbb0 2024-08-31T04:23:08.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87e80044f0 con 0x7f87f010dbb0 2024-08-31T04:23:08.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01a88d0 con 0x7f87f010dbb0 2024-08-31T04:23:08.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8030cb0 con 0x7f87f010dbb0 2024-08-31T04:23:08.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.802+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01a8e10 con 0x7f87f010dbb0 2024-08-31T04:23:08.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.804+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0104b60 con 0x7f87f010dbb0 2024-08-31T04:23:08.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.805+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f87e8004040 con 0x7f87f010dbb0 2024-08-31T04:23:08.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.805+0000 7f87ed7fa640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 0x7f87d80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.806+0000 7f87effff640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 0x7f87d80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.806+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f87e8106860 con 0x7f87f010dbb0 2024-08-31T04:23:08.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.806+0000 7f87effff640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 0x7f87d80b7090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87f0103ee0 tx=0x7f87e000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:08.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:08.810+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f87e80cd680 con 0x7f87f010dbb0 2024-08-31T04:23:09.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.032+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87f002e430 con 0x7f87f010dbb0 2024-08-31T04:23:09.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.032+0000 7f87ed7fa640 1 -- 172.21.15.2:0/3585523256 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7f87e80ccf80 con 0x7f87f010dbb0 2024-08-31T04:23:09.034 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:09.034 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"btime":"2024-08-31T04:23:07:288545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:06.979633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-08-31T04:23:09.034 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-31T04:23:09.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 msgr2=0x7f87d80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 0x7f87d80b7090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87f0103ee0 tx=0x7f87e000b390 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 msgr2=0x7f87f0102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005cc0 tx=0x7f87e80039f0 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 shutdown_connections 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f87d80b4b80 0x7f87d80b7090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f010dbb0 0x7f87f0102f10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87f01050a0 0x7f87f01029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 --2- 172.21.15.2:0/3585523256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f0104750 0x7f87f0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 >> 172.21.15.2:0/3585523256 conn(0x7f87f00794d0 msgr2=0x7f87f00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 shutdown_connections 2024-08-31T04:23:09.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:09.035+0000 7f87f6913640 1 -- 172.21.15.2:0/3585523256 wait complete. 2024-08-31T04:23:09.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:09 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3585523256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:09.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:09 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3585523256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:09.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:09 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3585523256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:09.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:10.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:10 smithi002 ceph-mon[18656]: pgmap v267: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:10.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:10 smithi002 ceph-mon[18656]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T04:23:10.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:10 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 -- 172.21.15.2:0/837471077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc103900 msgr2=0x7f77fc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 --2- 172.21.15.2:0/837471077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc103900 0x7f77fc103d10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 -- 172.21.15.2:0/837471077 shutdown_connections 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 --2- 172.21.15.2:0/837471077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109b90 0x7f77fc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 --2- 172.21.15.2:0/837471077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc109240 0x7f77fc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 --2- 172.21.15.2:0/837471077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc103900 0x7f77fc103d10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 -- 172.21.15.2:0/837471077 >> 172.21.15.2:0/837471077 conn(0x7f77fc07b5f0 msgr2=0x7f77fc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 -- 172.21.15.2:0/837471077 shutdown_connections 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.469+0000 7f7800e1d640 1 -- 172.21.15.2:0/837471077 wait complete. 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 Processor -- start 2024-08-31T04:23:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 -- start start 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc103900 0x7f77fc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109240 0x7f77fc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc113850 con 0x7f77fc109b90 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1136d0 con 0x7f77fc109240 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f7800e1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1139d0 con 0x7f77fc103900 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37676/0 (socket says 172.21.15.2:37676) 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f77fad9d640 1 -- 172.21.15.2:0/667822144 learned_addr learned my addr 172.21.15.2:0/667822144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.470+0000 7f77fa59c640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc103900 0x7f77fc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77f9d9b640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109240 0x7f77fc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 -- 172.21.15.2:0/667822144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc103900 msgr2=0x7f77fc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc103900 0x7f77fc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 -- 172.21.15.2:0/667822144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109240 msgr2=0x7f77fc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109240 0x7f77fc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 -- 172.21.15.2:0/667822144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc1a01b0 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77fad9d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77f400eaa0 tx=0x7f77f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f400cdb0 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f4005020 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc1a04a0 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f40116d0 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.471+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc1a6c00 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.472+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc103d10 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.474+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f77f40051d0 con 0x7f77fc109b90 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.474+0000 7f77eb7fe640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 0x7f77e40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.474+0000 7f77fa59c640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 0x7f77e40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.474+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f77f40e5700 con 0x7f77fc109b90 2024-08-31T04:23:10.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.475+0000 7f77fa59c640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 0x7f77e40b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77ec031440 tx=0x7f77ec009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:10.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.479+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f77f4016030 con 0x7f77fc109b90 2024-08-31T04:23:10.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:10 smithi064 ceph-mon[22007]: pgmap v267: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:10.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:10 smithi064 ceph-mon[22007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T04:23:10.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:10 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:23:10.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:10 smithi132 ceph-mon[22335]: pgmap v267: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:10.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:10 smithi132 ceph-mon[22335]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T04:23:10.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:10 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:23:10.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.664+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77fc10b3d0 con 0x7f77fc109b90 2024-08-31T04:23:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.666+0000 7f77eb7fe640 1 -- 172.21.15.2:0/667822144 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24437 (secure 0 0 0) 0x7f77f40ac4c0 con 0x7f77fc109b90 2024-08-31T04:23:10.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:10.668 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:06.979485+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 msgr2=0x7f77e40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 0x7f77e40b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77ec031440 tx=0x7f77ec009560 comp rx=0 tx=0).stop 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 msgr2=0x7f77fc19fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77f400eaa0 tx=0x7f77f400ef60 comp rx=0 tx=0).stop 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 shutdown_connections 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77e40b4b80 0x7f77e40b7090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc109b90 0x7f77fc19fa80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77fc109240 0x7f77fc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 --2- 172.21.15.2:0/667822144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77fc103900 0x7f77fc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.668+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 >> 172.21.15.2:0/667822144 conn(0x7f77fc07b5f0 msgr2=0x7f77fc1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:10.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.669+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 shutdown_connections 2024-08-31T04:23:10.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:10.669+0000 7f7800e1d640 1 -- 172.21.15.2:0/667822144 wait complete. 2024-08-31T04:23:11.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:11.566 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:11.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/667822144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:11.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/667822144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:11.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/667822144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 -- 172.21.15.2:0/3895931408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc634109310 msgr2=0x7fc634109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 --2- 172.21.15.2:0/3895931408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc634109310 0x7fc634109720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc624009900 tx=0x7fc62402a410 comp rx=0 tx=0).stop 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 -- 172.21.15.2:0/3895931408 shutdown_connections 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 --2- 172.21.15.2:0/3895931408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc634109310 0x7fc634109720 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 --2- 172.21.15.2:0/3895931408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109c60 0x7fc634110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 --2- 172.21.15.2:0/3895931408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6341039d0 0x7fc634103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 -- 172.21.15.2:0/3895931408 >> 172.21.15.2:0/3895931408 conn(0x7fc63407b670 msgr2=0x7fc63407ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 -- 172.21.15.2:0/3895931408 shutdown_connections 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.069+0000 7fc63b738640 1 -- 172.21.15.2:0/3895931408 wait complete. 2024-08-31T04:23:12.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 Processor -- start 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 -- start start 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109310 0x7fc63419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 0x7fc63419faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc634113880 con 0x7fc6341039d0 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc634113700 con 0x7fc634109c60 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc63b738640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc634113a00 con 0x7fc634109310 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc6394d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc6394d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37698/0 (socket says 172.21.15.2:37698) 2024-08-31T04:23:12.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.070+0000 7fc6394d4640 1 -- 172.21.15.2:0/3279257135 learned_addr learned my addr 172.21.15.2:0/3279257135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc638cd3640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109310 0x7fc63419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc639cd5640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 0x7fc63419faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 -- 172.21.15.2:0/3279257135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109310 msgr2=0x7fc63419a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109310 0x7fc63419a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 -- 172.21.15.2:0/3279257135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 msgr2=0x7fc63419faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 0x7fc63419faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 -- 172.21.15.2:0/3279257135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6341a0220 con 0x7fc6341039d0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc639cd5640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 0x7fc63419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc6394d4640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d950 tx=0x7fc63000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630017070 con 0x7fc6341039d0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6341a0510 con 0x7fc6341039d0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc630009c30 con 0x7fc6341039d0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63000f620 con 0x7fc6341039d0 2024-08-31T04:23:12.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.071+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6341a6c70 con 0x7fc6341039d0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.072+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc634103de0 con 0x7fc6341039d0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.074+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fc630005030 con 0x7fc6341039d0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.074+0000 7fc62a7fc640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 0x7fc6200b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.075+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7fc6300e5110 con 0x7fc6341039d0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.075+0000 7fc638cd3640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 0x7fc6200b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.075+0000 7fc638cd3640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 0x7fc6200b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc624009230 tx=0x7fc624031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:12.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.078+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc6300abfb0 con 0x7fc6341039d0 2024-08-31T04:23:12.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.263+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc63419b3e0 con 0x7fc6341039d0 2024-08-31T04:23:12.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.264+0000 7fc62a7fc640 1 -- 172.21.15.2:0/3279257135 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24437 (secure 0 0 0) 0x7fc630009de0 con 0x7fc6341039d0 2024-08-31T04:23:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:12.266 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:06.979485+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.266+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 msgr2=0x7fc6200b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.266+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 0x7fc6200b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc624009230 tx=0x7fc624031400 comp rx=0 tx=0).stop 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.266+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 msgr2=0x7fc63419a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.266+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d950 tx=0x7fc63000de10 comp rx=0 tx=0).stop 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 shutdown_connections 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc634109c60 0x7fc63419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634109310 0x7fc63419a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc6200b4c00 0x7fc6200b7110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 --2- 172.21.15.2:0/3279257135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6341039d0 0x7fc63419a2b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 >> 172.21.15.2:0/3279257135 conn(0x7fc63407b670 msgr2=0x7fc6341053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:12.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 shutdown_connections 2024-08-31T04:23:12.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:12.267+0000 7fc63b738640 1 -- 172.21.15.2:0/3279257135 wait complete. 2024-08-31T04:23:12.576 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:12 smithi002 ceph-mon[18656]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:12.576 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:12 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3279257135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:12 smithi064 ceph-mon[22007]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:12 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3279257135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:12 smithi132 ceph-mon[22335]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:12 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3279257135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:12.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 -- 172.21.15.2:0/263196260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075ea0 msgr2=0x7fe90810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/263196260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075ea0 0x7fe90810f920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009900 tx=0x7fe8f802a410 comp rx=0 tx=0).stop 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 -- 172.21.15.2:0/263196260 shutdown_connections 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/263196260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075ea0 0x7fe90810f920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/263196260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe90810fe60 0x7fe9081122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/263196260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe908075550 0x7fe908075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 -- 172.21.15.2:0/263196260 >> 172.21.15.2:0/263196260 conn(0x7fe90807b5f0 msgr2=0x7fe90807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 -- 172.21.15.2:0/263196260 shutdown_connections 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.663+0000 7fe90fe5f640 1 -- 172.21.15.2:0/263196260 wait complete. 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 Processor -- start 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 -- start start 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe908075ea0 0x7fe90819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe90810fe60 0x7fe9081a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115a10 con 0x7fe908075550 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115890 con 0x7fe90810fe60 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.664+0000 7fe90fe5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115b90 con 0x7fe908075ea0 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37718/0 (socket says 172.21.15.2:37718) 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 -- 172.21.15.2:0/1325827549 learned_addr learned my addr 172.21.15.2:0/1325827549 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90d3fa640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe908075ea0 0x7fe90819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90e3fc640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe90810fe60 0x7fe9081a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 -- 172.21.15.2:0/1325827549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe908075ea0 msgr2=0x7fe90819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe908075ea0 0x7fe90819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 -- 172.21.15.2:0/1325827549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe90810fe60 msgr2=0x7fe9081a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe90810fe60 0x7fe9081a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 -- 172.21.15.2:0/1325827549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a2370 con 0x7fe908075550 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90dbfb640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d950 tx=0x7fe90400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904017070 con 0x7fe908075550 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe904009c30 con 0x7fe908075550 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a2660 con 0x7fe908075550 2024-08-31T04:23:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90400f620 con 0x7fe908075550 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.665+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081a8dc0 con 0x7fe908075550 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.666+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe908075960 con 0x7fe908075550 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.669+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fe904005030 con 0x7fe908075550 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.669+0000 7fe8feffd640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 0x7fe8f40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.670+0000 7fe90d3fa640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 0x7fe8f40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.670+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7fe9040e5070 con 0x7fe908075550 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.670+0000 7fe90d3fa640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 0x7fe8f40b7110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000c00 tx=0x7fe8f8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.673+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe9040abf10 con 0x7fe908075550 2024-08-31T04:23:13.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.895+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe90819d530 con 0x7fe908075550 2024-08-31T04:23:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"btime":"2024-08-31T04:23:07:288545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:06.979633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-08-31T04:23:13.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.896+0000 7fe8feffd640 1 -- 172.21.15.2:0/1325827549 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7fe904009de0 con 0x7fe908075550 2024-08-31T04:23:13.898 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-31T04:23:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 msgr2=0x7fe8f40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 0x7fe8f40b7110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000c00 tx=0x7fe8f8031400 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 msgr2=0x7fe90819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d950 tx=0x7fe90400de10 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 shutdown_connections 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe90810fe60 0x7fe9081a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe908075ea0 0x7fe90819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe8f40b4c00 0x7fe8f40b7110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 --2- 172.21.15.2:0/1325827549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe908075550 0x7fe90819c400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 >> 172.21.15.2:0/1325827549 conn(0x7fe90807b5f0 msgr2=0x7fe9081016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 shutdown_connections 2024-08-31T04:23:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:13.898+0000 7fe90fe5f640 1 -- 172.21.15.2:0/1325827549 wait complete. 2024-08-31T04:23:14.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:14.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:14 smithi132 ceph-mon[22335]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:14.620 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:14 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1325827549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:14 smithi002 ceph-mon[18656]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:14 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1325827549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:14.785 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:14 smithi064 ceph-mon[22007]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T04:23:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:14 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1325827549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 -- 172.21.15.2:0/2400835559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5841081c0 msgr2=0x7fe5841085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/2400835559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5841081c0 0x7fe5841085d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009900 tx=0x7fe56c02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 -- 172.21.15.2:0/2400835559 shutdown_connections 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/2400835559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5841081c0 0x7fe5841085d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/2400835559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584108b10 0x7fe58410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/2400835559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe584102880 0x7fe584102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 -- 172.21.15.2:0/2400835559 >> 172.21.15.2:0/2400835559 conn(0x7fe584079510 msgr2=0x7fe584079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 -- 172.21.15.2:0/2400835559 shutdown_connections 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.232+0000 7fe58a7c3640 1 -- 172.21.15.2:0/2400835559 wait complete. 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 Processor -- start 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 -- start start 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5841081c0 0x7fe584199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe584112780 con 0x7fe584108b10 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe584112600 con 0x7fe584102880 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe58a7c3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe584112900 con 0x7fe5841081c0 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe588d60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe583fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe583fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40118/0 (socket says 172.21.15.2:40118) 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe588d60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37736/0 (socket says 172.21.15.2:37736) 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe583fff640 1 -- 172.21.15.2:0/1206576089 learned_addr learned my addr 172.21.15.2:0/1206576089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe57bfff640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5841081c0 0x7fe584199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe588d60640 1 -- 172.21.15.2:0/1206576089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5841081c0 msgr2=0x7fe584199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe588d60640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5841081c0 0x7fe584199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.233+0000 7fe588d60640 1 -- 172.21.15.2:0/1206576089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 msgr2=0x7fe584199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe588d60640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe588d60640 1 -- 172.21.15.2:0/1206576089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58419f040 con 0x7fe584108b10 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe583fff640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe588d60640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00e940 tx=0x7fe57c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c004d20 con 0x7fe584108b10 2024-08-31T04:23:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c005020 con 0x7fe584108b10 2024-08-31T04:23:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58419f330 con 0x7fe584108b10 2024-08-31T04:23:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0116d0 con 0x7fe584108b10 2024-08-31T04:23:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.234+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58419f7f0 con 0x7fe584108b10 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.235+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe584103b00 con 0x7fe584108b10 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.237+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fe57c005460 con 0x7fe584108b10 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.237+0000 7fe581ffb640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 0x7fe5700b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.237+0000 7fe583fff640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 0x7fe5700b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.237+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7fe57c0e55a0 con 0x7fe584108b10 2024-08-31T04:23:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.238+0000 7fe583fff640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 0x7fe5700b70c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe57400f4d0 tx=0x7fe57400a380 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:15.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.242+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe57c016030 con 0x7fe584108b10 2024-08-31T04:23:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.429+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe58410a390 con 0x7fe584108b10 2024-08-31T04:23:15.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.430+0000 7fe581ffb640 1 -- 172.21.15.2:0/1206576089 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24437 (secure 0 0 0) 0x7fe57c0ac3c0 con 0x7fe584108b10 2024-08-31T04:23:15.432 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:15.432 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:06.979485+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.432+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 msgr2=0x7fe5700b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.432+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 0x7fe5700b70c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe57400f4d0 tx=0x7fe57400a380 comp rx=0 tx=0).stop 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.432+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 msgr2=0x7fe58419e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.432+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00e940 tx=0x7fe57c00ee00 comp rx=0 tx=0).stop 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 shutdown_connections 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5700b4bb0 0x7fe5700b70c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe584108b10 0x7fe58419e9d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5841081c0 0x7fe584199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 --2- 172.21.15.2:0/1206576089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe584102880 0x7fe584199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 >> 172.21.15.2:0/1206576089 conn(0x7fe584079510 msgr2=0x7fe584106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 shutdown_connections 2024-08-31T04:23:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:15.433+0000 7fe58a7c3640 1 -- 172.21.15.2:0/1206576089 wait complete. 2024-08-31T04:23:16.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T04:22:57.945132+0000', 'modified': '2024-08-31T04:23:06.979633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6839/574572481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 574572481}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 574572481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-08-31T04:23:16.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T04:23:16.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:23:16.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:16 smithi002 ceph-mon[18656]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:16.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:16 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1206576089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:16.427 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:16.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:16 smithi064 ceph-mon[22007]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:16.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:16 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1206576089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:16 smithi132 ceph-mon[22335]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:16 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1206576089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 -- 172.21.15.2:0/3461565618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 msgr2=0x7f04781085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 --2- 172.21.15.2:0/3461565618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f04781085d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f046c009900 tx=0x7f046c02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 -- 172.21.15.2:0/3461565618 shutdown_connections 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 --2- 172.21.15.2:0/3461565618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f04781085d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 --2- 172.21.15.2:0/3461565618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478108b10 0x7f047810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 --2- 172.21.15.2:0/3461565618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478102880 0x7f0478102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 -- 172.21.15.2:0/3461565618 >> 172.21.15.2:0/3461565618 conn(0x7f0478079510 msgr2=0x7f0478079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 -- 172.21.15.2:0/3461565618 shutdown_connections 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.910+0000 7f047d008640 1 -- 172.21.15.2:0/3461565618 wait complete. 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 Processor -- start 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 -- start start 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478102880 0x7f047819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478108b10 0x7f047819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04781127a0 con 0x7f04781081c0 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0478112620 con 0x7f0478108b10 2024-08-31T04:23:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047d008640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0478112920 con 0x7f0478102880 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59644/0 (socket says 172.21.15.2:59644) 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f047659c640 1 -- 172.21.15.2:0/1770614353 learned_addr learned my addr 172.21.15.2:0/1770614353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.911+0000 7f0476d9d640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478102880 0x7f047819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047759e640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478108b10 0x7f047819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 -- 172.21.15.2:0/1770614353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478102880 msgr2=0x7f047819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478102880 0x7f047819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 -- 172.21.15.2:0/1770614353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478108b10 msgr2=0x7f047819bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478108b10 0x7f047819bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 -- 172.21.15.2:0/1770614353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04781a62f0 con 0x7f04781081c0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047659c640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f046c006010 tx=0x7f046c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f045ffff640 1 -- 172.21.15.2:0/1770614353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c03f030 con 0x7f04781081c0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04781a6580 con 0x7f04781081c0 2024-08-31T04:23:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f045ffff640 1 -- 172.21.15.2:0/1770614353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f046c003aa0 con 0x7f04781081c0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f045ffff640 1 -- 172.21.15.2:0/1770614353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c035070 con 0x7f04781081c0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.912+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04781a6a60 con 0x7f04781081c0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 Processor -- start 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 -- start start 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f045ffff640 1 -- 172.21.15.2:0/1770614353 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f046c042030 con 0x7f04781081c0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702e917b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e92230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e702e083f0 con 0x55e702ac30a0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e702df7980 con 0x55e702acb280 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f048357d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e702dfb930 con 0x55e702aebf60 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59648/0 (socket says 172.21.15.2:59648) 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 -- 172.21.15.2:0/33892132 learned_addr learned my addr 172.21.15.2:0/33892132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f047659c640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e92230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f047759e640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702e917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 -- 172.21.15.2:0/33892132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 msgr2=0x55e702e917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702e917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 -- 172.21.15.2:0/33892132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 msgr2=0x55e702e92230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e92230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f0476d9d640 1 -- 172.21.15.2:0/33892132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e702b57540 con 0x55e702ac30a0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.915+0000 7f047759e640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702e917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f0476d9d640 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0468007f40 tx=0x7f046800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb040eb702b7a91a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f045ffff640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 0x7f04600b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f045d7fa640 1 -- 172.21.15.2:0/33892132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468010900 con 0x55e702ac30a0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f047759e640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 0x7f04600b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f045d7fa640 1 -- 172.21.15.2:0/33892132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04680183f0 con 0x55e702ac30a0 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f045d7fa640 1 -- 172.21.15.2:0/33892132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468017600 con 0x55e702ac30a0 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.916+0000 7f045ffff640 1 -- 172.21.15.2:0/1770614353 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f046c1058d0 con 0x7f04781081c0 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f047759e640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 0x7f04600b70c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d30 tx=0x7f0470005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 -- 172.21.15.2:0/33892132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 msgr2=0x55e702e91cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0468007f40 tx=0x7f046800f850 comp rx=0 tx=0).stop 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 -- 172.21.15.2:0/33892132 shutdown_connections 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702ac30a0 0x55e702e91cf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e92230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 --2- 172.21.15.2:0/33892132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702e917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 -- 172.21.15.2:0/33892132 >> 172.21.15.2:0/33892132 conn(0x55e702ae0350 msgr2=0x55e702e8f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 -- 172.21.15.2:0/33892132 shutdown_connections 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.917+0000 7f048357d740 1 -- 172.21.15.2:0/33892132 wait complete. 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 -- start start 2024-08-31T04:23:16.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 Processor -- start 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e9ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 0x55e702e9d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e702c5a5f0 con 0x55e702acb280 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e702d7e600 con 0x55e702aebf60 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e702e9ff90 con 0x55e702ac30a0 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f048357d740 10 client.0 _ll_register_callbacks cb 0x55e702da4af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59658/0 (socket says 172.21.15.2:59658) 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 -- 172.21.15.2:0/3358946346 learned_addr learned my addr 172.21.15.2:0/3358946346 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047759e640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 0x55e702e9d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e9ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 -- 172.21.15.2:0/3358946346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 msgr2=0x55e702e9ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e9ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 -- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 msgr2=0x55e702e9d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 0x55e702e9d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047659c640 1 -- 172.21.15.2:0/3358946346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e702db77b0 con 0x55e702acb280 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f047759e640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 0x55e702e9d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.918+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e9ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f047659c640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f046c031440 tx=0x7f046c03b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cd815b569b4a18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c049030 con 0x55e702acb280 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f046c0d3be0 con 0x55e702acb280 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04680183f0 con 0x55e702acb280 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f046c0cbe70 con 0x55e702acb280 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 10 client.14928 fetch_fsmap learned FSMap version 17 2024-08-31T04:23:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e702eabc40 con 0x55e702acb280 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04680183f0 con 0x55e702acb280 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f046c0cc300 con 0x55e702acb280 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 10 client.14928 fetch_fsmap finished waiting for FSMap version 17 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 10 client.14928 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 20 client.14928 populate_metadata read hostname 'smithi002' 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702aaa8e0 0x55e702eaf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 4 client.14928 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.919+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e702e0a340 con 0x55e702aaa8e0 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.920+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702aaa8e0 0x55e702eaf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.920+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702aaa8e0 0x55e702eaf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aaaebfb2c2c5365 server_cookie=9aee38b42fe32c24 in_seq=0 out_seq=0 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.920+0000 7f045aff5640 10 client.14928 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.921+0000 7f045aff5640 1 -- 172.21.15.2:0/3358946346 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e702e0a340 con 0x55e702aaa8e0 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.921+0000 7f045aff5640 10 client.14928 handle_command_reply: tid=0 2024-08-31T04:23:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.921+0000 7f048357d740 1 client.14928 shutdown 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.921+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 msgr2=0x55e702e9d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.921+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f046c031440 tx=0x7f046c03b520 comp rx=0 tx=0).stop 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 shutdown_connections 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702aaa8e0 0x55e702eaf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702e9d360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702aebf60 0x55e702e9d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f045aff5640 0 client.14928 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 --2- 172.21.15.2:0/3358946346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e9ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 >> 172.21.15.2:0/3358946346 conn(0x55e702ae0350 msgr2=0x55e702e94940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 shutdown_connections 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 1 -- 172.21.15.2:0/3358946346 wait complete. 2024-08-31T04:23:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.922+0000 7f048357d740 20 client.14928 trim_cache size 0 max 16384 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 Processor -- start 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 -- start start 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e97f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e702eada60 con 0x55e702aebf60 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e702eae130 con 0x55e702acb280 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f048357d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e702eae800 con 0x55e702ac30a0 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59674/0 (socket says 172.21.15.2:59674) 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047759e640 1 -- 172.21.15.2:0/3063782815 learned_addr learned my addr 172.21.15.2:0/3063782815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047659c640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e97f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047759e640 1 -- 172.21.15.2:0/3063782815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 msgr2=0x55e702e97f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.941+0000 7f047759e640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e97f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f047759e640 1 -- 172.21.15.2:0/3063782815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 msgr2=0x55e702e984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f047759e640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f047759e640 1 -- 172.21.15.2:0/3063782815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e702ea9980 con 0x55e702aebf60 2024-08-31T04:23:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f0476d9d640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e97f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f047659c640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f047759e640 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f047001d5d0 tx=0x7f0470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a077231d5c625 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f045cff9640 1 -- 172.21.15.2:0/3063782815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047001ddc0 con 0x55e702aebf60 2024-08-31T04:23:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f045cff9640 1 -- 172.21.15.2:0/3063782815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f047002d070 con 0x55e702aebf60 2024-08-31T04:23:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.942+0000 7f045cff9640 1 -- 172.21.15.2:0/3063782815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047000f620 con 0x55e702aebf60 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- 172.21.15.2:0/3063782815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 msgr2=0x55e702e8ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f047001d5d0 tx=0x7f0470017000 comp rx=0 tx=0).stop 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- 172.21.15.2:0/3063782815 shutdown_connections 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702aebf60 0x55e702e8ecf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702acb280 0x55e702e984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 --2- 172.21.15.2:0/3063782815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702ac30a0 0x55e702e97f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- 172.21.15.2:0/3063782815 >> 172.21.15.2:0/3063782815 conn(0x55e702ae0350 msgr2=0x55e702e9cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- 172.21.15.2:0/3063782815 shutdown_connections 2024-08-31T04:23:16.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- 172.21.15.2:0/3063782815 wait complete. 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 -- start start 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.943+0000 7f048357d740 1 Processor -- start 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702ac30a0 0x55e702eb7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702eb1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e702eaf5a0 con 0x55e702acb280 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e702eaeed0 con 0x55e702ac30a0 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e702eafc70 con 0x55e702aebf60 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f048357d740 10 client.0 _ll_register_callbacks cb 0x7f046c004520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59686/0 (socket says 172.21.15.2:59686) 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 -- 172.21.15.2:0/1393842456 learned_addr learned my addr 172.21.15.2:0/1393842456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f0476d9d640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702ac30a0 0x55e702eb7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047759e640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702eb1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 -- 172.21.15.2:0/1393842456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 msgr2=0x55e702eb1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702eb1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 -- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702ac30a0 msgr2=0x55e702eb7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702ac30a0 0x55e702eb7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 -- 172.21.15.2:0/1393842456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e702eb1eb0 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f047659c640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f046c10b1b0 tx=0x7f046c03b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeff5e7f432f0e67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f045aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.944+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c049070 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f046c0b7190 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f047002d070 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f046c0e6050 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 10 client.14934 fetch_fsmap learned FSMap version 17 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e702eb76f0 con 0x55e702acb280 2024-08-31T04:23:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f047002d070 con 0x55e702acb280 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f046c0cb300 con 0x55e702acb280 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 10 client.14934 fetch_fsmap finished waiting for FSMap version 17 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 10 client.14934 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 20 client.14934 populate_metadata read hostname 'smithi002' 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702a7fc90 0x55e702f1ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 4 client.14934 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.945+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "status"}) -- 0x55e702e05de0 con 0x55e702a7fc90 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f0476d9d640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702a7fc90 0x55e702f1ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f045aff5640 10 client.14934 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f0476d9d640 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702a7fc90 0x55e702f1ded0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c39ff7b7680bcdd server_cookie=62a2b04bc33f45be in_seq=0 out_seq=0 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f045aff5640 1 -- 172.21.15.2:0/1393842456 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e702e05de0 con 0x55e702a7fc90 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f045aff5640 10 client.14934 handle_command_reply: tid=0 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 client.14934 shutdown 2024-08-31T04:23:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 msgr2=0x55e702eb1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f046c10b1b0 tx=0x7f046c03b5d0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 shutdown_connections 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e702a7fc90 0x55e702f1ded0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e702acb280 0x55e702eb1430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e702aebf60 0x55e702eb1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 --2- 172.21.15.2:0/1393842456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e702ac30a0 0x55e702eb7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 >> 172.21.15.2:0/1393842456 conn(0x55e702ae0350 msgr2=0x55e702e9cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f045aff5640 0 client.14934 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.946+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 shutdown_connections 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f048357d740 1 -- 172.21.15.2:0/1393842456 wait complete. 2024-08-31T04:23:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f048357d740 20 client.14934 trim_cache size 0 max 16384 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24704, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 18.717141521999999, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 29.43750863 2024-08-31T04:23:16.953 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 msgr2=0x7f04600b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 0x7f04600b70c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d30 tx=0x7f0470005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 msgr2=0x7f047819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f046c006010 tx=0x7f046c004060 comp rx=0 tx=0).stop 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 shutdown_connections 2024-08-31T04:23:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04600b4bb0 0x7f04600b70c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04781081c0 0x7f047819b630 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0478108b10 0x7f047819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 --2- 172.21.15.2:0/1770614353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0478102880 0x7f047819b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 >> 172.21.15.2:0/1770614353 conn(0x7f0478079510 msgr2=0x7f0478106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 shutdown_connections 2024-08-31T04:23:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:16.947+0000 7f047d008640 1 -- 172.21.15.2:0/1770614353 wait complete. 2024-08-31T04:23:17.731 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T04:23:17.731 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:17.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T04:23:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:18.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:18 smithi002 ceph-mon[18656]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 -- 172.21.15.2:0/1427193531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0104fe0 msgr2=0x7ffbe01053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/1427193531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0104fe0 0x7ffbe01053f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009900 tx=0x7ffbd002a410 comp rx=0 tx=0).stop 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 -- 172.21.15.2:0/1427193531 shutdown_connections 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/1427193531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0104fe0 0x7ffbe01053f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/1427193531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 0x7ffbe010f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/1427193531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0103010 0x7ffbe0103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 -- 172.21.15.2:0/1427193531 >> 172.21.15.2:0/1427193531 conn(0x7ffbe0079c60 msgr2=0x7ffbe007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 -- 172.21.15.2:0/1427193531 shutdown_connections 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.517+0000 7ffbe87d1640 1 -- 172.21.15.2:0/1427193531 wait complete. 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 Processor -- start 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 -- start start 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0104fe0 0x7ffbe019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 0x7ffbe019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe0113910 con 0x7ffbe0103010 2024-08-31T04:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe0113790 con 0x7ffbe0104fe0 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe87d1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe0113a90 con 0x7ffbe0105930 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe656d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe656d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59718/0 (socket says 172.21.15.2:59718) 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe656d640 1 -- 172.21.15.2:0/579539102 learned_addr learned my addr 172.21.15.2:0/579539102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.518+0000 7ffbe5d6c640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0104fe0 0x7ffbe019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe6d6e640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 0x7ffbe019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 -- 172.21.15.2:0/579539102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 msgr2=0x7ffbe019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 0x7ffbe019fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 -- 172.21.15.2:0/579539102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0104fe0 msgr2=0x7ffbe019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0104fe0 0x7ffbe019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 -- 172.21.15.2:0/579539102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe01a0250 con 0x7ffbe0103010 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe656d640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00e9f0 tx=0x7ffbdc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00cd80 con 0x7ffbe0103010 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbdc0108e0 con 0x7ffbe0103010 2024-08-31T04:23:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe01a0540 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc018980 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.519+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe01a6ca0 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.520+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe0103420 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.522+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7ffbdc010430 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.522+0000 7ffbd77fe640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 0x7ffbcc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.522+0000 7ffbe5d6c640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 0x7ffbcc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.522+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7ffbdc0e5860 con 0x7ffbe0103010 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.523+0000 7ffbe5d6c640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 0x7ffbcc0b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0000c00 tx=0x7ffbd0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.527+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffbdc0ac680 con 0x7ffbe0103010 2024-08-31T04:23:18.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.749+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffbe002e430 con 0x7ffbe0103010 2024-08-31T04:23:18.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.750+0000 7ffbd77fe640 1 -- 172.21.15.2:0/579539102 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7ffbdc0abf80 con 0x7ffbe0103010 2024-08-31T04:23:18.751 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T04:23:18.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 msgr2=0x7ffbcc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 0x7ffbcc0b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0000c00 tx=0x7ffbd0031400 comp rx=0 tx=0).stop 2024-08-31T04:23:18.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 msgr2=0x7ffbe019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00e9f0 tx=0x7ffbdc00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 shutdown_connections 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe0105930 0x7ffbe019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0104fe0 0x7ffbe019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ffbcc0b4b80 0x7ffbcc0b7090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 --2- 172.21.15.2:0/579539102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe0103010 0x7ffbe019a2e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 >> 172.21.15.2:0/579539102 conn(0x7ffbe0079c60 msgr2=0x7ffbe0106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 shutdown_connections 2024-08-31T04:23:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:18.752+0000 7ffbe87d1640 1 -- 172.21.15.2:0/579539102 wait complete. 2024-08-31T04:23:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:18 smithi064 ceph-mon[22007]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:18.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:18 smithi132 ceph-mon[22335]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:19.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:19 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/579539102' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:23:19.573 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-31T04:23:19.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T04:23:19.573 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-31T04:23:19.573 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-31T04:23:19.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:19.574 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-31T04:23:19.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T04:23:19.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T04:23:19.574 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T04:23:19.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:19.574 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-31T04:23:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42128sec preferred_lft 42128sec 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::6f05:b039:a4ec:1f10/64 scope link noprefixroute 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:23:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-31T04:23:19.593 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T04:23:19.593 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:23:19.593 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:23:19.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-08-31T04:23:19.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-08-31T04:23:19.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-08-31T04:23:19.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T04:23:19.594 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:23:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:23:19.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:19.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:19.794 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T04:23:19.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:19 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/579539102' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:23:19.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:19 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/579539102' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:23:19.819 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-31T04:23:19.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:19.820 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-31T04:23:19.905 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-31T04:23:19.906 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T04:23:19.906 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T04:23:19.906 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T04:23:19.906 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T04:23:19.906 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:23:19.906 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:23:19.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T04:23:19.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T04:23:19.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T04:23:19.907 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:23:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:23:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:20.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:20.157 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-31T04:23:20.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:20.173 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-31T04:23:20.228 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:23:20.228 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:23:20.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:23:20.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-31T04:23:20.228 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:23:20.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:20.348 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-31T04:23:20.348 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:23:20.348 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-31T04:23:20.349 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:23:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:23:20.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:20.476 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:23:20.476 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:23:20.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-31T04:23:20.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T04:23:20.477 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:23:20.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:20.559 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-31T04:23:20.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:23:20.559 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:20.574 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T04:23:20.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:23:20.574 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:20.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-08-31T04:23:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:20 smithi002 ceph-mon[18656]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:20.671 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T04:23:20.727 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-08-31T04:23:20.727 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-08-31T04:23:20.727 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-08-31T04:23:20.727 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-08-31T04:23:20.727 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-08-31T04:23:20.728 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/3e23fde193995c47e70b3143cfc175e4399b634e1fd8548d34bef49e67359692/merged 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/e56db332868ec028b84f51e955b69c2c52e5b20bc6506352a6991f6245db2d73/merged 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-08-31T04:23:20.729 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/10538c89150b1a8b531efd69109d90323648e5ea6ea55971f175c23cad94d7ec/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/db9139eda4a0f2b483c12273647d42a05e6e14481cc8b9b248f4f92b12fbe9dc/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/150fb3ae2f0ba27fd029e71c058e83344025a931f79ba1251f8e7b015491012e/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/1b1c91d7ba4f4d163c65effd284b45a28e6faf82855d1b96b9768bc7b536f61a/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/717d93d2a401589df89172e96faf0900d44397a30179c54c4d85681cf90a4919/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/6c76518016201e845660e89aab30bf839a63219797b65fc46a42c2ca8c9a86d6/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/71ce031bbf2fbca70176faa670887c8fb73c36cd274ce08825bc79a9cf7dc4f9/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/890c94e562d8cc1f9a2d45a50783d82298376267a44766a42a257f80a820ab73/merged 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:23:20.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:20.731 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-08-31T04:23:20.782 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T04:23:20.782 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-31T04:23:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:20 smithi064 ceph-mon[22007]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:20 smithi132 ceph-mon[22335]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:20.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-08-31T04:23:20.848 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-08-31T04:23:20.905 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T04:23:20.906 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/3e23fde193995c47e70b3143cfc175e4399b634e1fd8548d34bef49e67359692/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/e56db332868ec028b84f51e955b69c2c52e5b20bc6506352a6991f6245db2d73/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/10538c89150b1a8b531efd69109d90323648e5ea6ea55971f175c23cad94d7ec/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/db9139eda4a0f2b483c12273647d42a05e6e14481cc8b9b248f4f92b12fbe9dc/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/150fb3ae2f0ba27fd029e71c058e83344025a931f79ba1251f8e7b015491012e/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/1b1c91d7ba4f4d163c65effd284b45a28e6faf82855d1b96b9768bc7b536f61a/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/717d93d2a401589df89172e96faf0900d44397a30179c54c4d85681cf90a4919/merged 2024-08-31T04:23:20.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/6c76518016201e845660e89aab30bf839a63219797b65fc46a42c2ca8c9a86d6/merged 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/71ce031bbf2fbca70176faa670887c8fb73c36cd274ce08825bc79a9cf7dc4f9/merged 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/890c94e562d8cc1f9a2d45a50783d82298376267a44766a42a257f80a820ab73/merged 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:23:20.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:20.908 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-08-31T04:23:20.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:2024-08-31T04:23:20.935+0000 7f3dfa995480 -1 init, newargv = 0x7f3ddc054370 newargc=15 2024-08-31T04:23:20.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[67921]: starting ceph client 2024-08-31T04:23:20.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[67921]: starting fuse 2024-08-31T04:23:20.953 INFO:teuthology.orchestra.run.smithi002.stdout:121 2024-08-31T04:23:20.953 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-08-31T04:23:20.954 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T04:23:20.955 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.admin")) 2024-08-31T04:23:20.956 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-08-31T04:23:21.072 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.admin.67921.asok 2024-08-31T04:23:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:21.083 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.67921.asok 2024-08-31T04:23:21.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:21.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.67921.asok status 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "admin", 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-31T04:23:21.228 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "67921", 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 14946, 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 14946 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-08-31T04:23:21.229 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1896709022 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1896709022 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.14946 192.168.0.1:0/1896709022", 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1896709022", 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 17, 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 81, 2024-08-31T04:23:21.230 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-08-31T04:23:21.231 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-08-31T04:23:21.231 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-08-31T04:23:21.231 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:23:21.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:21.237 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-08-31T04:23:21.237 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:21.254 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-08-31T04:23:21.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:21.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:21.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:21.320 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-31T04:23:21.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:23:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:# file: . 2024-08-31T04:23:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-31T04:23:21.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:23:21.436 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:23:21.436 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:23:21.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T04:23:21.743 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 -- 172.21.15.2:0/2802366878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 msgr2=0x7f3c2010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2802366878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2010f340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009ca0 tx=0x7f3c1802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 -- 172.21.15.2:0/2802366878 shutdown_connections 2024-08-31T04:23:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2802366878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2010f340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2802366878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c201081c0 0x7f3c201085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2802366878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c20102880 0x7f3c20102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 -- 172.21.15.2:0/2802366878 >> 172.21.15.2:0/2802366878 conn(0x7f3c20079510 msgr2=0x7f3c20079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 -- 172.21.15.2:0/2802366878 shutdown_connections 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 -- 172.21.15.2:0/2802366878 wait complete. 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.269+0000 7f3c2587d640 1 Processor -- start 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 -- start start 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c20102880 0x7f3c20199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 0x7f3c201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20112830 con 0x7f3c20108b10 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201126b0 con 0x7f3c201081c0 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c2587d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201129b0 con 0x7f3c20102880 2024-08-31T04:23:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59738/0 (socket says 172.21.15.2:59738) 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2537047634 learned_addr learned my addr 172.21.15.2:0/2537047634 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1e7fc640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 0x7f3c201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1effd640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c20102880 0x7f3c20199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2537047634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c20102880 msgr2=0x7f3c20199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c20102880 0x7f3c20199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2537047634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 msgr2=0x7f3c201997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 0x7f3c201997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2537047634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2019f0b0 con 0x7f3c20108b10 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.270+0000 7f3c1e7fc640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 0x7f3c201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c1f7fe640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009430 tx=0x7f3c180319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18003c30 con 0x7f3c20108b10 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c18003dd0 con 0x7f3c20108b10 2024-08-31T04:23:22.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2019f340 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1802faa0 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.271+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2019f880 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.272+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c20103b00 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.274+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f3c1802fc40 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.275+0000 7f3c2487b640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 0x7f3c080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.275+0000 7f3c1effd640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 0x7f3c080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.275+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f3c18106a50 con 0x7f3c20108b10 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.275+0000 7f3c1effd640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 0x7f3c080b70c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005e10 tx=0x7f3c10005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.278+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c180cd870 con 0x7f3c20108b10 2024-08-31T04:23:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.480+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3c20102c90 con 0x7f3c20108b10 2024-08-31T04:23:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:22 smithi002 ceph-mon[18656]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.481+0000 7f3c2487b640 1 -- 172.21.15.2:0/2537047634 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v81) ==== 81+0+867 (secure 0 0 0) 0x7f3c20102c90 con 0x7f3c20108b10 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3769218802 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/676946348 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3520570143 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/383819124 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2196385741 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1227945442 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3454213639 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:22.484 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2617567314 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:22.485 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:22.485 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:22.485 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2564901012 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:22.485 INFO:teuthology.orchestra.run.smithi002.stderr:listed 15 entries 2024-08-31T04:23:22.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 msgr2=0x7f3c080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 0x7f3c080b70c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005e10 tx=0x7f3c10005da0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 msgr2=0x7f3c2019ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009430 tx=0x7f3c180319f0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 shutdown_connections 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c080b4bb0 0x7f3c080b70c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c20108b10 0x7f3c2019ea40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c201081c0 0x7f3c201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 --2- 172.21.15.2:0/2537047634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c20102880 0x7f3c20199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 >> 172.21.15.2:0/2537047634 conn(0x7f3c20079510 msgr2=0x7f3c20106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 shutdown_connections 2024-08-31T04:23:22.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:22.483+0000 7f3c2587d640 1 -- 172.21.15.2:0/2537047634 wait complete. 2024-08-31T04:23:22.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:22 smithi064 ceph-mon[22007]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:22 smithi132 ceph-mon[22335]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:23.227 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:23:23.227 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:23:23.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T04:23:23.544 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2537047634' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2537047634' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:23.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2537047634' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 -- 172.21.15.2:0/2660614690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109240 msgr2=0x7f133c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 --2- 172.21.15.2:0/2660614690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109240 0x7f133c109650 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1330009900 tx=0x7f133002a410 comp rx=0 tx=0).stop 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 -- 172.21.15.2:0/2660614690 shutdown_connections 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 --2- 172.21.15.2:0/2660614690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109240 0x7f133c109650 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 --2- 172.21.15.2:0/2660614690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c109b90 0x7f133c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 --2- 172.21.15.2:0/2660614690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c103900 0x7f133c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 -- 172.21.15.2:0/2660614690 >> 172.21.15.2:0/2660614690 conn(0x7f133c07b5f0 msgr2=0x7f133c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 -- 172.21.15.2:0/2660614690 shutdown_connections 2024-08-31T04:23:24.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.111+0000 7f1341085640 1 -- 172.21.15.2:0/2660614690 wait complete. 2024-08-31T04:23:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.112+0000 7f1341085640 1 Processor -- start 2024-08-31T04:23:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 -- start start 2024-08-31T04:23:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c103900 0x7f133c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c109240 0x7f133c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f133c113850 con 0x7f133c109b90 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f133c1136d0 con 0x7f133c103900 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f1341085640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f133c1139d0 con 0x7f133c109240 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f133b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f133b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59752/0 (socket says 172.21.15.2:59752) 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f133b59e640 1 -- 172.21.15.2:0/1112901678 learned_addr learned my addr 172.21.15.2:0/1112901678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f133a59c640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c109240 0x7f133c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.113+0000 7f133ad9d640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c103900 0x7f133c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 -- 172.21.15.2:0/1112901678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c109240 msgr2=0x7f133c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c109240 0x7f133c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 -- 172.21.15.2:0/1112901678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c103900 msgr2=0x7f133c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c103900 0x7f133c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 -- 172.21.15.2:0/1112901678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c1a01f0 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f133b59e640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fd0 tx=0x7f133400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334017070 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1334003e20 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c1a04e0 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334010460 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.114+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1a6c40 con 0x7f133c109b90 2024-08-31T04:23:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.115+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c103d10 con 0x7f133c109b90 2024-08-31T04:23:24.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.117+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f1334003970 con 0x7f133c109b90 2024-08-31T04:23:24.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.117+0000 7f1323fff640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 0x7f13240b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.117+0000 7f133ad9d640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 0x7f13240b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.117+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f13340e55e0 con 0x7f133c109b90 2024-08-31T04:23:24.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.118+0000 7f133ad9d640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 0x7f13240b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f132c005fd0 tx=0x7f132c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.121+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13340abdb0 con 0x7f133c109b90 2024-08-31T04:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.317+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f133c10b990 con 0x7f133c109b90 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.317+0000 7f1323fff640 1 -- 172.21.15.2:0/1112901678 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v81) ==== 81+0+867 (secure 0 0 0) 0x7f13340b0570 con 0x7f133c109b90 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3769218802 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/676946348 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3520570143 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/383819124 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2196385741 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1227945442 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3454213639 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2617567314 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2564901012 2024-09-01T04:16:32.968503+0000 2024-08-31T04:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:listed 15 entries 2024-08-31T04:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.319+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 msgr2=0x7f13240b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.319+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 0x7f13240b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f132c005fd0 tx=0x7f132c00b390 comp rx=0 tx=0).stop 2024-08-31T04:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.319+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 msgr2=0x7f133c19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.319+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fd0 tx=0x7f133400b260 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 shutdown_connections 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f13240b4b80 0x7f13240b7090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c109b90 0x7f133c19fac0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c109240 0x7f133c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 --2- 172.21.15.2:0/1112901678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f133c103900 0x7f133c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 >> 172.21.15.2:0/1112901678 conn(0x7f133c07b5f0 msgr2=0x7f133c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 shutdown_connections 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:24.320+0000 7f1341085640 1 -- 172.21.15.2:0/1112901678 wait complete. 2024-08-31T04:23:24.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:24 smithi002 ceph-mon[18656]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:24.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:24 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1112901678' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:24 smithi064 ceph-mon[22007]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:24 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1112901678' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:24 smithi132 ceph-mon[22335]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:24 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1112901678' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:23:24.980 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-08-31T04:23:24.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:24.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:23:25.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[67921]: fuse finished with error 0 and tester_r 0 2024-08-31T04:23:25.009 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:23:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:26 smithi002 ceph-mon[18656]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:26 smithi064 ceph-mon[22007]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:26.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:26 smithi132 ceph-mon[22335]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:28 smithi002 ceph-mon[18656]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:28 smithi064 ceph-mon[22007]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:28 smithi132 ceph-mon[22335]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:30 smithi002 ceph-mon[18656]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:30 smithi064 ceph-mon[22007]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:30 smithi132 ceph-mon[22335]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:31.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:23:31.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:23:31.111 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-31T04:23:31.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 -- 172.21.15.2:0/1330608192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 msgr2=0x7f19341100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 --2- 172.21.15.2:0/1330608192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f19341100d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f192c009900 tx=0x7f192c02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 -- 172.21.15.2:0/1330608192 shutdown_connections 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 --2- 172.21.15.2:0/1330608192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f19341100d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 --2- 172.21.15.2:0/1330608192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1934105120 0x7f193410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 --2- 172.21.15.2:0/1330608192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19341047d0 0x7f1934104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 -- 172.21.15.2:0/1330608192 >> 172.21.15.2:0/1330608192 conn(0x7f1934079500 msgr2=0x7f1934079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 -- 172.21.15.2:0/1330608192 shutdown_connections 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.052+0000 7f193b9f4640 1 -- 172.21.15.2:0/1330608192 wait complete. 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 Processor -- start 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 -- start start 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 0x7f193419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1934105120 0x7f193419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113860 con 0x7f193410dc00 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f19341136e0 con 0x7f19341047d0 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f193b9f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f19341139e0 con 0x7f1934105120 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f1939f91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f1939f91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49452/0 (socket says 172.21.15.2:49452) 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f1939f91640 1 -- 172.21.15.2:0/2261377865 learned_addr learned my addr 172.21.15.2:0/2261377865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f1938f8f640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1934105120 0x7f193419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.053+0000 7f1939790640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 0x7f193419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 -- 172.21.15.2:0/2261377865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1934105120 msgr2=0x7f193419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1934105120 0x7f193419a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 -- 172.21.15.2:0/2261377865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 msgr2=0x7f193419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 0x7f193419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 -- 172.21.15.2:0/2261377865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341a0200 con 0x7f193410dc00 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939790640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 0x7f193419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f1939f91640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f192c004770 tx=0x7f192c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c03f030 con 0x7f193410dc00 2024-08-31T04:23:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341a0490 con 0x7f193410dc00 2024-08-31T04:23:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f192c003aa0 con 0x7f193410dc00 2024-08-31T04:23:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c035070 con 0x7f193410dc00 2024-08-31T04:23:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.054+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a6c50 con 0x7f193410dc00 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.055+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934104be0 con 0x7f193410dc00 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.057+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f192c042030 con 0x7f193410dc00 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.058+0000 7f192a7fc640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 0x7f19200b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.058+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f192c105ea0 con 0x7f193410dc00 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.058+0000 7f1939790640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 0x7f19200b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.058+0000 7f1939790640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 0x7f19200b7090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f193406c630 tx=0x7f1930009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.061+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f192c0cccc0 con 0x7f193410dc00 2024-08-31T04:23:32.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.246+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19341a6e20 con 0x7f193410dc00 2024-08-31T04:23:32.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.248+0000 7f192a7fc640 1 -- 172.21.15.2:0/2261377865 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24437 (secure 0 0 0) 0x7f192c0d5020 con 0x7f193410dc00 2024-08-31T04:23:32.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:32.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:06.979485+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:32.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 msgr2=0x7f19200b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 0x7f19200b7090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f193406c630 tx=0x7f1930009520 comp rx=0 tx=0).stop 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 msgr2=0x7f193419fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f192c004770 tx=0x7f192c004270 comp rx=0 tx=0).stop 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 shutdown_connections 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f19200b4b80 0x7f19200b7090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f193410dc00 0x7f193419fad0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1934105120 0x7f193419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.250+0000 7f193b9f4640 1 --2- 172.21.15.2:0/2261377865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19341047d0 0x7f193419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:32.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.251+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 >> 172.21.15.2:0/2261377865 conn(0x7f1934079500 msgr2=0x7f19340ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:32.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.251+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 shutdown_connections 2024-08-31T04:23:32.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:32.251+0000 7f193b9f4640 1 -- 172.21.15.2:0/2261377865 wait complete. 2024-08-31T04:23:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:32 smithi002 ceph-mon[18656]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:32 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2261377865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:32 smithi064 ceph-mon[22007]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:32 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2261377865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:32 smithi132 ceph-mon[22335]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:32.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:32 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2261377865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:33.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]} : dispatch 2024-08-31T04:23:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]} : dispatch 2024-08-31T04:23:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-31T04:23:33.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-08-31T04:23:33.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]} : dispatch 2024-08-31T04:23:33.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]} : dispatch 2024-08-31T04:23:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-31T04:23:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-31T04:23:33.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-08-31T04:23:33.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]} : dispatch 2024-08-31T04:23:33.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]} : dispatch 2024-08-31T04:23:33.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-31T04:23:33.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T04:23:33.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T04:23:33.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-31T04:23:33.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-08-31T04:23:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 -- 172.21.15.2:0/2883122153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5418104750 msgr2=0x7f5418104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2883122153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5418104750 0x7f5418104b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5408009900 tx=0x7f540802a410 comp rx=0 tx=0).stop 2024-08-31T04:23:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 -- 172.21.15.2:0/2883122153 shutdown_connections 2024-08-31T04:23:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2883122153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f541810dbb0 0x7f54181100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2883122153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54181050a0 0x7f541810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2883122153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5418104750 0x7f5418104b60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 -- 172.21.15.2:0/2883122153 >> 172.21.15.2:0/2883122153 conn(0x7f54180794d0 msgr2=0x7f54180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 -- 172.21.15.2:0/2883122153 shutdown_connections 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.894+0000 7f541d2d4640 1 -- 172.21.15.2:0/2883122153 wait complete. 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 Processor -- start 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 -- start start 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 0x7f541819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 0x7f541819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 0x7f541819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5418113830 con 0x7f54181050a0 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54181136b0 con 0x7f541810dbb0 2024-08-31T04:23:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.895+0000 7f541d2d4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f54181139b0 con 0x7f5418104750 2024-08-31T04:23:33.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54167fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 0x7f541819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:33.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54167fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 0x7f541819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49472/0 (socket says 172.21.15.2:49472) 2024-08-31T04:23:33.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54167fc640 1 -- 172.21.15.2:0/2171370228 learned_addr learned my addr 172.21.15.2:0/2171370228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 0x7f541819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f5416ffd640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 0x7f541819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 -- 172.21.15.2:0/2171370228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 msgr2=0x7f541819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 0x7f541819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 -- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 msgr2=0x7f541819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 0x7f541819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.896+0000 7f54177fe640 1 -- 172.21.15.2:0/2171370228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54181a02d0 con 0x7f541810dbb0 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f5416ffd640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 0x7f541819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f54177fe640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 0x7f541819fba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541000e940 tx=0x7f541000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410004d20 con 0x7f541810dbb0 2024-08-31T04:23:33.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54181a05c0 con 0x7f541810dbb0 2024-08-31T04:23:33.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5410005020 con 0x7f541810dbb0 2024-08-31T04:23:33.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54100116d0 con 0x7f541810dbb0 2024-08-31T04:23:33.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.897+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181a6d20 con 0x7f541810dbb0 2024-08-31T04:23:33.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.898+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5418104b60 con 0x7f541810dbb0 2024-08-31T04:23:33.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.900+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f5410005460 con 0x7f541810dbb0 2024-08-31T04:23:33.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.901+0000 7f53fffff640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 0x7f54000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:33.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.901+0000 7f5416ffd640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 0x7f54000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:33.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.901+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f54100e5900 con 0x7f541810dbb0 2024-08-31T04:23:33.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.902+0000 7f5416ffd640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 0x7f54000b7090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f5408031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:33.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:33.904+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5410016030 con 0x7f541810dbb0 2024-08-31T04:23:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.092+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f541819b490 con 0x7f541810dbb0 2024-08-31T04:23:34.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.094+0000 7f53fffff640 1 -- 172.21.15.2:0/2171370228 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24908 (secure 0 0 0) 0x7f541819b490 con 0x7f541810dbb0 2024-08-31T04:23:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:34.096 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:33.356587+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:34.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 msgr2=0x7f54000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 0x7f54000b7090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f5408031400 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 msgr2=0x7f541819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 0x7f541819fba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541000e940 tx=0x7f541000ee00 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 shutdown_connections 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f54000b4b80 0x7f54000b7090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54181050a0 0x7f541819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f541810dbb0 0x7f541819fba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 --2- 172.21.15.2:0/2171370228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5418104750 0x7f541819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 >> 172.21.15.2:0/2171370228 conn(0x7f54180794d0 msgr2=0x7f54180ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 shutdown_connections 2024-08-31T04:23:34.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:34.096+0000 7f541d2d4640 1 -- 172.21.15.2:0/2171370228 wait complete. 2024-08-31T04:23:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]}]': finished 2024-08-31T04:23:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:23:34.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:34 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2171370228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]}]': finished 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]}]': finished 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-08-31T04:23:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:34 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2171370228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 6]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [10, 11]}]': finished 2024-08-31T04:23:34.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:23:34.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:34 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2171370228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:34.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T04:23:35.208 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:35.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:35 smithi002 ceph-mon[18656]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 -- 172.21.15.2:0/2609629004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108140 msgr2=0x7f2efc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 --2- 172.21.15.2:0/2609629004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108140 0x7f2efc108550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009900 tx=0x7f2eec02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 -- 172.21.15.2:0/2609629004 shutdown_connections 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 --2- 172.21.15.2:0/2609629004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108140 0x7f2efc108550 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 --2- 172.21.15.2:0/2609629004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108a90 0x7f2efc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 --2- 172.21.15.2:0/2609629004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 -- 172.21.15.2:0/2609629004 >> 172.21.15.2:0/2609629004 conn(0x7f2efc0794d0 msgr2=0x7f2efc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 -- 172.21.15.2:0/2609629004 shutdown_connections 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.682+0000 7f2f04681640 1 -- 172.21.15.2:0/2609629004 wait complete. 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 Processor -- start 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 -- start start 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 0x7f2efc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc113820 con 0x7f2efc108a90 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1136a0 con 0x7f2efc108140 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f04681640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1139a0 con 0x7f2efc102800 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f02c1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f02c1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54394/0 (socket says 172.21.15.2:54394) 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.683+0000 7f2f02c1e640 1 -- 172.21.15.2:0/236454469 learned_addr learned my addr 172.21.15.2:0/236454469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f0241d640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f01c1c640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 0x7f2efc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 -- 172.21.15.2:0/236454469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 msgr2=0x7f2efc19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 -- 172.21.15.2:0/236454469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 msgr2=0x7f2efc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 0x7f2efc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 -- 172.21.15.2:0/236454469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc1a01c0 con 0x7f2efc108a90 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f0241d640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f01c1c640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 0x7f2efc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f02c1e640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009fd0 tx=0x7f2ef400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4017070 con 0x7f2efc108a90 2024-08-31T04:23:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ef4003e20 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4010460 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc1a04b0 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.684+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc1a6c10 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.685+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc102c10 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.687+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f2ef4003970 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.688+0000 7f2ef37fe640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 0x7f2ee80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.688+0000 7f2f0241d640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 0x7f2ee80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.688+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f2ef40e5410 con 0x7f2efc108a90 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.688+0000 7f2f0241d640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 0x7f2ee80b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80058c0 tx=0x7f2ef8005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.691+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ef40ac110 con 0x7f2efc108a90 2024-08-31T04:23:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:35 smithi064 ceph-mon[22007]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:23:35.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:35 smithi132 ceph-mon[22335]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:23:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:35.914+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2efc10a860 con 0x7f2efc108a90 2024-08-31T04:23:36.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.381+0000 7f2ef37fe640 1 -- 172.21.15.2:0/236454469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f2ef40aba10 con 0x7f2efc108a90 2024-08-31T04:23:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 msgr2=0x7f2ee80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 0x7f2ee80b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80058c0 tx=0x7f2ef8005850 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 msgr2=0x7f2efc19fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009fd0 tx=0x7f2ef400b260 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 shutdown_connections 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ee80b4b80 0x7f2ee80b7090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2efc108a90 0x7f2efc19fa90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2efc108140 0x7f2efc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 --2- 172.21.15.2:0/236454469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2efc102800 0x7f2efc19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 >> 172.21.15.2:0/236454469 conn(0x7f2efc0794d0 msgr2=0x7f2efc104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 shutdown_connections 2024-08-31T04:23:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:36.384+0000 7f2f04681640 1 -- 172.21.15.2:0/236454469 wait complete. 2024-08-31T04:23:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:36 smithi002 ceph-mon[18656]: pgmap v282: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:36 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:23:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:36 smithi064 ceph-mon[22007]: pgmap v282: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:36 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:23:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:36 smithi132 ceph-mon[22335]: pgmap v282: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:23:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:36 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:23:37.191 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-08-31T04:23:37.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-31T04:23:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:37.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:37 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:23:37.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:37 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:37.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:37 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:23:37.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:37 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:37.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:37 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/236454469' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:23:37.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:37 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 -- 172.21.15.2:0/1730822898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 msgr2=0x7f01b41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/1730822898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b41103c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009ca0 tx=0x7f01ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 -- 172.21.15.2:0/1730822898 shutdown_connections 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/1730822898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b41103c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/1730822898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4109240 0x7f01b4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/1730822898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4103900 0x7f01b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 -- 172.21.15.2:0/1730822898 >> 172.21.15.2:0/1730822898 conn(0x7f01b407b5f0 msgr2=0x7f01b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 -- 172.21.15.2:0/1730822898 shutdown_connections 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.085+0000 7f01ba3ef640 1 -- 172.21.15.2:0/1730822898 wait complete. 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 Processor -- start 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 -- start start 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4103900 0x7f01b419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4109240 0x7f01b419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4113850 con 0x7f01b4109b90 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01b41136d0 con 0x7f01b4109240 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01ba3ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f01b41139d0 con 0x7f01b4103900 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01b898c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01b898c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54416/0 (socket says 172.21.15.2:54416) 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.086+0000 7f01b898c640 1 -- 172.21.15.2:0/2039632544 learned_addr learned my addr 172.21.15.2:0/2039632544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b3fff640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4103900 0x7f01b419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b37fe640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4109240 0x7f01b419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 -- 172.21.15.2:0/2039632544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4103900 msgr2=0x7f01b419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4103900 0x7f01b419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 -- 172.21.15.2:0/2039632544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4109240 msgr2=0x7f01b419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4109240 0x7f01b419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 -- 172.21.15.2:0/2039632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b41a0190 con 0x7f01b4109b90 2024-08-31T04:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b898c640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005cc0 tx=0x7f01ac02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac003cf0 con 0x7f01b4109b90 2024-08-31T04:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b41a0420 con 0x7f01b4109b90 2024-08-31T04:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01ac0044f0 con 0x7f01b4109b90 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac02fd10 con 0x7f01b4109b90 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.087+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b41a6be0 con 0x7f01b4109b90 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.088+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b4103d10 con 0x7f01b4109b90 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.090+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f01ac004040 con 0x7f01b4109b90 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.090+0000 7f01b17fa640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 0x7f019c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.091+0000 7f01b3fff640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 0x7f019c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.091+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f01ac106d10 con 0x7f01b4109b90 2024-08-31T04:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.091+0000 7f01b3fff640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 0x7f019c0b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01a40058c0 tx=0x7f01a400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.094+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f01ac0cda10 con 0x7f01b4109b90 2024-08-31T04:23:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.323+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f01b402e430 con 0x7f01b4109b90 2024-08-31T04:23:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.393+0000 7f01b17fa640 1 -- 172.21.15.2:0/2039632544 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f01ac0cd310 con 0x7f01b4109b90 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.395+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 msgr2=0x7f019c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.395+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 0x7f019c0b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01a40058c0 tx=0x7f01a400a2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.395+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 msgr2=0x7f01b419fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.395+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005cc0 tx=0x7f01ac02f470 comp rx=0 tx=0).stop 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 shutdown_connections 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f019c0b4b80 0x7f019c0b7090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01b4109b90 0x7f01b419fa60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01b4109240 0x7f01b419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 --2- 172.21.15.2:0/2039632544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b4103900 0x7f01b419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 >> 172.21.15.2:0/2039632544 conn(0x7f01b407b5f0 msgr2=0x7f01b41072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 shutdown_connections 2024-08-31T04:23:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:38.396+0000 7f01ba3ef640 1 -- 172.21.15.2:0/2039632544 wait complete. 2024-08-31T04:23:38.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:38 smithi002 ceph-mon[18656]: pgmap v283: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:38.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T04:23:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:38 smithi064 ceph-mon[22007]: pgmap v283: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T04:23:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:38 smithi132 ceph-mon[22335]: pgmap v283: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T04:23:39.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T04:23:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T04:23:39.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:39 smithi002 ceph-mon[18656]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T04:23:39.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:23:39.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T04:23:39.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:23:39.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:39 smithi132 ceph-mon[22335]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2039632544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T04:23:39.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:39 smithi064 ceph-mon[22007]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T04:23:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 -- 172.21.15.2:0/4164006514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c1081a0 msgr2=0x7fce0c1085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 --2- 172.21.15.2:0/4164006514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c1081a0 0x7fce0c1085b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fce00009900 tx=0x7fce0002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 -- 172.21.15.2:0/4164006514 shutdown_connections 2024-08-31T04:23:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 --2- 172.21.15.2:0/4164006514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c1081a0 0x7fce0c1085b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 --2- 172.21.15.2:0/4164006514 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c108af0 0x7fce0c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 --2- 172.21.15.2:0/4164006514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c102f30 0x7fce0c103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.026+0000 7fce1246b640 1 -- 172.21.15.2:0/4164006514 >> 172.21.15.2:0/4164006514 conn(0x7fce0c079d30 msgr2=0x7fce0c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.027+0000 7fce1246b640 1 -- 172.21.15.2:0/4164006514 shutdown_connections 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.027+0000 7fce1246b640 1 -- 172.21.15.2:0/4164006514 wait complete. 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.027+0000 7fce1246b640 1 Processor -- start 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.027+0000 7fce1246b640 1 -- start start 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c102f30 0x7fce0c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c1081a0 0x7fce0c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c112760 con 0x7fce0c108af0 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c1125e0 con 0x7fce0c102f30 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce1246b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c1128e0 con 0x7fce0c1081a0 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54444/0 (socket says 172.21.15.2:54444) 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 -- 172.21.15.2:0/645719295 learned_addr learned my addr 172.21.15.2:0/645719295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce0bfff640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c102f30 0x7fce0c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce0b7fe640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c1081a0 0x7fce0c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 -- 172.21.15.2:0/645719295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c1081a0 msgr2=0x7fce0c19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c1081a0 0x7fce0c19b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 -- 172.21.15.2:0/645719295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c102f30 msgr2=0x7fce0c19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c102f30 0x7fce0c19b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.028+0000 7fce10a08640 1 -- 172.21.15.2:0/645719295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c1a6240 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce10a08640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce0400cce0 tx=0x7fce0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0400f450 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce0400faa0 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c1a6530 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04018a80 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.029+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c1a69f0 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.030+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c103340 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.032+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fce0400fc50 con 0x7fce0c108af0 2024-08-31T04:23:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.033+0000 7fce097fa640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 0x7fcdf40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.033+0000 7fce0bfff640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 0x7fcdf40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.033+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fce040e5f10 con 0x7fce0c108af0 2024-08-31T04:23:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.034+0000 7fce0bfff640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 0x7fcdf40b7090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce0c102710 tx=0x7fcdfc00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.036+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fce04014030 con 0x7fce0c108af0 2024-08-31T04:23:40.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.259+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fce0c02e430 con 0x7fce0c108af0 2024-08-31T04:23:40.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.413+0000 7fce097fa640 1 -- 172.21.15.2:0/645719295 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fce040acc10 con 0x7fce0c108af0 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 msgr2=0x7fcdf40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 0x7fcdf40b7090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce0c102710 tx=0x7fcdfc00a2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 msgr2=0x7fce0c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce0400cce0 tx=0x7fce0400a620 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 shutdown_connections 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcdf40b4b80 0x7fcdf40b7090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce0c108af0 0x7fce0c19ba90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce0c1081a0 0x7fce0c19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 --2- 172.21.15.2:0/645719295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce0c102f30 0x7fce0c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 >> 172.21.15.2:0/645719295 conn(0x7fce0c079d30 msgr2=0x7fce0c1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 shutdown_connections 2024-08-31T04:23:40.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:40.416+0000 7fce1246b640 1 -- 172.21.15.2:0/645719295 wait complete. 2024-08-31T04:23:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: pgmap v284: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:active 2024-08-31T04:23:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:23:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:23:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:23:40.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T04:23:40.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:23:40.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:23:40.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:40 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: pgmap v284: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:active 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:23:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:40 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: pgmap v284: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] up:active 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:23:40.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:23:40.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T04:23:40.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:23:40.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:23:40.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:40 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:23:41.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T04:23:41.618 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:41 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:23:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:41 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:active 2024-08-31T04:23:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:41 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:23:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:41 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:41 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:23:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:41 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:active 2024-08-31T04:23:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:41 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:23:41.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:41 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:41.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:41 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/645719295' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:23:41.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:41 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] up:active 2024-08-31T04:23:41.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:41 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:23:41.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:41 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 -- 172.21.15.2:0/95050403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a9410dbb0 msgr2=0x7f7a941100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 --2- 172.21.15.2:0/95050403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a9410dbb0 0x7f7a941100a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009ca0 tx=0x7f7a8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 -- 172.21.15.2:0/95050403 shutdown_connections 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 --2- 172.21.15.2:0/95050403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a9410dbb0 0x7f7a941100a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 --2- 172.21.15.2:0/95050403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a941050a0 0x7f7a9410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 --2- 172.21.15.2:0/95050403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 0x7f7a94104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 -- 172.21.15.2:0/95050403 >> 172.21.15.2:0/95050403 conn(0x7f7a940794c0 msgr2=0x7f7a940798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 -- 172.21.15.2:0/95050403 shutdown_connections 2024-08-31T04:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.111+0000 7f7a9b271640 1 -- 172.21.15.2:0/95050403 wait complete. 2024-08-31T04:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 Processor -- start 2024-08-31T04:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 -- start start 2024-08-31T04:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 0x7f7a9419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a9410dbb0 0x7f7a9419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a94113830 con 0x7f7a941050a0 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7a941136b0 con 0x7f7a94104750 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9b271640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a941139b0 con 0x7f7a9410dbb0 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9880c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9880c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54462/0 (socket says 172.21.15.2:54462) 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9880c640 1 -- 172.21.15.2:0/1825255488 learned_addr learned my addr 172.21.15.2:0/1825255488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9900d640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 0x7f7a9419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.112+0000 7f7a9980e640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a9410dbb0 0x7f7a9419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 -- 172.21.15.2:0/1825255488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a9410dbb0 msgr2=0x7f7a9419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a9410dbb0 0x7f7a9419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 -- 172.21.15.2:0/1825255488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 msgr2=0x7f7a9419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 0x7f7a9419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 -- 172.21.15.2:0/1825255488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a941a0170 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9880c640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d750 tx=0x7f7a8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84017070 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a840054d0 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a941a0460 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84004c30 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.113+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a941a6bc0 con 0x7f7a941050a0 2024-08-31T04:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.114+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9406c020 con 0x7f7a941050a0 2024-08-31T04:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.116+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f7a84004dd0 con 0x7f7a941050a0 2024-08-31T04:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.117+0000 7f7a8a7fc640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 0x7f7a800b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.117+0000 7f7a9900d640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 0x7f7a800b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.117+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f7a840e4ea0 con 0x7f7a941050a0 2024-08-31T04:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.117+0000 7f7a9900d640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 0x7f7a800b7110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a9406c720 tx=0x7f7a9000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.121+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a840ab550 con 0x7f7a941050a0 2024-08-31T04:23:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.351+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a94108720 con 0x7f7a941050a0 2024-08-31T04:23:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.428+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/1825255488 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f7a840afd10 con 0x7f7a941050a0 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 msgr2=0x7f7a800b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 0x7f7a800b7110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a9406c720 tx=0x7f7a9000a2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 msgr2=0x7f7a9419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d750 tx=0x7f7a8400dc10 comp rx=0 tx=0).stop 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 shutdown_connections 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7a800b4c00 0x7f7a800b7110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a941050a0 0x7f7a9419a7a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a9410dbb0 0x7f7a9419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 --2- 172.21.15.2:0/1825255488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a94104750 0x7f7a9419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:42.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 >> 172.21.15.2:0/1825255488 conn(0x7f7a940794c0 msgr2=0x7f7a94100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:42.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 shutdown_connections 2024-08-31T04:23:42.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:42.430+0000 7f7a9b271640 1 -- 172.21.15.2:0/1825255488 wait complete. 2024-08-31T04:23:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:42 smithi002 ceph-mon[18656]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 383 B/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:23:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:42 smithi064 ceph-mon[22007]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 383 B/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:23:42.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:42 smithi132 ceph-mon[22335]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 383 B/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T04:23:42.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:23:43.273 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-08-31T04:23:43.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T04:23:43.317 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:23:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: 2024-08-31T04:23:42.878+0000 7f181c79b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-31T04:23:43.317 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:23:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: 2024-08-31T04:23:42.878+0000 7f181c79b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-31T04:23:43.529 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:43.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:43 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:23:43.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:43 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:43 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:23:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:43 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:43.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:43 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1825255488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:23:43.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:43 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:23:44.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 -- 172.21.15.2:0/2687372749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 msgr2=0x7f6dc010f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:44.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/2687372749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc010f300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009ca0 tx=0x7f6db802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 -- 172.21.15.2:0/2687372749 shutdown_connections 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/2687372749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc010f300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/2687372749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 0x7f6dc0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/2687372749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 -- 172.21.15.2:0/2687372749 >> 172.21.15.2:0/2687372749 conn(0x7f6dc00794f0 msgr2=0x7f6dc0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 -- 172.21.15.2:0/2687372749 shutdown_connections 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.153+0000 7f6dc49a2640 1 -- 172.21.15.2:0/2687372749 wait complete. 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 Processor -- start 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 -- start start 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:44.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 0x7f6dc019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc01127a0 con 0x7f6dc0108ad0 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0112620 con 0x7f6dc0108180 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dc49a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0112920 con 0x7f6dc0102840 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dbed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dbed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54476/0 (socket says 172.21.15.2:54476) 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dbed9d640 1 -- 172.21.15.2:0/3338561012 learned_addr learned my addr 172.21.15.2:0/3338561012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.154+0000 7f6dbdd9b640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 0x7f6dc019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbe59c640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 -- 172.21.15.2:0/3338561012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 msgr2=0x7f6dc019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 -- 172.21.15.2:0/3338561012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 msgr2=0x7f6dc019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:44.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 0x7f6dc019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 -- 172.21.15.2:0/3338561012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc01a0090 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbe59c640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dbed9d640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6db8005cc0 tx=0x7f6db802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8003bf0 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db8003d90 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc01a0320 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db802fb20 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.155+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01a0860 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.156+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc0102c50 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.158+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f6db8004580 con 0x7f6dc0108ad0 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.158+0000 7f6daf7fe640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 0x7f6da80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:44.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.159+0000 7f6dbe59c640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 0x7f6da80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:44.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.159+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f6db8106b90 con 0x7f6dc0108ad0 2024-08-31T04:23:44.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.159+0000 7f6dbe59c640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 0x7f6da80b70c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6db00058c0 tx=0x7f6db0005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:44.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.162+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6db80cd8c0 con 0x7f6dc0108ad0 2024-08-31T04:23:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.376+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6dc00635a0 con 0x7f6da80b4bb0 2024-08-31T04:23:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.407+0000 7f6daf7fe640 1 -- 172.21.15.2:0/3338561012 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6dc00635a0 con 0x7f6da80b4bb0 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 msgr2=0x7f6da80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 0x7f6da80b70c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6db00058c0 tx=0x7f6db0005850 comp rx=0 tx=0).stop 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 msgr2=0x7f6dc019fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6db8005cc0 tx=0x7f6db802f380 comp rx=0 tx=0).stop 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 shutdown_connections 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6da80b4bb0 0x7f6da80b70c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc0108ad0 0x7f6dc019fa20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6dc0108180 0x7f6dc019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 --2- 172.21.15.2:0/3338561012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dc0102840 0x7f6dc019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 >> 172.21.15.2:0/3338561012 conn(0x7f6dc00794f0 msgr2=0x7f6dc0101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 shutdown_connections 2024-08-31T04:23:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:44.409+0000 7f6dc49a2640 1 -- 172.21.15.2:0/3338561012 wait complete. 2024-08-31T04:23:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-mon[18656]: pgmap v286: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 59 B/s, 0 objects/s recovering 2024-08-31T04:23:44.647 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:23:44.382+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:23:44.647 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:23:44.382+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:23:44.647 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:23:44.382+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:23:44.647 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:23:44.382+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:23:44.648 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:23:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:23:44.382+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:23:44.719 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:44 smithi132 ceph-mon[22335]: pgmap v286: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 59 B/s, 0 objects/s recovering 2024-08-31T04:23:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:44 smithi064 ceph-mon[22007]: pgmap v286: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 59 B/s, 0 objects/s recovering 2024-08-31T04:23:45.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T04:23:45.322 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:45.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:45 smithi002 ceph-mon[18656]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:45 smithi064 ceph-mon[22007]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:45.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:45 smithi132 ceph-mon[22335]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 -- 172.21.15.2:0/348413821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108ac0 msgr2=0x7f98c010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 --2- 172.21.15.2:0/348413821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108ac0 0x7f98c010f2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009ca0 tx=0x7f98b802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 -- 172.21.15.2:0/348413821 shutdown_connections 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 --2- 172.21.15.2:0/348413821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108ac0 0x7f98c010f2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 --2- 172.21.15.2:0/348413821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108170 0x7f98c0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 --2- 172.21.15.2:0/348413821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 -- 172.21.15.2:0/348413821 >> 172.21.15.2:0/348413821 conn(0x7f98c0079500 msgr2=0x7f98c0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 -- 172.21.15.2:0/348413821 shutdown_connections 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.881+0000 7f98c676e640 1 -- 172.21.15.2:0/348413821 wait complete. 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.882+0000 7f98c676e640 1 Processor -- start 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.882+0000 7f98c676e640 1 -- start start 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108ac0 0x7f98c019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0113850 con 0x7f98c0108170 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01136d0 con 0x7f98c0102880 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01139d0 con 0x7f98c0108ac0 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40940/0 (socket says 172.21.15.2:40940) 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 -- 172.21.15.2:0/4118561003 learned_addr learned my addr 172.21.15.2:0/4118561003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c4d0b640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108ac0 0x7f98c019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bffff640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 -- 172.21.15.2:0/4118561003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108ac0 msgr2=0x7f98c019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108ac0 0x7f98c019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 -- 172.21.15.2:0/4118561003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 msgr2=0x7f98c019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 -- 172.21.15.2:0/4118561003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c019fff0 con 0x7f98c0108170 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bffff640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bf7fe640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98b400c970 tx=0x7f98b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014070 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98b4004440 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4003e50 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.883+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c01a02e0 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.884+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c01a6b00 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.885+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c0103ab0 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.886+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f98b4017070 con 0x7f98c0108170 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.887+0000 7f98bd7fa640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 0x7f98a80b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.887+0000 7f98bffff640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 0x7f98a80b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.887+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f98b40e5a20 con 0x7f98c0108170 2024-08-31T04:23:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.887+0000 7f98bffff640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 0x7f98a80b72f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98b000baa0 tx=0x7f98b0005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:45.890+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98b401e030 con 0x7f98c0108170 2024-08-31T04:23:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.100+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f98c00635a0 con 0x7f98a80b4de0 2024-08-31T04:23:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.130+0000 7f98bd7fa640 1 -- 172.21.15.2:0/4118561003 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f98c00635a0 con 0x7f98a80b4de0 2024-08-31T04:23:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 msgr2=0x7f98a80b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 0x7f98a80b72f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98b000baa0 tx=0x7f98b0005d90 comp rx=0 tx=0).stop 2024-08-31T04:23:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 msgr2=0x7f98c019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98b400c970 tx=0x7f98b400ce30 comp rx=0 tx=0).stop 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 shutdown_connections 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98a80b4de0 0x7f98a80b72f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98c0108170 0x7f98c019a6e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c0108ac0 0x7f98c019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 --2- 172.21.15.2:0/4118561003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98c0102880 0x7f98c019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 >> 172.21.15.2:0/4118561003 conn(0x7f98c0079500 msgr2=0x7f98c0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 shutdown_connections 2024-08-31T04:23:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:46.133+0000 7f98c676e640 1 -- 172.21.15.2:0/4118561003 wait complete. 2024-08-31T04:23:46.718 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:46 smithi064 ceph-mon[22007]: pgmap v287: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 54 B/s, 0 objects/s recovering 2024-08-31T04:23:46.718 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:46 smithi064 ceph-mon[22007]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T04:23:46.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:46 smithi002 ceph-mon[18656]: pgmap v287: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 54 B/s, 0 objects/s recovering 2024-08-31T04:23:46.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:46 smithi002 ceph-mon[18656]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T04:23:46.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T04:23:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:46 smithi132 ceph-mon[22335]: pgmap v287: 129 pgs: 129 active+clean; 584 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 54 B/s, 0 objects/s recovering 2024-08-31T04:23:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:46 smithi132 ceph-mon[22335]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T04:23:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 -- 172.21.15.2:0/4284600844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 msgr2=0x7efcbc10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 --2- 172.21.15.2:0/4284600844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc10f320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ca0 tx=0x7efcb402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 -- 172.21.15.2:0/4284600844 shutdown_connections 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 --2- 172.21.15.2:0/4284600844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc10f320 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 --2- 172.21.15.2:0/4284600844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 --2- 172.21.15.2:0/4284600844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc1033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 -- 172.21.15.2:0/4284600844 >> 172.21.15.2:0/4284600844 conn(0x7efcbc079d30 msgr2=0x7efcbc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 -- 172.21.15.2:0/4284600844 shutdown_connections 2024-08-31T04:23:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.517+0000 7efcc081e640 1 -- 172.21.15.2:0/4284600844 wait complete. 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 Processor -- start 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 -- start start 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc112770 con 0x7efcbc1058d0 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc1125f0 con 0x7efcbc102fb0 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcc081e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc1128f0 con 0x7efcbc104f80 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40972/0 (socket says 172.21.15.2:40972) 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 -- 172.21.15.2:0/322261879 learned_addr learned my addr 172.21.15.2:0/322261879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcba59c640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcb9d9b640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 -- 172.21.15.2:0/322261879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 msgr2=0x7efcbc199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 -- 172.21.15.2:0/322261879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 msgr2=0x7efcbc199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcbad9d640 1 -- 172.21.15.2:0/322261879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc19f0d0 con 0x7efcbc1058d0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcb9d9b640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.518+0000 7efcba59c640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcbad9d640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcb40098d0 tx=0x7efcb40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4003b70 con 0x7efcbc1058d0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcb4003d10 con 0x7efcbc1058d0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc19f360 con 0x7efcbc1058d0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb402fa20 con 0x7efcbc1058d0 2024-08-31T04:23:47.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.519+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc1a5b20 con 0x7efcbc1058d0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.520+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc1033c0 con 0x7efcbc1058d0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.521+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7efcb402fbe0 con 0x7efcbc1058d0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.522+0000 7efcab7fe640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 0x7efca40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.522+0000 7efcba59c640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 0x7efca40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.522+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7efcb4106cf0 con 0x7efcbc1058d0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.523+0000 7efcba59c640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 0x7efca40b7120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efcac009c20 tx=0x7efcac005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.526+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efcb40cd890 con 0x7efcbc1058d0 2024-08-31T04:23:47.729 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:47 smithi064 ceph-mon[22007]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.743+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7efcbc10a940 con 0x7efca40b4c10 2024-08-31T04:23:47.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:47 smithi002 ceph-mon[18656]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.748+0000 7efcab7fe640 1 -- 172.21.15.2:0/322261879 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7efcbc10a940 con 0x7efca40b4c10 2024-08-31T04:23:47.749 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/e21e45d1-97c9-48bd-a6d9-5d10090a69b5 2024-08-31T04:23:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 msgr2=0x7efca40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 0x7efca40b7120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efcac009c20 tx=0x7efcac005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 msgr2=0x7efcbc19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcb40098d0 tx=0x7efcb40317b0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 shutdown_connections 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efca40b4c10 0x7efca40b7120 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcbc1058d0 0x7efcbc19e9a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc104f80 0x7efcbc199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 --2- 172.21.15.2:0/322261879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcbc102fb0 0x7efcbc199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 >> 172.21.15.2:0/322261879 conn(0x7efcbc079d30 msgr2=0x7efcbc106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 shutdown_connections 2024-08-31T04:23:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:47.750+0000 7efcc081e640 1 -- 172.21.15.2:0/322261879 wait complete. 2024-08-31T04:23:47.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:47 smithi132 ceph-mon[22335]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:48.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T04:23:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:48 smithi002 ceph-mon[18656]: pgmap v288: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T04:23:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:48 smithi002 ceph-mon[18656]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:48 smithi064 ceph-mon[22007]: pgmap v288: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T04:23:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:48 smithi064 ceph-mon[22007]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:48.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:48 smithi132 ceph-mon[22335]: pgmap v288: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T04:23:48.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:48 smithi132 ceph-mon[22335]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 -- 172.21.15.2:0/255516276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e010fea0 msgr2=0x7f56e01122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 --2- 172.21.15.2:0/255516276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e010fea0 0x7f56e01122c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009ca0 tx=0x7f56d802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 -- 172.21.15.2:0/255516276 shutdown_connections 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 --2- 172.21.15.2:0/255516276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e010fea0 0x7f56e01122c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 --2- 172.21.15.2:0/255516276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e0075e60 0x7f56e010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 --2- 172.21.15.2:0/255516276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 0x7f56e0075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 -- 172.21.15.2:0/255516276 >> 172.21.15.2:0/255516276 conn(0x7f56e007b5f0 msgr2=0x7f56e007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 -- 172.21.15.2:0/255516276 shutdown_connections 2024-08-31T04:23:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.049+0000 7f56e8454640 1 -- 172.21.15.2:0/255516276 wait complete. 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 Processor -- start 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 -- start start 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 0x7f56e019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 0x7f56e01a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0115a30 con 0x7f56e0075e60 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56e01158b0 con 0x7f56e0075510 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e8454640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0115bb0 con 0x7f56e010fea0 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40984/0 (socket says 172.21.15.2:40984) 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 -- 172.21.15.2:0/3262936273 learned_addr learned my addr 172.21.15.2:0/3262936273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e61f0640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 0x7f56e019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e69f1640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 0x7f56e01a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 -- 172.21.15.2:0/3262936273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 msgr2=0x7f56e01a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 0x7f56e01a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 -- 172.21.15.2:0/3262936273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 msgr2=0x7f56e019c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 0x7f56e019c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e59ef640 1 -- 172.21.15.2:0/3262936273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01a2350 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.050+0000 7f56e69f1640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 0x7f56e01a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56e59ef640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56d0005d00 tx=0x7f56d000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0017070 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d0009c30 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01a2640 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d000f620 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.051+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01a8da0 con 0x7f56e0075e60 2024-08-31T04:23:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.052+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0075920 con 0x7f56e0075e60 2024-08-31T04:23:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.053+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f56d001a070 con 0x7f56e0075e60 2024-08-31T04:23:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.054+0000 7f56d77fe640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 0x7f56cc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.055+0000 7f56e61f0640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 0x7f56cc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.055+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f56d00e5170 con 0x7f56e0075e60 2024-08-31T04:23:49.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.055+0000 7f56e61f0640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 0x7f56cc0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00bbe0 tx=0x7f56dc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:49.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.058+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56d0009de0 con 0x7f56e0075e60 2024-08-31T04:23:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.269+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f56e010a130 con 0x7f56cc0b4c10 2024-08-31T04:23:49.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.294+0000 7f56d77fe640 1 -- 172.21.15.2:0/3262936273 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f56e010a130 con 0x7f56cc0b4c10 2024-08-31T04:23:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 msgr2=0x7f56cc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 0x7f56cc0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00bbe0 tx=0x7f56dc00b390 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 msgr2=0x7f56e019c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56d0005d00 tx=0x7f56d000dde0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 shutdown_connections 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56cc0b4c10 0x7f56cc0b7120 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56e0075e60 0x7f56e019c980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e010fea0 0x7f56e01a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 --2- 172.21.15.2:0/3262936273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56e0075510 0x7f56e019c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 >> 172.21.15.2:0/3262936273 conn(0x7f56e007b5f0 msgr2=0x7f56e0109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 shutdown_connections 2024-08-31T04:23:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:49.296+0000 7f56e8454640 1 -- 172.21.15.2:0/3262936273 wait complete. 2024-08-31T04:23:49.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T04:23:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:50 smithi002 ceph-mon[18656]: pgmap v289: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:50 smithi002 ceph-mon[18656]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 -- 172.21.15.2:0/967161834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 msgr2=0x7f2d34103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/967161834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d34103d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009900 tx=0x7f2d2802a410 comp rx=0 tx=0).stop 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 -- 172.21.15.2:0/967161834 shutdown_connections 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/967161834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 0x7f2d341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/967161834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 0x7f2d34109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/967161834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d34103d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 -- 172.21.15.2:0/967161834 >> 172.21.15.2:0/967161834 conn(0x7f2d3407b5f0 msgr2=0x7f2d3407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 -- 172.21.15.2:0/967161834 shutdown_connections 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.744+0000 7f2d3ae65640 1 -- 172.21.15.2:0/967161834 wait complete. 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 Processor -- start 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 -- start start 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 0x7f2d3419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 0x7f2d3419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34113850 con 0x7f2d34103900 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2d341136d0 con 0x7f2d34109240 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d3ae65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2d341139d0 con 0x7f2d34109b90 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d38c01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d38c01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41006/0 (socket says 172.21.15.2:41006) 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d38c01640 1 -- 172.21.15.2:0/4091110941 learned_addr learned my addr 172.21.15.2:0/4091110941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d33fff640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 0x7f2d3419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.745+0000 7f2d39402640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 0x7f2d3419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 -- 172.21.15.2:0/4091110941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 msgr2=0x7f2d3419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 0x7f2d3419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 -- 172.21.15.2:0/4091110941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 msgr2=0x7f2d3419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 0x7f2d3419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 -- 172.21.15.2:0/4091110941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341a0290 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d38c01640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2d28005940 tx=0x7f2d280040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2803f030 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d341a0520 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d280044c0 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28035070 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.746+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d341a6ce0 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.748+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d34103d10 con 0x7f2d34103900 2024-08-31T04:23:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.749+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f2d28042030 con 0x7f2d34103900 2024-08-31T04:23:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.750+0000 7f2d31ffb640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 0x7f2d240b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.750+0000 7f2d33fff640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 0x7f2d240b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.750+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f2d28105d30 con 0x7f2d34103900 2024-08-31T04:23:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.750+0000 7f2d33fff640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 0x7f2d240b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d34108fa0 tx=0x7f2d20005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.753+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2d280cc220 con 0x7f2d34103900 2024-08-31T04:23:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:50 smithi064 ceph-mon[22007]: pgmap v289: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:50 smithi064 ceph-mon[22007]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:50 smithi132 ceph-mon[22335]: pgmap v289: 129 pgs: 129 active+clean; 591 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:50 smithi132 ceph-mon[22335]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:50.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.970+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2d3410b9c0 con 0x7f2d240b4c10 2024-08-31T04:23:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.976+0000 7f2d31ffb640 1 -- 172.21.15.2:0/4091110941 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2d3410b9c0 con 0x7f2d240b4c10 2024-08-31T04:23:50.977 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/8a650a09-e3bb-42b7-a91b-e46279072352 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 msgr2=0x7f2d240b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 0x7f2d240b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d34108fa0 tx=0x7f2d20005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 msgr2=0x7f2d3419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2d28005940 tx=0x7f2d280040c0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 shutdown_connections 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d34109b90 0x7f2d3419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d34109240 0x7f2d3419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2d240b4c10 0x7f2d240b7120 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 --2- 172.21.15.2:0/4091110941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d34103900 0x7f2d3419a320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.978+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 >> 172.21.15.2:0/4091110941 conn(0x7f2d3407b5f0 msgr2=0x7f2d341073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.979+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 shutdown_connections 2024-08-31T04:23:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:50.979+0000 7f2d3ae65640 1 -- 172.21.15.2:0/4091110941 wait complete. 2024-08-31T04:23:51.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 -- 172.21.15.2:0/1351448862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc102fd0 msgr2=0x7f70cc1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 --2- 172.21.15.2:0/1351448862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc102fd0 0x7f70cc1033e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009900 tx=0x7f70bc02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 -- 172.21.15.2:0/1351448862 shutdown_connections 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 --2- 172.21.15.2:0/1351448862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc108b50 0x7f70cc10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 --2- 172.21.15.2:0/1351448862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 0x7f70cc108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 --2- 172.21.15.2:0/1351448862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc102fd0 0x7f70cc1033e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 -- 172.21.15.2:0/1351448862 >> 172.21.15.2:0/1351448862 conn(0x7f70cc079c60 msgr2=0x7f70cc07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 -- 172.21.15.2:0/1351448862 shutdown_connections 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.367+0000 7f70d2881640 1 -- 172.21.15.2:0/1351448862 wait complete. 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.368+0000 7f70d2881640 1 Processor -- start 2024-08-31T04:23:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.368+0000 7f70d2881640 1 -- start start 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 0x7f70cc19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 0x7f70cc19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc1127f0 con 0x7f70cc108b50 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc112670 con 0x7f70cc102fd0 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc112970 con 0x7f70cc108200 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41014/0 (socket says 172.21.15.2:41014) 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 -- 172.21.15.2:0/3788217689 learned_addr learned my addr 172.21.15.2:0/3788217689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70cbfff640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 0x7f70cc19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70cb7fe640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 0x7f70cc19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 -- 172.21.15.2:0/3788217689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 msgr2=0x7f70cc19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 0x7f70cc19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 -- 172.21.15.2:0/3788217689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 msgr2=0x7f70cc19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 0x7f70cc19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 -- 172.21.15.2:0/3788217689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc1a6370 con 0x7f70cc108b50 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70cbfff640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 0x7f70cc19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d0e1e640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70c400eb10 tx=0x7f70c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4004b20 con 0x7f70cc108b50 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70c4004cc0 con 0x7f70cc108b50 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc1a6660 con 0x7f70cc108b50 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.369+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4010670 con 0x7f70cc108b50 2024-08-31T04:23:52.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.370+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc1a6b50 con 0x7f70cc108b50 2024-08-31T04:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.370+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70cc1033e0 con 0x7f70cc108b50 2024-08-31T04:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.373+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f70c4010810 con 0x7f70cc108b50 2024-08-31T04:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.374+0000 7f70c97fa640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 0x7f70b40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.374+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f70c40e5fd0 con 0x7f70cc108b50 2024-08-31T04:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.374+0000 7f70cbfff640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 0x7f70b40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.375+0000 7f70cbfff640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 0x7f70b40b7150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000c00 tx=0x7f70bc009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.377+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70c4056130 con 0x7f70cc108b50 2024-08-31T04:23:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.599+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70cc102040 con 0x7f70cc108b50 2024-08-31T04:23:52.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:52 smithi002 ceph-mon[18656]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:52.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:52 smithi002 ceph-mon[18656]: pgmap v290: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:52.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.600+0000 7f70c97fa640 1 -- 172.21.15.2:0/3788217689 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f70c40acb10 con 0x7f70cc108b50 2024-08-31T04:23:52.602 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:52.602 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:23:52.602 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:23:52.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 msgr2=0x7f70b40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:52.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 0x7f70b40b7150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000c00 tx=0x7f70bc009680 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 msgr2=0x7f70cc19bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70c400eb10 tx=0x7f70c400c2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 shutdown_connections 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70b40b4c40 0x7f70b40b7150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc108b50 0x7f70cc19bb60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc108200 0x7f70cc19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 --2- 172.21.15.2:0/3788217689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70cc102fd0 0x7f70cc19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 >> 172.21.15.2:0/3788217689 conn(0x7f70cc079c60 msgr2=0x7f70cc1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 shutdown_connections 2024-08-31T04:23:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:52.603+0000 7f70d2881640 1 -- 172.21.15.2:0/3788217689 wait complete. 2024-08-31T04:23:52.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:52 smithi064 ceph-mon[22007]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:52.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:52 smithi064 ceph-mon[22007]: pgmap v290: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:52 smithi132 ceph-mon[22335]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:52 smithi132 ceph-mon[22335]: pgmap v290: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T04:23:53.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:53.530 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:53.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:53 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3788217689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:53.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:53 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:53.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:53 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3788217689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:53.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:53 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:53 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3788217689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:53 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:54.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:54 smithi002 ceph-mon[18656]: pgmap v291: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-08-31T04:23:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 -- 172.21.15.2:0/86927925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108a90 msgr2=0x7f37c410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/86927925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108a90 0x7f37c410f2c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009ca0 tx=0x7f37bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 -- 172.21.15.2:0/86927925 shutdown_connections 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/86927925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108a90 0x7f37c410f2c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/86927925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4108140 0x7f37c4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/86927925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4102800 0x7f37c4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 -- 172.21.15.2:0/86927925 >> 172.21.15.2:0/86927925 conn(0x7f37c40794d0 msgr2=0x7f37c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 -- 172.21.15.2:0/86927925 shutdown_connections 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.678+0000 7f37cc7f8640 1 -- 172.21.15.2:0/86927925 wait complete. 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 Processor -- start 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 -- start start 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108140 0x7f37c419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4108a90 0x7f37c419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4112710 con 0x7f37c4108140 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4112590 con 0x7f37c4102800 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cc7f8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4112890 con 0x7f37c4108a90 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37c9d93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108140 0x7f37c419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37ca594640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37ca594640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:44460/0 (socket says 172.21.15.2:44460) 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37ca594640 1 -- 172.21.15.2:0/475275645 learned_addr learned my addr 172.21.15.2:0/475275645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.679+0000 7f37cad95640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4108a90 0x7f37c419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 -- 172.21.15.2:0/475275645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4108a90 msgr2=0x7f37c419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4108a90 0x7f37c419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 -- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108140 msgr2=0x7f37c419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108140 0x7f37c419b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 -- 172.21.15.2:0/475275645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c41a63b0 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37ca594640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e9f0 tx=0x7f37c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c000cd80 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37c00054d0 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0010690 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c41a66a0 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.680+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c41a6b90 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.681+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c4102c10 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.683+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f37c0004e50 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.683+0000 7f37bb7fe640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 0x7f37b00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.683+0000 7f37c9d93640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 0x7f37b00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.684+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f37c00e5b90 con 0x7f37c4102800 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.684+0000 7f37c9d93640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 0x7f37b00b7150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37c4105d20 tx=0x7f37b4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.688+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37c00ac6d0 con 0x7f37c4102800 2024-08-31T04:23:54.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:54 smithi064 ceph-mon[22007]: pgmap v291: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-08-31T04:23:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:54 smithi132 ceph-mon[22335]: pgmap v291: 129 pgs: 129 active+clean; 623 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-08-31T04:23:54.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.882+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37c410a2f0 con 0x7f37c4102800 2024-08-31T04:23:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.884+0000 7f37bb7fe640 1 -- 172.21.15.2:0/475275645 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24908 (secure 0 0 0) 0x7f37c00abfd0 con 0x7f37c4102800 2024-08-31T04:23:54.886 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:54.886 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:34.362402+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 msgr2=0x7f37b00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 0x7f37b00b7150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37c4105d20 tx=0x7f37b4005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 msgr2=0x7f37c419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e9f0 tx=0x7f37c000edf0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 shutdown_connections 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f37b00b4c40 0x7f37b00b7150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37c4108140 0x7f37c419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c4108a90 0x7f37c419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 --2- 172.21.15.2:0/475275645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c4102800 0x7f37c419b120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 >> 172.21.15.2:0/475275645 conn(0x7f37c40794d0 msgr2=0x7f37c41041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.887+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 shutdown_connections 2024-08-31T04:23:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:54.888+0000 7f37cc7f8640 1 -- 172.21.15.2:0/475275645 wait complete. 2024-08-31T04:23:55.540 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T04:23:55.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:23:55.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:55 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:55 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/475275645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:55.818 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:55.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:55 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:55 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/475275645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:55.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:55 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:55.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:55 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/475275645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:56.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 -- 172.21.15.2:0/3284285867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0101fe0 msgr2=0x7f58c01023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 --2- 172.21.15.2:0/3284285867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0101fe0 0x7f58c01023f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009900 tx=0x7f58bc02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 -- 172.21.15.2:0/3284285867 shutdown_connections 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 --2- 172.21.15.2:0/3284285867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0108270 0x7f58c010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 --2- 172.21.15.2:0/3284285867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 0x7f58c0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 --2- 172.21.15.2:0/3284285867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0101fe0 0x7f58c01023f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 -- 172.21.15.2:0/3284285867 >> 172.21.15.2:0/3284285867 conn(0x7f58c0079d30 msgr2=0x7f58c007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 -- 172.21.15.2:0/3284285867 shutdown_connections 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.338+0000 7f58c7dab640 1 -- 172.21.15.2:0/3284285867 wait complete. 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 Processor -- start 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 -- start start 2024-08-31T04:23:56.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0101fe0 0x7f58c01980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 0x7f58c0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58c01116b0 con 0x7f58c0108270 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0111530 con 0x7f58c0101fe0 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c7dab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0111830 con 0x7f58c0107920 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c6348640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c6348640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36904/0 (socket says 172.21.15.2:36904) 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.339+0000 7f58c6348640 1 -- 172.21.15.2:0/914595658 learned_addr learned my addr 172.21.15.2:0/914595658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c5b47640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0101fe0 0x7f58c01980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c5346640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 0x7f58c0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 -- 172.21.15.2:0/914595658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 msgr2=0x7f58c0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:56.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 0x7f58c0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 -- 172.21.15.2:0/914595658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0101fe0 msgr2=0x7f58c01980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0101fe0 0x7f58c01980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 -- 172.21.15.2:0/914595658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c019e010 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c6348640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f58b800eb10 tx=0x7f58b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8004b20 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b8004cc0 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c019e300 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8010670 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.340+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01a4a60 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.341+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c01023f0 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.343+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f58b8005000 con 0x7f58c0108270 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.344+0000 7f58b6ffd640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 0x7f58ac0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:56.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.344+0000 7f58c5b47640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 0x7f58ac0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:56.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.344+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f58b80e5f20 con 0x7f58c0108270 2024-08-31T04:23:56.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.344+0000 7f58c5b47640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 0x7f58ac0b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58bc031440 tx=0x7f58bc009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:56.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.347+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f58b8056130 con 0x7f58c0108270 2024-08-31T04:23:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.528+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58c00635a0 con 0x7f58ac0b4c10 2024-08-31T04:23:56.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.534+0000 7f58b6ffd640 1 -- 172.21.15.2:0/914595658 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340316 (secure 0 0 0) 0x7f58c00635a0 con 0x7f58ac0b4c10 2024-08-31T04:23:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:23:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.537+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 msgr2=0x7f58ac0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 0x7f58ac0b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58bc031440 tx=0x7f58bc009560 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 msgr2=0x7f58c019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f58b800eb10 tx=0x7f58b800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 shutdown_connections 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f58ac0b4c10 0x7f58ac0b7120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c0108270 0x7f58c019d8e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c0107920 0x7f58c0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 --2- 172.21.15.2:0/914595658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c0101fe0 0x7f58c01980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 >> 172.21.15.2:0/914595658 conn(0x7f58c0079d30 msgr2=0x7f58c0105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 shutdown_connections 2024-08-31T04:23:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:56.538+0000 7f58c7dab640 1 -- 172.21.15.2:0/914595658 wait complete. 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: pgmap v292: 129 pgs: 129 active+clean; 623 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:56 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: pgmap v292: 129 pgs: 129 active+clean; 623 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:57.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:56 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: pgmap v292: 129 pgs: 129 active+clean; 623 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-08-31T04:23:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:57.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:56 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:23:57.232 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-08-31T04:23:55.076504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638335,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":275,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":403972,"kb_used_data":13124,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537852,"statfs":{"total":1151940427776,"available":1151526760448,"internally_reserved":0,"allocated":13438976,"data_stored":7659611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40627,"num_objects":7,"num_object_clones":0,"num_object_copies":23,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":72,"num_read_kb":78,"num_write":31,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003675"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426129+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:23:39.426129+0000","last_peered":"2024-08-31T04:23:39.426129+0000","last_clean":"2024-08-31T04:23:39.426129+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:23:39.426129+0000","last_undegraded":"2024-08-31T04:23:39.426129+0000","last_fullsized":"2024-08-31T04:23:39.426129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495109+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:23:34.495109+0000","last_peered":"2024-08-31T04:23:34.495109+0000","last_clean":"2024-08-31T04:23:34.495109+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:23:34.495109+0000","last_undegraded":"2024-08-31T04:23:34.495109+0000","last_fullsized":"2024-08-31T04:23:34.495109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371312+0000","last_change":"2024-08-31T04:23:04.284623+0000","last_active":"2024-08-31T04:23:34.371312+0000","last_peered":"2024-08-31T04:23:34.371312+0000","last_clean":"2024-08-31T04:23:34.371312+0000","last_became_active":"2024-08-31T04:23:04.284191+0000","last_became_peered":"2024-08-31T04:23:04.284191+0000","last_unstale":"2024-08-31T04:23:34.371312+0000","last_undegraded":"2024-08-31T04:23:34.371312+0000","last_fullsized":"2024-08-31T04:23:34.371312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:25.476317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495348+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:23:34.495348+0000","last_peered":"2024-08-31T04:23:34.495348+0000","last_clean":"2024-08-31T04:23:34.495348+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:23:34.495348+0000","last_undegraded":"2024-08-31T04:23:34.495348+0000","last_fullsized":"2024-08-31T04:23:34.495348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369945+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:23:34.369945+0000","last_peered":"2024-08-31T04:23:34.369945+0000","last_clean":"2024-08-31T04:23:34.369945+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:23:34.369945+0000","last_undegraded":"2024-08-31T04:23:34.369945+0000","last_fullsized":"2024-08-31T04:23:34.369945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369632+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:23:34.369632+0000","last_peered":"2024-08-31T04:23:34.369632+0000","last_clean":"2024-08-31T04:23:34.369632+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:23:34.369632+0000","last_undegraded":"2024-08-31T04:23:34.369632+0000","last_fullsized":"2024-08-31T04:23:34.369632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.423415+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:23:39.423415+0000","last_peered":"2024-08-31T04:23:39.423415+0000","last_clean":"2024-08-31T04:23:39.423415+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:23:39.423415+0000","last_undegraded":"2024-08-31T04:23:39.423415+0000","last_fullsized":"2024-08-31T04:23:39.423415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495890+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:23:34.495890+0000","last_peered":"2024-08-31T04:23:34.495890+0000","last_clean":"2024-08-31T04:23:34.495890+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:23:34.495890+0000","last_undegraded":"2024-08-31T04:23:34.495890+0000","last_fullsized":"2024-08-31T04:23:34.495890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370529+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:23:34.370529+0000","last_peered":"2024-08-31T04:23:34.370529+0000","last_clean":"2024-08-31T04:23:34.370529+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:23:34.370529+0000","last_undegraded":"2024-08-31T04:23:34.370529+0000","last_fullsized":"2024-08-31T04:23:34.370529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372539+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:23:34.372539+0000","last_peered":"2024-08-31T04:23:34.372539+0000","last_clean":"2024-08-31T04:23:34.372539+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:23:34.372539+0000","last_undegraded":"2024-08-31T04:23:34.372539+0000","last_fullsized":"2024-08-31T04:23:34.372539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373216+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:23:34.373216+0000","last_peered":"2024-08-31T04:23:34.373216+0000","last_clean":"2024-08-31T04:23:34.373216+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:23:34.373216+0000","last_undegraded":"2024-08-31T04:23:34.373216+0000","last_fullsized":"2024-08-31T04:23:34.373216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370147+0000","last_change":"2024-08-31T04:23:04.278183+0000","last_active":"2024-08-31T04:23:34.370147+0000","last_peered":"2024-08-31T04:23:34.370147+0000","last_clean":"2024-08-31T04:23:34.370147+0000","last_became_active":"2024-08-31T04:23:04.277694+0000","last_became_peered":"2024-08-31T04:23:04.277694+0000","last_unstale":"2024-08-31T04:23:34.370147+0000","last_undegraded":"2024-08-31T04:23:34.370147+0000","last_fullsized":"2024-08-31T04:23:34.370147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:15:36.985643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375004+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:23:34.375004+0000","last_peered":"2024-08-31T04:23:34.375004+0000","last_clean":"2024-08-31T04:23:34.375004+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:23:34.375004+0000","last_undegraded":"2024-08-31T04:23:34.375004+0000","last_fullsized":"2024-08-31T04:23:34.375004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413112+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:23:38.413112+0000","last_peered":"2024-08-31T04:23:38.413112+0000","last_clean":"2024-08-31T04:23:38.413112+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:23:38.413112+0000","last_undegraded":"2024-08-31T04:23:38.413112+0000","last_fullsized":"2024-08-31T04:23:38.413112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370717+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:23:34.370717+0000","last_peered":"2024-08-31T04:23:34.370717+0000","last_clean":"2024-08-31T04:23:34.370717+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:23:34.370717+0000","last_undegraded":"2024-08-31T04:23:34.370717+0000","last_fullsized":"2024-08-31T04:23:34.370717+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494855+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:23:34.494855+0000","last_peered":"2024-08-31T04:23:34.494855+0000","last_clean":"2024-08-31T04:23:34.494855+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:23:34.494855+0000","last_undegraded":"2024-08-31T04:23:34.494855+0000","last_fullsized":"2024-08-31T04:23:34.494855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372057+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:23:34.372057+0000","last_peered":"2024-08-31T04:23:34.372057+0000","last_clean":"2024-08-31T04:23:34.372057+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:23:34.372057+0000","last_undegraded":"2024-08-31T04:23:34.372057+0000","last_fullsized":"2024-08-31T04:23:34.372057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371242+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:23:34.371242+0000","last_peered":"2024-08-31T04:23:34.371242+0000","last_clean":"2024-08-31T04:23:34.371242+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:23:34.371242+0000","last_undegraded":"2024-08-31T04:23:34.371242+0000","last_fullsized":"2024-08-31T04:23:34.371242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366977+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:23:34.366977+0000","last_peered":"2024-08-31T04:23:34.366977+0000","last_clean":"2024-08-31T04:23:34.366977+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:23:34.366977+0000","last_undegraded":"2024-08-31T04:23:34.366977+0000","last_fullsized":"2024-08-31T04:23:34.366977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413722+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:23:38.413722+0000","last_peered":"2024-08-31T04:23:38.413722+0000","last_clean":"2024-08-31T04:23:38.413722+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:23:38.413722+0000","last_undegraded":"2024-08-31T04:23:38.413722+0000","last_fullsized":"2024-08-31T04:23:38.413722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369813+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:23:34.369813+0000","last_peered":"2024-08-31T04:23:34.369813+0000","last_clean":"2024-08-31T04:23:34.369813+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:23:34.369813+0000","last_undegraded":"2024-08-31T04:23:34.369813+0000","last_fullsized":"2024-08-31T04:23:34.369813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371348+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:23:34.371348+0000","last_peered":"2024-08-31T04:23:34.371348+0000","last_clean":"2024-08-31T04:23:34.371348+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:23:34.371348+0000","last_undegraded":"2024-08-31T04:23:34.371348+0000","last_fullsized":"2024-08-31T04:23:34.371348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.412128+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:23:38.412128+0000","last_peered":"2024-08-31T04:23:38.412128+0000","last_clean":"2024-08-31T04:23:38.412128+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:23:38.412128+0000","last_undegraded":"2024-08-31T04:23:38.412128+0000","last_fullsized":"2024-08-31T04:23:38.412128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370634+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:23:34.370634+0000","last_peered":"2024-08-31T04:23:34.370634+0000","last_clean":"2024-08-31T04:23:34.370634+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:23:34.370634+0000","last_undegraded":"2024-08-31T04:23:34.370634+0000","last_fullsized":"2024-08-31T04:23:34.370634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369702+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:23:34.369702+0000","last_peered":"2024-08-31T04:23:34.369702+0000","last_clean":"2024-08-31T04:23:34.369702+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:23:34.369702+0000","last_undegraded":"2024-08-31T04:23:34.369702+0000","last_fullsized":"2024-08-31T04:23:34.369702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.411360+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:23:38.411360+0000","last_peered":"2024-08-31T04:23:38.411360+0000","last_clean":"2024-08-31T04:23:38.411360+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:23:38.411360+0000","last_undegraded":"2024-08-31T04:23:38.411360+0000","last_fullsized":"2024-08-31T04:23:38.411360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371750+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:23:34.371750+0000","last_peered":"2024-08-31T04:23:34.371750+0000","last_clean":"2024-08-31T04:23:34.371750+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:23:34.371750+0000","last_undegraded":"2024-08-31T04:23:34.371750+0000","last_fullsized":"2024-08-31T04:23:34.371750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495252+0000","last_change":"2024-08-31T04:22:57.251361+0000","last_active":"2024-08-31T04:23:34.495252+0000","last_peered":"2024-08-31T04:23:34.495252+0000","last_clean":"2024-08-31T04:23:34.495252+0000","last_became_active":"2024-08-31T04:22:57.250958+0000","last_became_peered":"2024-08-31T04:22:57.250958+0000","last_unstale":"2024-08-31T04:23:34.495252+0000","last_undegraded":"2024-08-31T04:23:34.495252+0000","last_fullsized":"2024-08-31T04:23:34.495252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:12:39.004877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'6","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:46.242834+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:23:46.242834+0000","last_peered":"2024-08-31T04:23:46.242834+0000","last_clean":"2024-08-31T04:23:46.242834+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:23:46.242834+0000","last_undegraded":"2024-08-31T04:23:46.242834+0000","last_fullsized":"2024-08-31T04:23:46.242834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494557+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:23:34.494557+0000","last_peered":"2024-08-31T04:23:34.494557+0000","last_clean":"2024-08-31T04:23:34.494557+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:23:34.494557+0000","last_undegraded":"2024-08-31T04:23:34.494557+0000","last_fullsized":"2024-08-31T04:23:34.494557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366106+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:23:34.366106+0000","last_peered":"2024-08-31T04:23:34.366106+0000","last_clean":"2024-08-31T04:23:34.366106+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:23:34.366106+0000","last_undegraded":"2024-08-31T04:23:34.366106+0000","last_fullsized":"2024-08-31T04:23:34.366106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.410230+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:23:38.410230+0000","last_peered":"2024-08-31T04:23:38.410230+0000","last_clean":"2024-08-31T04:23:38.410230+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:23:38.410230+0000","last_undegraded":"2024-08-31T04:23:38.410230+0000","last_fullsized":"2024-08-31T04:23:38.410230+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367104+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.367104+0000","last_peered":"2024-08-31T04:23:34.367104+0000","last_clean":"2024-08-31T04:23:34.367104+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:23:34.367104+0000","last_undegraded":"2024-08-31T04:23:34.367104+0000","last_fullsized":"2024-08-31T04:23:34.367104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369150+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:23:34.369150+0000","last_peered":"2024-08-31T04:23:34.369150+0000","last_clean":"2024-08-31T04:23:34.369150+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:23:34.369150+0000","last_undegraded":"2024-08-31T04:23:34.369150+0000","last_fullsized":"2024-08-31T04:23:34.369150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370116+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:23:34.370116+0000","last_peered":"2024-08-31T04:23:34.370116+0000","last_clean":"2024-08-31T04:23:34.370116+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:23:34.370116+0000","last_undegraded":"2024-08-31T04:23:34.370116+0000","last_fullsized":"2024-08-31T04:23:34.370116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370932+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:23:34.370932+0000","last_peered":"2024-08-31T04:23:34.370932+0000","last_clean":"2024-08-31T04:23:34.370932+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:23:34.370932+0000","last_undegraded":"2024-08-31T04:23:34.370932+0000","last_fullsized":"2024-08-31T04:23:34.370932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.368814+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:23:34.368814+0000","last_peered":"2024-08-31T04:23:34.368814+0000","last_clean":"2024-08-31T04:23:34.368814+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:23:34.368814+0000","last_undegraded":"2024-08-31T04:23:34.368814+0000","last_fullsized":"2024-08-31T04:23:34.368814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375276+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:23:34.375276+0000","last_peered":"2024-08-31T04:23:34.375276+0000","last_clean":"2024-08-31T04:23:34.375276+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:23:34.375276+0000","last_undegraded":"2024-08-31T04:23:34.375276+0000","last_fullsized":"2024-08-31T04:23:34.375276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366006+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:23:34.366006+0000","last_peered":"2024-08-31T04:23:34.366006+0000","last_clean":"2024-08-31T04:23:34.366006+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:23:34.366006+0000","last_undegraded":"2024-08-31T04:23:34.366006+0000","last_fullsized":"2024-08-31T04:23:34.366006+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374439+0000","last_change":"2024-08-31T04:22:57.254065+0000","last_active":"2024-08-31T04:23:34.374439+0000","last_peered":"2024-08-31T04:23:34.374439+0000","last_clean":"2024-08-31T04:23:34.374439+0000","last_became_active":"2024-08-31T04:22:57.253673+0000","last_became_peered":"2024-08-31T04:22:57.253673+0000","last_unstale":"2024-08-31T04:23:34.374439+0000","last_undegraded":"2024-08-31T04:23:34.374439+0000","last_fullsized":"2024-08-31T04:23:34.374439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:14.164265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:49.445818+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:23:49.445818+0000","last_peered":"2024-08-31T04:23:49.445818+0000","last_clean":"2024-08-31T04:23:49.445818+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:23:49.445818+0000","last_undegraded":"2024-08-31T04:23:49.445818+0000","last_fullsized":"2024-08-31T04:23:49.445818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365903+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:23:34.365903+0000","last_peered":"2024-08-31T04:23:34.365903+0000","last_clean":"2024-08-31T04:23:34.365903+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:23:34.365903+0000","last_undegraded":"2024-08-31T04:23:34.365903+0000","last_fullsized":"2024-08-31T04:23:34.365903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365462+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:23:34.365462+0000","last_peered":"2024-08-31T04:23:34.365462+0000","last_clean":"2024-08-31T04:23:34.365462+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:23:34.365462+0000","last_undegraded":"2024-08-31T04:23:34.365462+0000","last_fullsized":"2024-08-31T04:23:34.365462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.424431+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:23:39.424431+0000","last_peered":"2024-08-31T04:23:39.424431+0000","last_clean":"2024-08-31T04:23:39.424431+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:23:39.424431+0000","last_undegraded":"2024-08-31T04:23:39.424431+0000","last_fullsized":"2024-08-31T04:23:39.424431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373010+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:23:34.373010+0000","last_peered":"2024-08-31T04:23:34.373010+0000","last_clean":"2024-08-31T04:23:34.373010+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:23:34.373010+0000","last_undegraded":"2024-08-31T04:23:34.373010+0000","last_fullsized":"2024-08-31T04:23:34.373010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494951+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:23:34.494951+0000","last_peered":"2024-08-31T04:23:34.494951+0000","last_clean":"2024-08-31T04:23:34.494951+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:23:34.494951+0000","last_undegraded":"2024-08-31T04:23:34.494951+0000","last_fullsized":"2024-08-31T04:23:34.494951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:40.427555+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:23:40.427555+0000","last_peered":"2024-08-31T04:23:40.427555+0000","last_clean":"2024-08-31T04:23:40.427555+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:23:40.427555+0000","last_undegraded":"2024-08-31T04:23:40.427555+0000","last_fullsized":"2024-08-31T04:23:40.427555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374339+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:23:34.374339+0000","last_peered":"2024-08-31T04:23:34.374339+0000","last_clean":"2024-08-31T04:23:34.374339+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:23:34.374339+0000","last_undegraded":"2024-08-31T04:23:34.374339+0000","last_fullsized":"2024-08-31T04:23:34.374339+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374607+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:23:34.374607+0000","last_peered":"2024-08-31T04:23:34.374607+0000","last_clean":"2024-08-31T04:23:34.374607+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:23:34.374607+0000","last_undegraded":"2024-08-31T04:23:34.374607+0000","last_fullsized":"2024-08-31T04:23:34.374607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374696+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:23:34.374696+0000","last_peered":"2024-08-31T04:23:34.374696+0000","last_clean":"2024-08-31T04:23:34.374696+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:23:34.374696+0000","last_undegraded":"2024-08-31T04:23:34.374696+0000","last_fullsized":"2024-08-31T04:23:34.374696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.425946+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:23:39.425946+0000","last_peered":"2024-08-31T04:23:39.425946+0000","last_clean":"2024-08-31T04:23:39.425946+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:23:39.425946+0000","last_undegraded":"2024-08-31T04:23:39.425946+0000","last_fullsized":"2024-08-31T04:23:39.425946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495884+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:23:34.495884+0000","last_peered":"2024-08-31T04:23:34.495884+0000","last_clean":"2024-08-31T04:23:34.495884+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:23:34.495884+0000","last_undegraded":"2024-08-31T04:23:34.495884+0000","last_fullsized":"2024-08-31T04:23:34.495884+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374289+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:23:34.374289+0000","last_peered":"2024-08-31T04:23:34.374289+0000","last_clean":"2024-08-31T04:23:34.374289+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:23:34.374289+0000","last_undegraded":"2024-08-31T04:23:34.374289+0000","last_fullsized":"2024-08-31T04:23:34.374289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373670+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:23:34.373670+0000","last_peered":"2024-08-31T04:23:34.373670+0000","last_clean":"2024-08-31T04:23:34.373670+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:23:34.373670+0000","last_undegraded":"2024-08-31T04:23:34.373670+0000","last_fullsized":"2024-08-31T04:23:34.373670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369551+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:23:34.369551+0000","last_peered":"2024-08-31T04:23:34.369551+0000","last_clean":"2024-08-31T04:23:34.369551+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:23:34.369551+0000","last_undegraded":"2024-08-31T04:23:34.369551+0000","last_fullsized":"2024-08-31T04:23:34.369551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375289+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:23:34.375289+0000","last_peered":"2024-08-31T04:23:34.375289+0000","last_clean":"2024-08-31T04:23:34.375289+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:23:34.375289+0000","last_undegraded":"2024-08-31T04:23:34.375289+0000","last_fullsized":"2024-08-31T04:23:34.375289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366007+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:23:34.366007+0000","last_peered":"2024-08-31T04:23:34.366007+0000","last_clean":"2024-08-31T04:23:34.366007+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:23:34.366007+0000","last_undegraded":"2024-08-31T04:23:34.366007+0000","last_fullsized":"2024-08-31T04:23:34.366007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373760+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.373760+0000","last_peered":"2024-08-31T04:23:34.373760+0000","last_clean":"2024-08-31T04:23:34.373760+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:23:34.373760+0000","last_undegraded":"2024-08-31T04:23:34.373760+0000","last_fullsized":"2024-08-31T04:23:34.373760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367139+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:23:34.367139+0000","last_peered":"2024-08-31T04:23:34.367139+0000","last_clean":"2024-08-31T04:23:34.367139+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:23:34.367139+0000","last_undegraded":"2024-08-31T04:23:34.367139+0000","last_fullsized":"2024-08-31T04:23:34.367139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:40.420433+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:23:40.420433+0000","last_peered":"2024-08-31T04:23:40.420433+0000","last_clean":"2024-08-31T04:23:40.420433+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:23:40.420433+0000","last_undegraded":"2024-08-31T04:23:40.420433+0000","last_fullsized":"2024-08-31T04:23:40.420433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373127+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:23:34.373127+0000","last_peered":"2024-08-31T04:23:34.373127+0000","last_clean":"2024-08-31T04:23:34.373127+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:23:34.373127+0000","last_undegraded":"2024-08-31T04:23:34.373127+0000","last_fullsized":"2024-08-31T04:23:34.373127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373428+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:23:34.373428+0000","last_peered":"2024-08-31T04:23:34.373428+0000","last_clean":"2024-08-31T04:23:34.373428+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:23:34.373428+0000","last_undegraded":"2024-08-31T04:23:34.373428+0000","last_fullsized":"2024-08-31T04:23:34.373428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426403+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:23:39.426403+0000","last_peered":"2024-08-31T04:23:39.426403+0000","last_clean":"2024-08-31T04:23:39.426403+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:23:39.426403+0000","last_undegraded":"2024-08-31T04:23:39.426403+0000","last_fullsized":"2024-08-31T04:23:39.426403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365898+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:23:34.365898+0000","last_peered":"2024-08-31T04:23:34.365898+0000","last_clean":"2024-08-31T04:23:34.365898+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:23:34.365898+0000","last_undegraded":"2024-08-31T04:23:34.365898+0000","last_fullsized":"2024-08-31T04:23:34.365898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374048+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:23:34.374048+0000","last_peered":"2024-08-31T04:23:34.374048+0000","last_clean":"2024-08-31T04:23:34.374048+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:23:34.374048+0000","last_undegraded":"2024-08-31T04:23:34.374048+0000","last_fullsized":"2024-08-31T04:23:34.374048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:50.448087+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:23:50.448087+0000","last_peered":"2024-08-31T04:23:50.448087+0000","last_clean":"2024-08-31T04:23:50.448087+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:23:50.448087+0000","last_undegraded":"2024-08-31T04:23:50.448087+0000","last_fullsized":"2024-08-31T04:23:50.448087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370286+0000","last_change":"2024-08-31T04:23:04.285395+0000","last_active":"2024-08-31T04:23:34.370286+0000","last_peered":"2024-08-31T04:23:34.370286+0000","last_clean":"2024-08-31T04:23:34.370286+0000","last_became_active":"2024-08-31T04:23:04.285021+0000","last_became_peered":"2024-08-31T04:23:04.285021+0000","last_unstale":"2024-08-31T04:23:34.370286+0000","last_undegraded":"2024-08-31T04:23:34.370286+0000","last_fullsized":"2024-08-31T04:23:34.370286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:16:34.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374562+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:23:34.374562+0000","last_peered":"2024-08-31T04:23:34.374562+0000","last_clean":"2024-08-31T04:23:34.374562+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:23:34.374562+0000","last_undegraded":"2024-08-31T04:23:34.374562+0000","last_fullsized":"2024-08-31T04:23:34.374562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413783+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:23:38.413783+0000","last_peered":"2024-08-31T04:23:38.413783+0000","last_clean":"2024-08-31T04:23:38.413783+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:23:38.413783+0000","last_undegraded":"2024-08-31T04:23:38.413783+0000","last_fullsized":"2024-08-31T04:23:38.413783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367016+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:23:34.367016+0000","last_peered":"2024-08-31T04:23:34.367016+0000","last_clean":"2024-08-31T04:23:34.367016+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:23:34.367016+0000","last_undegraded":"2024-08-31T04:23:34.367016+0000","last_fullsized":"2024-08-31T04:23:34.367016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365571+0000","last_change":"2024-08-31T04:22:57.257383+0000","last_active":"2024-08-31T04:23:34.365571+0000","last_peered":"2024-08-31T04:23:34.365571+0000","last_clean":"2024-08-31T04:23:34.365571+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:23:34.365571+0000","last_undegraded":"2024-08-31T04:23:34.365571+0000","last_fullsized":"2024-08-31T04:23:34.365571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:00.282629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426202+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:23:39.426202+0000","last_peered":"2024-08-31T04:23:39.426202+0000","last_clean":"2024-08-31T04:23:39.426202+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:23:39.426202+0000","last_undegraded":"2024-08-31T04:23:39.426202+0000","last_fullsized":"2024-08-31T04:23:39.426202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373083+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:23:34.373083+0000","last_peered":"2024-08-31T04:23:34.373083+0000","last_clean":"2024-08-31T04:23:34.373083+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:23:34.373083+0000","last_undegraded":"2024-08-31T04:23:34.373083+0000","last_fullsized":"2024-08-31T04:23:34.373083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372840+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:23:34.372840+0000","last_peered":"2024-08-31T04:23:34.372840+0000","last_clean":"2024-08-31T04:23:34.372840+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:23:34.372840+0000","last_undegraded":"2024-08-31T04:23:34.372840+0000","last_fullsized":"2024-08-31T04:23:34.372840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'25","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:50.448755+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:23:50.448755+0000","last_peered":"2024-08-31T04:23:50.448755+0000","last_clean":"2024-08-31T04:23:50.448755+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:23:50.448755+0000","last_undegraded":"2024-08-31T04:23:50.448755+0000","last_fullsized":"2024-08-31T04:23:50.448755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43341,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":56,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369315+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:23:34.369315+0000","last_peered":"2024-08-31T04:23:34.369315+0000","last_clean":"2024-08-31T04:23:34.369315+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:23:34.369315+0000","last_undegraded":"2024-08-31T04:23:34.369315+0000","last_fullsized":"2024-08-31T04:23:34.369315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496025+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:23:34.496025+0000","last_peered":"2024-08-31T04:23:34.496025+0000","last_clean":"2024-08-31T04:23:34.496025+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:23:34.496025+0000","last_undegraded":"2024-08-31T04:23:34.496025+0000","last_fullsized":"2024-08-31T04:23:34.496025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.411989+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:23:38.411989+0000","last_peered":"2024-08-31T04:23:38.411989+0000","last_clean":"2024-08-31T04:23:38.411989+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:23:38.411989+0000","last_undegraded":"2024-08-31T04:23:38.411989+0000","last_fullsized":"2024-08-31T04:23:38.411989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371023+0000","last_change":"2024-08-31T04:23:04.278223+0000","last_active":"2024-08-31T04:23:34.371023+0000","last_peered":"2024-08-31T04:23:34.371023+0000","last_clean":"2024-08-31T04:23:34.371023+0000","last_became_active":"2024-08-31T04:23:04.277718+0000","last_became_peered":"2024-08-31T04:23:04.277718+0000","last_unstale":"2024-08-31T04:23:34.371023+0000","last_undegraded":"2024-08-31T04:23:34.371023+0000","last_fullsized":"2024-08-31T04:23:34.371023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:02.947850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369989+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:23:34.369989+0000","last_peered":"2024-08-31T04:23:34.369989+0000","last_clean":"2024-08-31T04:23:34.369989+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:23:34.369989+0000","last_undegraded":"2024-08-31T04:23:34.369989+0000","last_fullsized":"2024-08-31T04:23:34.369989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413588+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:23:38.413588+0000","last_peered":"2024-08-31T04:23:38.413588+0000","last_clean":"2024-08-31T04:23:38.413588+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:23:38.413588+0000","last_undegraded":"2024-08-31T04:23:38.413588+0000","last_fullsized":"2024-08-31T04:23:38.413588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369015+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:23:34.369015+0000","last_peered":"2024-08-31T04:23:34.369015+0000","last_clean":"2024-08-31T04:23:34.369015+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:23:34.369015+0000","last_undegraded":"2024-08-31T04:23:34.369015+0000","last_fullsized":"2024-08-31T04:23:34.369015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496322+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:23:34.496322+0000","last_peered":"2024-08-31T04:23:34.496322+0000","last_clean":"2024-08-31T04:23:34.496322+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:23:34.496322+0000","last_undegraded":"2024-08-31T04:23:34.496322+0000","last_fullsized":"2024-08-31T04:23:34.496322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:49.444891+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:23:49.444891+0000","last_peered":"2024-08-31T04:23:49.444891+0000","last_clean":"2024-08-31T04:23:49.444891+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:23:49.444891+0000","last_undegraded":"2024-08-31T04:23:49.444891+0000","last_fullsized":"2024-08-31T04:23:49.444891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494642+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:23:34.494642+0000","last_peered":"2024-08-31T04:23:34.494642+0000","last_clean":"2024-08-31T04:23:34.494642+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:23:34.494642+0000","last_undegraded":"2024-08-31T04:23:34.494642+0000","last_fullsized":"2024-08-31T04:23:34.494642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369477+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:23:34.369477+0000","last_peered":"2024-08-31T04:23:34.369477+0000","last_clean":"2024-08-31T04:23:34.369477+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:23:34.369477+0000","last_undegraded":"2024-08-31T04:23:34.369477+0000","last_fullsized":"2024-08-31T04:23:34.369477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369314+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:23:34.369314+0000","last_peered":"2024-08-31T04:23:34.369314+0000","last_clean":"2024-08-31T04:23:34.369314+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:23:34.369314+0000","last_undegraded":"2024-08-31T04:23:34.369314+0000","last_fullsized":"2024-08-31T04:23:34.369314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374936+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:23:34.374936+0000","last_peered":"2024-08-31T04:23:34.374936+0000","last_clean":"2024-08-31T04:23:34.374936+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:23:34.374936+0000","last_undegraded":"2024-08-31T04:23:34.374936+0000","last_fullsized":"2024-08-31T04:23:34.374936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367211+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:23:34.367211+0000","last_peered":"2024-08-31T04:23:34.367211+0000","last_clean":"2024-08-31T04:23:34.367211+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:23:34.367211+0000","last_undegraded":"2024-08-31T04:23:34.367211+0000","last_fullsized":"2024-08-31T04:23:34.367211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494708+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:23:34.494708+0000","last_peered":"2024-08-31T04:23:34.494708+0000","last_clean":"2024-08-31T04:23:34.494708+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:23:34.494708+0000","last_undegraded":"2024-08-31T04:23:34.494708+0000","last_fullsized":"2024-08-31T04:23:34.494708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.424666+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:23:39.424666+0000","last_peered":"2024-08-31T04:23:39.424666+0000","last_clean":"2024-08-31T04:23:39.424666+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:23:39.424666+0000","last_undegraded":"2024-08-31T04:23:39.424666+0000","last_fullsized":"2024-08-31T04:23:39.424666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426246+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:23:39.426246+0000","last_peered":"2024-08-31T04:23:39.426246+0000","last_clean":"2024-08-31T04:23:39.426246+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:23:39.426246+0000","last_undegraded":"2024-08-31T04:23:39.426246+0000","last_fullsized":"2024-08-31T04:23:39.426246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373771+0000","last_change":"2024-08-31T04:22:57.237756+0000","last_active":"2024-08-31T04:23:34.373771+0000","last_peered":"2024-08-31T04:23:34.373771+0000","last_clean":"2024-08-31T04:23:34.373771+0000","last_became_active":"2024-08-31T04:22:57.237387+0000","last_became_peered":"2024-08-31T04:22:57.237387+0000","last_unstale":"2024-08-31T04:23:34.373771+0000","last_undegraded":"2024-08-31T04:23:34.373771+0000","last_fullsized":"2024-08-31T04:23:34.373771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:19.598899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371375+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:23:34.371375+0000","last_peered":"2024-08-31T04:23:34.371375+0000","last_clean":"2024-08-31T04:23:34.371375+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:23:34.371375+0000","last_undegraded":"2024-08-31T04:23:34.371375+0000","last_fullsized":"2024-08-31T04:23:34.371375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":63,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:50.447015+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:23:50.447015+0000","last_peered":"2024-08-31T04:23:50.447015+0000","last_clean":"2024-08-31T04:23:50.447015+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:23:50.447015+0000","last_undegraded":"2024-08-31T04:23:50.447015+0000","last_fullsized":"2024-08-31T04:23:50.447015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371545+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:23:34.371545+0000","last_peered":"2024-08-31T04:23:34.371545+0000","last_clean":"2024-08-31T04:23:34.371545+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:23:34.371545+0000","last_undegraded":"2024-08-31T04:23:34.371545+0000","last_fullsized":"2024-08-31T04:23:34.371545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371481+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:23:34.371481+0000","last_peered":"2024-08-31T04:23:34.371481+0000","last_clean":"2024-08-31T04:23:34.371481+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:23:34.371481+0000","last_undegraded":"2024-08-31T04:23:34.371481+0000","last_fullsized":"2024-08-31T04:23:34.371481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366880+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:23:34.366880+0000","last_peered":"2024-08-31T04:23:34.366880+0000","last_clean":"2024-08-31T04:23:34.366880+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:23:34.366880+0000","last_undegraded":"2024-08-31T04:23:34.366880+0000","last_fullsized":"2024-08-31T04:23:34.366880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.379293+0000","last_change":"2024-08-31T04:23:34.379163+0000","last_active":"2024-08-31T04:23:34.379293+0000","last_peered":"2024-08-31T04:23:34.379293+0000","last_clean":"2024-08-31T04:23:34.379293+0000","last_became_active":"2024-08-31T04:23:34.378478+0000","last_became_peered":"2024-08-31T04:23:34.378478+0000","last_unstale":"2024-08-31T04:23:34.379293+0000","last_undegraded":"2024-08-31T04:23:34.379293+0000","last_fullsized":"2024-08-31T04:23:34.379293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:13:22.843766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371165+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:23:34.371165+0000","last_peered":"2024-08-31T04:23:34.371165+0000","last_clean":"2024-08-31T04:23:34.371165+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:23:34.371165+0000","last_undegraded":"2024-08-31T04:23:34.371165+0000","last_fullsized":"2024-08-31T04:23:34.371165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369671+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:23:34.369671+0000","last_peered":"2024-08-31T04:23:34.369671+0000","last_clean":"2024-08-31T04:23:34.369671+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:23:34.369671+0000","last_undegraded":"2024-08-31T04:23:34.369671+0000","last_fullsized":"2024-08-31T04:23:34.369671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365970+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:23:34.365970+0000","last_peered":"2024-08-31T04:23:34.365970+0000","last_clean":"2024-08-31T04:23:34.365970+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:23:34.365970+0000","last_undegraded":"2024-08-31T04:23:34.365970+0000","last_fullsized":"2024-08-31T04:23:34.365970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367262+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:23:34.367262+0000","last_peered":"2024-08-31T04:23:34.367262+0000","last_clean":"2024-08-31T04:23:34.367262+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:23:34.367262+0000","last_undegraded":"2024-08-31T04:23:34.367262+0000","last_fullsized":"2024-08-31T04:23:34.367262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372423+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:23:34.372423+0000","last_peered":"2024-08-31T04:23:34.372423+0000","last_clean":"2024-08-31T04:23:34.372423+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:23:34.372423+0000","last_undegraded":"2024-08-31T04:23:34.372423+0000","last_fullsized":"2024-08-31T04:23:34.372423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495243+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:23:34.495243+0000","last_peered":"2024-08-31T04:23:34.495243+0000","last_clean":"2024-08-31T04:23:34.495243+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:23:34.495243+0000","last_undegraded":"2024-08-31T04:23:34.495243+0000","last_fullsized":"2024-08-31T04:23:34.495243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374084+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:23:34.374084+0000","last_peered":"2024-08-31T04:23:34.374084+0000","last_clean":"2024-08-31T04:23:34.374084+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:23:34.374084+0000","last_undegraded":"2024-08-31T04:23:34.374084+0000","last_fullsized":"2024-08-31T04:23:34.374084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494741+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:23:34.494741+0000","last_peered":"2024-08-31T04:23:34.494741+0000","last_clean":"2024-08-31T04:23:34.494741+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:23:34.494741+0000","last_undegraded":"2024-08-31T04:23:34.494741+0000","last_fullsized":"2024-08-31T04:23:34.494741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496097+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:23:34.496097+0000","last_peered":"2024-08-31T04:23:34.496097+0000","last_clean":"2024-08-31T04:23:34.496097+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:23:34.496097+0000","last_undegraded":"2024-08-31T04:23:34.496097+0000","last_fullsized":"2024-08-31T04:23:34.496097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365813+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:23:34.365813+0000","last_peered":"2024-08-31T04:23:34.365813+0000","last_clean":"2024-08-31T04:23:34.365813+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:23:34.365813+0000","last_undegraded":"2024-08-31T04:23:34.365813+0000","last_fullsized":"2024-08-31T04:23:34.365813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367007+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:23:34.367007+0000","last_peered":"2024-08-31T04:23:34.367007+0000","last_clean":"2024-08-31T04:23:34.367007+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:23:34.367007+0000","last_undegraded":"2024-08-31T04:23:34.367007+0000","last_fullsized":"2024-08-31T04:23:34.367007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372144+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:23:34.372144+0000","last_peered":"2024-08-31T04:23:34.372144+0000","last_clean":"2024-08-31T04:23:34.372144+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:23:34.372144+0000","last_undegraded":"2024-08-31T04:23:34.372144+0000","last_fullsized":"2024-08-31T04:23:34.372144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370323+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:23:34.370323+0000","last_peered":"2024-08-31T04:23:34.370323+0000","last_clean":"2024-08-31T04:23:34.370323+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:23:34.370323+0000","last_undegraded":"2024-08-31T04:23:34.370323+0000","last_fullsized":"2024-08-31T04:23:34.370323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367508+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:23:34.367508+0000","last_peered":"2024-08-31T04:23:34.367508+0000","last_clean":"2024-08-31T04:23:34.367508+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:23:34.367508+0000","last_undegraded":"2024-08-31T04:23:34.367508+0000","last_fullsized":"2024-08-31T04:23:34.367508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495486+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:23:34.495486+0000","last_peered":"2024-08-31T04:23:34.495486+0000","last_clean":"2024-08-31T04:23:34.495486+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:23:34.495486+0000","last_undegraded":"2024-08-31T04:23:34.495486+0000","last_fullsized":"2024-08-31T04:23:34.495486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.376991+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:23:34.376991+0000","last_peered":"2024-08-31T04:23:34.376991+0000","last_clean":"2024-08-31T04:23:34.376991+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:23:34.376991+0000","last_undegraded":"2024-08-31T04:23:34.376991+0000","last_fullsized":"2024-08-31T04:23:34.376991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370111+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:23:34.370111+0000","last_peered":"2024-08-31T04:23:34.370111+0000","last_clean":"2024-08-31T04:23:34.370111+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:23:34.370111+0000","last_undegraded":"2024-08-31T04:23:34.370111+0000","last_fullsized":"2024-08-31T04:23:34.370111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365887+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:23:34.365887+0000","last_peered":"2024-08-31T04:23:34.365887+0000","last_clean":"2024-08-31T04:23:34.365887+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:23:34.365887+0000","last_undegraded":"2024-08-31T04:23:34.365887+0000","last_fullsized":"2024-08-31T04:23:34.365887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371328+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:23:34.371328+0000","last_peered":"2024-08-31T04:23:34.371328+0000","last_clean":"2024-08-31T04:23:34.371328+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:23:34.371328+0000","last_undegraded":"2024-08-31T04:23:34.371328+0000","last_fullsized":"2024-08-31T04:23:34.371328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374684+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:23:34.374684+0000","last_peered":"2024-08-31T04:23:34.374684+0000","last_clean":"2024-08-31T04:23:34.374684+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:23:34.374684+0000","last_undegraded":"2024-08-31T04:23:34.374684+0000","last_fullsized":"2024-08-31T04:23:34.374684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369752+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:23:34.369752+0000","last_peered":"2024-08-31T04:23:34.369752+0000","last_clean":"2024-08-31T04:23:34.369752+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:23:34.369752+0000","last_undegraded":"2024-08-31T04:23:34.369752+0000","last_fullsized":"2024-08-31T04:23:34.369752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496507+0000","last_change":"2024-08-31T04:22:57.252212+0000","last_active":"2024-08-31T04:23:34.496507+0000","last_peered":"2024-08-31T04:23:34.496507+0000","last_clean":"2024-08-31T04:23:34.496507+0000","last_became_active":"2024-08-31T04:22:57.250923+0000","last_became_peered":"2024-08-31T04:22:57.250923+0000","last_unstale":"2024-08-31T04:23:34.496507+0000","last_undegraded":"2024-08-31T04:23:34.496507+0000","last_fullsized":"2024-08-31T04:23:34.496507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:56:18.585443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494697+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:23:34.494697+0000","last_peered":"2024-08-31T04:23:34.494697+0000","last_clean":"2024-08-31T04:23:34.494697+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:23:34.494697+0000","last_undegraded":"2024-08-31T04:23:34.494697+0000","last_fullsized":"2024-08-31T04:23:34.494697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373787+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:23:34.373787+0000","last_peered":"2024-08-31T04:23:34.373787+0000","last_clean":"2024-08-31T04:23:34.373787+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:23:34.373787+0000","last_undegraded":"2024-08-31T04:23:34.373787+0000","last_fullsized":"2024-08-31T04:23:34.373787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.368409+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:23:34.368409+0000","last_peered":"2024-08-31T04:23:34.368409+0000","last_clean":"2024-08-31T04:23:34.368409+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:23:34.368409+0000","last_undegraded":"2024-08-31T04:23:34.368409+0000","last_fullsized":"2024-08-31T04:23:34.368409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373147+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:23:34.373147+0000","last_peered":"2024-08-31T04:23:34.373147+0000","last_clean":"2024-08-31T04:23:34.373147+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:23:34.373147+0000","last_undegraded":"2024-08-31T04:23:34.373147+0000","last_fullsized":"2024-08-31T04:23:34.373147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371187+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:23:34.371187+0000","last_peered":"2024-08-31T04:23:34.371187+0000","last_clean":"2024-08-31T04:23:34.371187+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:23:34.371187+0000","last_undegraded":"2024-08-31T04:23:34.371187+0000","last_fullsized":"2024-08-31T04:23:34.371187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369435+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:23:34.369435+0000","last_peered":"2024-08-31T04:23:34.369435+0000","last_clean":"2024-08-31T04:23:34.369435+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:23:34.369435+0000","last_undegraded":"2024-08-31T04:23:34.369435+0000","last_fullsized":"2024-08-31T04:23:34.369435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369592+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:23:34.369592+0000","last_peered":"2024-08-31T04:23:34.369592+0000","last_clean":"2024-08-31T04:23:34.369592+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:23:34.369592+0000","last_undegraded":"2024-08-31T04:23:34.369592+0000","last_fullsized":"2024-08-31T04:23:34.369592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367487+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:23:34.367487+0000","last_peered":"2024-08-31T04:23:34.367487+0000","last_clean":"2024-08-31T04:23:34.367487+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:23:34.367487+0000","last_undegraded":"2024-08-31T04:23:34.367487+0000","last_fullsized":"2024-08-31T04:23:34.367487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47733,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":98,"num_write":150,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":143199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":481736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1613824,"data_stored":1111689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103200,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":485055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299430,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":480297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1552384,"data_stored":1076200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":476135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1564672,"data_stored":1072376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":482771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":476329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378693,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":519532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":519968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":43487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":45276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:23:57.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:23:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:57 smithi002 ceph-mon[18656]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:57.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.988+0000 7f7feaa0d640 1 -- 172.21.15.2:0/2774308395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 msgr2=0x7f7fe4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.988+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/2774308395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe4109650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009900 tx=0x7f7fd802a410 comp rx=0 tx=0).stop 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.988+0000 7f7feaa0d640 1 -- 172.21.15.2:0/2774308395 shutdown_connections 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.988+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/2774308395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe4109650 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.988+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/2774308395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/2774308395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 0x7f7fe4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 -- 172.21.15.2:0/2774308395 >> 172.21.15.2:0/2774308395 conn(0x7f7fe407b5f0 msgr2=0x7f7fe407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 -- 172.21.15.2:0/2774308395 shutdown_connections 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 -- 172.21.15.2:0/2774308395 wait complete. 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 Processor -- start 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.989+0000 7f7feaa0d640 1 -- start start 2024-08-31T04:23:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 0x7f7fe419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe4113850 con 0x7f7fe4109240 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe41136d0 con 0x7f7fe4103900 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7feaa0d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe41139d0 con 0x7f7fe4109b90 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7fe37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7fe37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36922/0 (socket says 172.21.15.2:36922) 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7fe37fe640 1 -- 172.21.15.2:0/3018383927 learned_addr learned my addr 172.21.15.2:0/3018383927 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7fe3fff640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 0x7f7fe419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.990+0000 7f7fe8faa640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 -- 172.21.15.2:0/3018383927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 msgr2=0x7f7fe419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 -- 172.21.15.2:0/3018383927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 msgr2=0x7f7fe419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 0x7f7fe419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 -- 172.21.15.2:0/3018383927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe41a0190 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe8faa640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe37fe640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7fd802a930 tx=0x7f7fd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd803f030 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe41a0420 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd8003aa0 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8035070 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.991+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe41a6be0 con 0x7f7fe4109240 2024-08-31T04:23:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.992+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe4103d10 con 0x7f7fe4109240 2024-08-31T04:23:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.995+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7fd8042030 con 0x7f7fe4109240 2024-08-31T04:23:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.995+0000 7f7fe17fa640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 0x7f7fcc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.995+0000 7f7fe3fff640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 0x7f7fcc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.995+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f7fd8106260 con 0x7f7fe4109240 2024-08-31T04:23:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.996+0000 7f7fe3fff640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 0x7f7fcc0b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400bbe0 tx=0x7f7fd400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:57.998+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7fd80cce00 con 0x7f7fe4109240 2024-08-31T04:23:58.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:57 smithi064 ceph-mon[22007]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:58.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:57 smithi132 ceph-mon[22335]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.180+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fe40635a0 con 0x7f7fcc0b4c10 2024-08-31T04:23:58.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.187+0000 7f7fe17fa640 1 -- 172.21.15.2:0/3018383927 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340323 (secure 0 0 0) 0x7f7fe40635a0 con 0x7f7fcc0b4c10 2024-08-31T04:23:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:23:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 msgr2=0x7f7fcc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 0x7f7fcc0b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400bbe0 tx=0x7f7fd400b390 comp rx=0 tx=0).stop 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 msgr2=0x7f7fe419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7fd802a930 tx=0x7f7fd8004270 comp rx=0 tx=0).stop 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 shutdown_connections 2024-08-31T04:23:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7fcc0b4c10 0x7f7fcc0b7120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe4109240 0x7f7fe419a7c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe4109b90 0x7f7fe419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 --2- 172.21.15.2:0/3018383927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fe4103900 0x7f7fe419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 >> 172.21.15.2:0/3018383927 conn(0x7f7fe407b5f0 msgr2=0x7f7fe41052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 shutdown_connections 2024-08-31T04:23:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:58.190+0000 7f7feaa0d640 1 -- 172.21.15.2:0/3018383927 wait complete. 2024-08-31T04:23:58.868 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-08-31T04:23:57.077204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646889,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":206,"num_read_kb":191,"num_write":287,"num_write_kb":2257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":403996,"kb_used_data":13148,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537828,"statfs":{"total":1151940427776,"available":1151526735872,"internally_reserved":0,"allocated":13463552,"data_stored":7685273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49069,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003602"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426129+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:23:39.426129+0000","last_peered":"2024-08-31T04:23:39.426129+0000","last_clean":"2024-08-31T04:23:39.426129+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:23:39.426129+0000","last_undegraded":"2024-08-31T04:23:39.426129+0000","last_fullsized":"2024-08-31T04:23:39.426129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495109+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:23:34.495109+0000","last_peered":"2024-08-31T04:23:34.495109+0000","last_clean":"2024-08-31T04:23:34.495109+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:23:34.495109+0000","last_undegraded":"2024-08-31T04:23:34.495109+0000","last_fullsized":"2024-08-31T04:23:34.495109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371312+0000","last_change":"2024-08-31T04:23:04.284623+0000","last_active":"2024-08-31T04:23:34.371312+0000","last_peered":"2024-08-31T04:23:34.371312+0000","last_clean":"2024-08-31T04:23:34.371312+0000","last_became_active":"2024-08-31T04:23:04.284191+0000","last_became_peered":"2024-08-31T04:23:04.284191+0000","last_unstale":"2024-08-31T04:23:34.371312+0000","last_undegraded":"2024-08-31T04:23:34.371312+0000","last_fullsized":"2024-08-31T04:23:34.371312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:25.476317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495348+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:23:34.495348+0000","last_peered":"2024-08-31T04:23:34.495348+0000","last_clean":"2024-08-31T04:23:34.495348+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:23:34.495348+0000","last_undegraded":"2024-08-31T04:23:34.495348+0000","last_fullsized":"2024-08-31T04:23:34.495348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369945+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:23:34.369945+0000","last_peered":"2024-08-31T04:23:34.369945+0000","last_clean":"2024-08-31T04:23:34.369945+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:23:34.369945+0000","last_undegraded":"2024-08-31T04:23:34.369945+0000","last_fullsized":"2024-08-31T04:23:34.369945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369632+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:23:34.369632+0000","last_peered":"2024-08-31T04:23:34.369632+0000","last_clean":"2024-08-31T04:23:34.369632+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:23:34.369632+0000","last_undegraded":"2024-08-31T04:23:34.369632+0000","last_fullsized":"2024-08-31T04:23:34.369632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.423415+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:23:39.423415+0000","last_peered":"2024-08-31T04:23:39.423415+0000","last_clean":"2024-08-31T04:23:39.423415+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:23:39.423415+0000","last_undegraded":"2024-08-31T04:23:39.423415+0000","last_fullsized":"2024-08-31T04:23:39.423415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495890+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:23:34.495890+0000","last_peered":"2024-08-31T04:23:34.495890+0000","last_clean":"2024-08-31T04:23:34.495890+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:23:34.495890+0000","last_undegraded":"2024-08-31T04:23:34.495890+0000","last_fullsized":"2024-08-31T04:23:34.495890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370529+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:23:34.370529+0000","last_peered":"2024-08-31T04:23:34.370529+0000","last_clean":"2024-08-31T04:23:34.370529+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:23:34.370529+0000","last_undegraded":"2024-08-31T04:23:34.370529+0000","last_fullsized":"2024-08-31T04:23:34.370529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372539+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:23:34.372539+0000","last_peered":"2024-08-31T04:23:34.372539+0000","last_clean":"2024-08-31T04:23:34.372539+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:23:34.372539+0000","last_undegraded":"2024-08-31T04:23:34.372539+0000","last_fullsized":"2024-08-31T04:23:34.372539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373216+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:23:34.373216+0000","last_peered":"2024-08-31T04:23:34.373216+0000","last_clean":"2024-08-31T04:23:34.373216+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:23:34.373216+0000","last_undegraded":"2024-08-31T04:23:34.373216+0000","last_fullsized":"2024-08-31T04:23:34.373216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370147+0000","last_change":"2024-08-31T04:23:04.278183+0000","last_active":"2024-08-31T04:23:34.370147+0000","last_peered":"2024-08-31T04:23:34.370147+0000","last_clean":"2024-08-31T04:23:34.370147+0000","last_became_active":"2024-08-31T04:23:04.277694+0000","last_became_peered":"2024-08-31T04:23:04.277694+0000","last_unstale":"2024-08-31T04:23:34.370147+0000","last_undegraded":"2024-08-31T04:23:34.370147+0000","last_fullsized":"2024-08-31T04:23:34.370147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:15:36.985643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375004+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:23:34.375004+0000","last_peered":"2024-08-31T04:23:34.375004+0000","last_clean":"2024-08-31T04:23:34.375004+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:23:34.375004+0000","last_undegraded":"2024-08-31T04:23:34.375004+0000","last_fullsized":"2024-08-31T04:23:34.375004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413112+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:23:38.413112+0000","last_peered":"2024-08-31T04:23:38.413112+0000","last_clean":"2024-08-31T04:23:38.413112+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:23:38.413112+0000","last_undegraded":"2024-08-31T04:23:38.413112+0000","last_fullsized":"2024-08-31T04:23:38.413112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370717+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:23:34.370717+0000","last_peered":"2024-08-31T04:23:34.370717+0000","last_clean":"2024-08-31T04:23:34.370717+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:23:34.370717+0000","last_undegraded":"2024-08-31T04:23:34.370717+0000","last_fullsized":"2024-08-31T04:23:34.370717+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494855+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:23:34.494855+0000","last_peered":"2024-08-31T04:23:34.494855+0000","last_clean":"2024-08-31T04:23:34.494855+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:23:34.494855+0000","last_undegraded":"2024-08-31T04:23:34.494855+0000","last_fullsized":"2024-08-31T04:23:34.494855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372057+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:23:34.372057+0000","last_peered":"2024-08-31T04:23:34.372057+0000","last_clean":"2024-08-31T04:23:34.372057+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:23:34.372057+0000","last_undegraded":"2024-08-31T04:23:34.372057+0000","last_fullsized":"2024-08-31T04:23:34.372057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371242+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:23:34.371242+0000","last_peered":"2024-08-31T04:23:34.371242+0000","last_clean":"2024-08-31T04:23:34.371242+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:23:34.371242+0000","last_undegraded":"2024-08-31T04:23:34.371242+0000","last_fullsized":"2024-08-31T04:23:34.371242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366977+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:23:34.366977+0000","last_peered":"2024-08-31T04:23:34.366977+0000","last_clean":"2024-08-31T04:23:34.366977+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:23:34.366977+0000","last_undegraded":"2024-08-31T04:23:34.366977+0000","last_fullsized":"2024-08-31T04:23:34.366977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413722+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:23:38.413722+0000","last_peered":"2024-08-31T04:23:38.413722+0000","last_clean":"2024-08-31T04:23:38.413722+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:23:38.413722+0000","last_undegraded":"2024-08-31T04:23:38.413722+0000","last_fullsized":"2024-08-31T04:23:38.413722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369813+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:23:34.369813+0000","last_peered":"2024-08-31T04:23:34.369813+0000","last_clean":"2024-08-31T04:23:34.369813+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:23:34.369813+0000","last_undegraded":"2024-08-31T04:23:34.369813+0000","last_fullsized":"2024-08-31T04:23:34.369813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371348+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:23:34.371348+0000","last_peered":"2024-08-31T04:23:34.371348+0000","last_clean":"2024-08-31T04:23:34.371348+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:23:34.371348+0000","last_undegraded":"2024-08-31T04:23:34.371348+0000","last_fullsized":"2024-08-31T04:23:34.371348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.412128+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:23:38.412128+0000","last_peered":"2024-08-31T04:23:38.412128+0000","last_clean":"2024-08-31T04:23:38.412128+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:23:38.412128+0000","last_undegraded":"2024-08-31T04:23:38.412128+0000","last_fullsized":"2024-08-31T04:23:38.412128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370634+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:23:34.370634+0000","last_peered":"2024-08-31T04:23:34.370634+0000","last_clean":"2024-08-31T04:23:34.370634+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:23:34.370634+0000","last_undegraded":"2024-08-31T04:23:34.370634+0000","last_fullsized":"2024-08-31T04:23:34.370634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369702+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:23:34.369702+0000","last_peered":"2024-08-31T04:23:34.369702+0000","last_clean":"2024-08-31T04:23:34.369702+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:23:34.369702+0000","last_undegraded":"2024-08-31T04:23:34.369702+0000","last_fullsized":"2024-08-31T04:23:34.369702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.411360+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:23:38.411360+0000","last_peered":"2024-08-31T04:23:38.411360+0000","last_clean":"2024-08-31T04:23:38.411360+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:23:38.411360+0000","last_undegraded":"2024-08-31T04:23:38.411360+0000","last_fullsized":"2024-08-31T04:23:38.411360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371750+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:23:34.371750+0000","last_peered":"2024-08-31T04:23:34.371750+0000","last_clean":"2024-08-31T04:23:34.371750+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:23:34.371750+0000","last_undegraded":"2024-08-31T04:23:34.371750+0000","last_fullsized":"2024-08-31T04:23:34.371750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495252+0000","last_change":"2024-08-31T04:22:57.251361+0000","last_active":"2024-08-31T04:23:34.495252+0000","last_peered":"2024-08-31T04:23:34.495252+0000","last_clean":"2024-08-31T04:23:34.495252+0000","last_became_active":"2024-08-31T04:22:57.250958+0000","last_became_peered":"2024-08-31T04:22:57.250958+0000","last_unstale":"2024-08-31T04:23:34.495252+0000","last_undegraded":"2024-08-31T04:23:34.495252+0000","last_fullsized":"2024-08-31T04:23:34.495252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:12:39.004877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:53.244135+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:23:53.244135+0000","last_peered":"2024-08-31T04:23:53.244135+0000","last_clean":"2024-08-31T04:23:53.244135+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:23:53.244135+0000","last_undegraded":"2024-08-31T04:23:53.244135+0000","last_fullsized":"2024-08-31T04:23:53.244135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494557+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:23:34.494557+0000","last_peered":"2024-08-31T04:23:34.494557+0000","last_clean":"2024-08-31T04:23:34.494557+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:23:34.494557+0000","last_undegraded":"2024-08-31T04:23:34.494557+0000","last_fullsized":"2024-08-31T04:23:34.494557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366106+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:23:34.366106+0000","last_peered":"2024-08-31T04:23:34.366106+0000","last_clean":"2024-08-31T04:23:34.366106+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:23:34.366106+0000","last_undegraded":"2024-08-31T04:23:34.366106+0000","last_fullsized":"2024-08-31T04:23:34.366106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.410230+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:23:38.410230+0000","last_peered":"2024-08-31T04:23:38.410230+0000","last_clean":"2024-08-31T04:23:38.410230+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:23:38.410230+0000","last_undegraded":"2024-08-31T04:23:38.410230+0000","last_fullsized":"2024-08-31T04:23:38.410230+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367104+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.367104+0000","last_peered":"2024-08-31T04:23:34.367104+0000","last_clean":"2024-08-31T04:23:34.367104+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:23:34.367104+0000","last_undegraded":"2024-08-31T04:23:34.367104+0000","last_fullsized":"2024-08-31T04:23:34.367104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369150+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:23:34.369150+0000","last_peered":"2024-08-31T04:23:34.369150+0000","last_clean":"2024-08-31T04:23:34.369150+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:23:34.369150+0000","last_undegraded":"2024-08-31T04:23:34.369150+0000","last_fullsized":"2024-08-31T04:23:34.369150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370116+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:23:34.370116+0000","last_peered":"2024-08-31T04:23:34.370116+0000","last_clean":"2024-08-31T04:23:34.370116+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:23:34.370116+0000","last_undegraded":"2024-08-31T04:23:34.370116+0000","last_fullsized":"2024-08-31T04:23:34.370116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370932+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:23:34.370932+0000","last_peered":"2024-08-31T04:23:34.370932+0000","last_clean":"2024-08-31T04:23:34.370932+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:23:34.370932+0000","last_undegraded":"2024-08-31T04:23:34.370932+0000","last_fullsized":"2024-08-31T04:23:34.370932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.368814+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:23:34.368814+0000","last_peered":"2024-08-31T04:23:34.368814+0000","last_clean":"2024-08-31T04:23:34.368814+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:23:34.368814+0000","last_undegraded":"2024-08-31T04:23:34.368814+0000","last_fullsized":"2024-08-31T04:23:34.368814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375276+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:23:34.375276+0000","last_peered":"2024-08-31T04:23:34.375276+0000","last_clean":"2024-08-31T04:23:34.375276+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:23:34.375276+0000","last_undegraded":"2024-08-31T04:23:34.375276+0000","last_fullsized":"2024-08-31T04:23:34.375276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366006+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:23:34.366006+0000","last_peered":"2024-08-31T04:23:34.366006+0000","last_clean":"2024-08-31T04:23:34.366006+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:23:34.366006+0000","last_undegraded":"2024-08-31T04:23:34.366006+0000","last_fullsized":"2024-08-31T04:23:34.366006+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374439+0000","last_change":"2024-08-31T04:22:57.254065+0000","last_active":"2024-08-31T04:23:34.374439+0000","last_peered":"2024-08-31T04:23:34.374439+0000","last_clean":"2024-08-31T04:23:34.374439+0000","last_became_active":"2024-08-31T04:22:57.253673+0000","last_became_peered":"2024-08-31T04:22:57.253673+0000","last_unstale":"2024-08-31T04:23:34.374439+0000","last_undegraded":"2024-08-31T04:23:34.374439+0000","last_fullsized":"2024-08-31T04:23:34.374439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:14.164265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:54.453461+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:23:54.453461+0000","last_peered":"2024-08-31T04:23:54.453461+0000","last_clean":"2024-08-31T04:23:54.453461+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:23:54.453461+0000","last_undegraded":"2024-08-31T04:23:54.453461+0000","last_fullsized":"2024-08-31T04:23:54.453461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365903+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:23:34.365903+0000","last_peered":"2024-08-31T04:23:34.365903+0000","last_clean":"2024-08-31T04:23:34.365903+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:23:34.365903+0000","last_undegraded":"2024-08-31T04:23:34.365903+0000","last_fullsized":"2024-08-31T04:23:34.365903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365462+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:23:34.365462+0000","last_peered":"2024-08-31T04:23:34.365462+0000","last_clean":"2024-08-31T04:23:34.365462+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:23:34.365462+0000","last_undegraded":"2024-08-31T04:23:34.365462+0000","last_fullsized":"2024-08-31T04:23:34.365462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.424431+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:23:39.424431+0000","last_peered":"2024-08-31T04:23:39.424431+0000","last_clean":"2024-08-31T04:23:39.424431+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:23:39.424431+0000","last_undegraded":"2024-08-31T04:23:39.424431+0000","last_fullsized":"2024-08-31T04:23:39.424431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373010+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:23:34.373010+0000","last_peered":"2024-08-31T04:23:34.373010+0000","last_clean":"2024-08-31T04:23:34.373010+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:23:34.373010+0000","last_undegraded":"2024-08-31T04:23:34.373010+0000","last_fullsized":"2024-08-31T04:23:34.373010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494951+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:23:34.494951+0000","last_peered":"2024-08-31T04:23:34.494951+0000","last_clean":"2024-08-31T04:23:34.494951+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:23:34.494951+0000","last_undegraded":"2024-08-31T04:23:34.494951+0000","last_fullsized":"2024-08-31T04:23:34.494951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:40.427555+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:23:40.427555+0000","last_peered":"2024-08-31T04:23:40.427555+0000","last_clean":"2024-08-31T04:23:40.427555+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:23:40.427555+0000","last_undegraded":"2024-08-31T04:23:40.427555+0000","last_fullsized":"2024-08-31T04:23:40.427555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374339+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:23:34.374339+0000","last_peered":"2024-08-31T04:23:34.374339+0000","last_clean":"2024-08-31T04:23:34.374339+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:23:34.374339+0000","last_undegraded":"2024-08-31T04:23:34.374339+0000","last_fullsized":"2024-08-31T04:23:34.374339+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374607+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:23:34.374607+0000","last_peered":"2024-08-31T04:23:34.374607+0000","last_clean":"2024-08-31T04:23:34.374607+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:23:34.374607+0000","last_undegraded":"2024-08-31T04:23:34.374607+0000","last_fullsized":"2024-08-31T04:23:34.374607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374696+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:23:34.374696+0000","last_peered":"2024-08-31T04:23:34.374696+0000","last_clean":"2024-08-31T04:23:34.374696+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:23:34.374696+0000","last_undegraded":"2024-08-31T04:23:34.374696+0000","last_fullsized":"2024-08-31T04:23:34.374696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.425946+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:23:39.425946+0000","last_peered":"2024-08-31T04:23:39.425946+0000","last_clean":"2024-08-31T04:23:39.425946+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:23:39.425946+0000","last_undegraded":"2024-08-31T04:23:39.425946+0000","last_fullsized":"2024-08-31T04:23:39.425946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495884+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:23:34.495884+0000","last_peered":"2024-08-31T04:23:34.495884+0000","last_clean":"2024-08-31T04:23:34.495884+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:23:34.495884+0000","last_undegraded":"2024-08-31T04:23:34.495884+0000","last_fullsized":"2024-08-31T04:23:34.495884+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374289+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:23:34.374289+0000","last_peered":"2024-08-31T04:23:34.374289+0000","last_clean":"2024-08-31T04:23:34.374289+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:23:34.374289+0000","last_undegraded":"2024-08-31T04:23:34.374289+0000","last_fullsized":"2024-08-31T04:23:34.374289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373670+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:23:34.373670+0000","last_peered":"2024-08-31T04:23:34.373670+0000","last_clean":"2024-08-31T04:23:34.373670+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:23:34.373670+0000","last_undegraded":"2024-08-31T04:23:34.373670+0000","last_fullsized":"2024-08-31T04:23:34.373670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369551+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:23:34.369551+0000","last_peered":"2024-08-31T04:23:34.369551+0000","last_clean":"2024-08-31T04:23:34.369551+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:23:34.369551+0000","last_undegraded":"2024-08-31T04:23:34.369551+0000","last_fullsized":"2024-08-31T04:23:34.369551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.375289+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:23:34.375289+0000","last_peered":"2024-08-31T04:23:34.375289+0000","last_clean":"2024-08-31T04:23:34.375289+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:23:34.375289+0000","last_undegraded":"2024-08-31T04:23:34.375289+0000","last_fullsized":"2024-08-31T04:23:34.375289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366007+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:23:34.366007+0000","last_peered":"2024-08-31T04:23:34.366007+0000","last_clean":"2024-08-31T04:23:34.366007+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:23:34.366007+0000","last_undegraded":"2024-08-31T04:23:34.366007+0000","last_fullsized":"2024-08-31T04:23:34.366007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373760+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.373760+0000","last_peered":"2024-08-31T04:23:34.373760+0000","last_clean":"2024-08-31T04:23:34.373760+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:23:34.373760+0000","last_undegraded":"2024-08-31T04:23:34.373760+0000","last_fullsized":"2024-08-31T04:23:34.373760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367139+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:23:34.367139+0000","last_peered":"2024-08-31T04:23:34.367139+0000","last_clean":"2024-08-31T04:23:34.367139+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:23:34.367139+0000","last_undegraded":"2024-08-31T04:23:34.367139+0000","last_fullsized":"2024-08-31T04:23:34.367139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:40.420433+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:23:40.420433+0000","last_peered":"2024-08-31T04:23:40.420433+0000","last_clean":"2024-08-31T04:23:40.420433+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:23:40.420433+0000","last_undegraded":"2024-08-31T04:23:40.420433+0000","last_fullsized":"2024-08-31T04:23:40.420433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373127+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:23:34.373127+0000","last_peered":"2024-08-31T04:23:34.373127+0000","last_clean":"2024-08-31T04:23:34.373127+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:23:34.373127+0000","last_undegraded":"2024-08-31T04:23:34.373127+0000","last_fullsized":"2024-08-31T04:23:34.373127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373428+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:23:34.373428+0000","last_peered":"2024-08-31T04:23:34.373428+0000","last_clean":"2024-08-31T04:23:34.373428+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:23:34.373428+0000","last_undegraded":"2024-08-31T04:23:34.373428+0000","last_fullsized":"2024-08-31T04:23:34.373428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426403+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:23:39.426403+0000","last_peered":"2024-08-31T04:23:39.426403+0000","last_clean":"2024-08-31T04:23:39.426403+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:23:39.426403+0000","last_undegraded":"2024-08-31T04:23:39.426403+0000","last_fullsized":"2024-08-31T04:23:39.426403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365898+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:23:34.365898+0000","last_peered":"2024-08-31T04:23:34.365898+0000","last_clean":"2024-08-31T04:23:34.365898+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:23:34.365898+0000","last_undegraded":"2024-08-31T04:23:34.365898+0000","last_fullsized":"2024-08-31T04:23:34.365898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374048+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:23:34.374048+0000","last_peered":"2024-08-31T04:23:34.374048+0000","last_clean":"2024-08-31T04:23:34.374048+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:23:34.374048+0000","last_undegraded":"2024-08-31T04:23:34.374048+0000","last_fullsized":"2024-08-31T04:23:34.374048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:55.455608+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:23:55.455608+0000","last_peered":"2024-08-31T04:23:55.455608+0000","last_clean":"2024-08-31T04:23:55.455608+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:23:55.455608+0000","last_undegraded":"2024-08-31T04:23:55.455608+0000","last_fullsized":"2024-08-31T04:23:55.455608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370286+0000","last_change":"2024-08-31T04:23:04.285395+0000","last_active":"2024-08-31T04:23:34.370286+0000","last_peered":"2024-08-31T04:23:34.370286+0000","last_clean":"2024-08-31T04:23:34.370286+0000","last_became_active":"2024-08-31T04:23:04.285021+0000","last_became_peered":"2024-08-31T04:23:04.285021+0000","last_unstale":"2024-08-31T04:23:34.370286+0000","last_undegraded":"2024-08-31T04:23:34.370286+0000","last_fullsized":"2024-08-31T04:23:34.370286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:16:34.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374562+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:23:34.374562+0000","last_peered":"2024-08-31T04:23:34.374562+0000","last_clean":"2024-08-31T04:23:34.374562+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:23:34.374562+0000","last_undegraded":"2024-08-31T04:23:34.374562+0000","last_fullsized":"2024-08-31T04:23:34.374562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413783+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:23:38.413783+0000","last_peered":"2024-08-31T04:23:38.413783+0000","last_clean":"2024-08-31T04:23:38.413783+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:23:38.413783+0000","last_undegraded":"2024-08-31T04:23:38.413783+0000","last_fullsized":"2024-08-31T04:23:38.413783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367016+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:23:34.367016+0000","last_peered":"2024-08-31T04:23:34.367016+0000","last_clean":"2024-08-31T04:23:34.367016+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:23:34.367016+0000","last_undegraded":"2024-08-31T04:23:34.367016+0000","last_fullsized":"2024-08-31T04:23:34.367016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365571+0000","last_change":"2024-08-31T04:22:57.257383+0000","last_active":"2024-08-31T04:23:34.365571+0000","last_peered":"2024-08-31T04:23:34.365571+0000","last_clean":"2024-08-31T04:23:34.365571+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:23:34.365571+0000","last_undegraded":"2024-08-31T04:23:34.365571+0000","last_fullsized":"2024-08-31T04:23:34.365571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:00.282629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426202+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:23:39.426202+0000","last_peered":"2024-08-31T04:23:39.426202+0000","last_clean":"2024-08-31T04:23:39.426202+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:23:39.426202+0000","last_undegraded":"2024-08-31T04:23:39.426202+0000","last_fullsized":"2024-08-31T04:23:39.426202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373083+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:23:34.373083+0000","last_peered":"2024-08-31T04:23:34.373083+0000","last_clean":"2024-08-31T04:23:34.373083+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:23:34.373083+0000","last_undegraded":"2024-08-31T04:23:34.373083+0000","last_fullsized":"2024-08-31T04:23:34.373083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372840+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:23:34.372840+0000","last_peered":"2024-08-31T04:23:34.372840+0000","last_clean":"2024-08-31T04:23:34.372840+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:23:34.372840+0000","last_undegraded":"2024-08-31T04:23:34.372840+0000","last_fullsized":"2024-08-31T04:23:34.372840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:55.455005+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:23:55.455005+0000","last_peered":"2024-08-31T04:23:55.455005+0000","last_clean":"2024-08-31T04:23:55.455005+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:23:55.455005+0000","last_undegraded":"2024-08-31T04:23:55.455005+0000","last_fullsized":"2024-08-31T04:23:55.455005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51895,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":70,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369315+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:23:34.369315+0000","last_peered":"2024-08-31T04:23:34.369315+0000","last_clean":"2024-08-31T04:23:34.369315+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:23:34.369315+0000","last_undegraded":"2024-08-31T04:23:34.369315+0000","last_fullsized":"2024-08-31T04:23:34.369315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496025+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:23:34.496025+0000","last_peered":"2024-08-31T04:23:34.496025+0000","last_clean":"2024-08-31T04:23:34.496025+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:23:34.496025+0000","last_undegraded":"2024-08-31T04:23:34.496025+0000","last_fullsized":"2024-08-31T04:23:34.496025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.411989+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:23:38.411989+0000","last_peered":"2024-08-31T04:23:38.411989+0000","last_clean":"2024-08-31T04:23:38.411989+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:23:38.411989+0000","last_undegraded":"2024-08-31T04:23:38.411989+0000","last_fullsized":"2024-08-31T04:23:38.411989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371023+0000","last_change":"2024-08-31T04:23:04.278223+0000","last_active":"2024-08-31T04:23:34.371023+0000","last_peered":"2024-08-31T04:23:34.371023+0000","last_clean":"2024-08-31T04:23:34.371023+0000","last_became_active":"2024-08-31T04:23:04.277718+0000","last_became_peered":"2024-08-31T04:23:04.277718+0000","last_unstale":"2024-08-31T04:23:34.371023+0000","last_undegraded":"2024-08-31T04:23:34.371023+0000","last_fullsized":"2024-08-31T04:23:34.371023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:02.947850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369989+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:23:34.369989+0000","last_peered":"2024-08-31T04:23:34.369989+0000","last_clean":"2024-08-31T04:23:34.369989+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:23:34.369989+0000","last_undegraded":"2024-08-31T04:23:34.369989+0000","last_fullsized":"2024-08-31T04:23:34.369989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:38.413588+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:23:38.413588+0000","last_peered":"2024-08-31T04:23:38.413588+0000","last_clean":"2024-08-31T04:23:38.413588+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:23:38.413588+0000","last_undegraded":"2024-08-31T04:23:38.413588+0000","last_fullsized":"2024-08-31T04:23:38.413588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369015+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:23:34.369015+0000","last_peered":"2024-08-31T04:23:34.369015+0000","last_clean":"2024-08-31T04:23:34.369015+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:23:34.369015+0000","last_undegraded":"2024-08-31T04:23:34.369015+0000","last_fullsized":"2024-08-31T04:23:34.369015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496322+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:23:34.496322+0000","last_peered":"2024-08-31T04:23:34.496322+0000","last_clean":"2024-08-31T04:23:34.496322+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:23:34.496322+0000","last_undegraded":"2024-08-31T04:23:34.496322+0000","last_fullsized":"2024-08-31T04:23:34.496322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:54.452458+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:23:54.452458+0000","last_peered":"2024-08-31T04:23:54.452458+0000","last_clean":"2024-08-31T04:23:54.452458+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:23:54.452458+0000","last_undegraded":"2024-08-31T04:23:54.452458+0000","last_fullsized":"2024-08-31T04:23:54.452458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494642+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:23:34.494642+0000","last_peered":"2024-08-31T04:23:34.494642+0000","last_clean":"2024-08-31T04:23:34.494642+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:23:34.494642+0000","last_undegraded":"2024-08-31T04:23:34.494642+0000","last_fullsized":"2024-08-31T04:23:34.494642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369477+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:23:34.369477+0000","last_peered":"2024-08-31T04:23:34.369477+0000","last_clean":"2024-08-31T04:23:34.369477+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:23:34.369477+0000","last_undegraded":"2024-08-31T04:23:34.369477+0000","last_fullsized":"2024-08-31T04:23:34.369477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369314+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:23:34.369314+0000","last_peered":"2024-08-31T04:23:34.369314+0000","last_clean":"2024-08-31T04:23:34.369314+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:23:34.369314+0000","last_undegraded":"2024-08-31T04:23:34.369314+0000","last_fullsized":"2024-08-31T04:23:34.369314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374936+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:23:34.374936+0000","last_peered":"2024-08-31T04:23:34.374936+0000","last_clean":"2024-08-31T04:23:34.374936+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:23:34.374936+0000","last_undegraded":"2024-08-31T04:23:34.374936+0000","last_fullsized":"2024-08-31T04:23:34.374936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367211+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:23:34.367211+0000","last_peered":"2024-08-31T04:23:34.367211+0000","last_clean":"2024-08-31T04:23:34.367211+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:23:34.367211+0000","last_undegraded":"2024-08-31T04:23:34.367211+0000","last_fullsized":"2024-08-31T04:23:34.367211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494708+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:23:34.494708+0000","last_peered":"2024-08-31T04:23:34.494708+0000","last_clean":"2024-08-31T04:23:34.494708+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:23:34.494708+0000","last_undegraded":"2024-08-31T04:23:34.494708+0000","last_fullsized":"2024-08-31T04:23:34.494708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.424666+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:23:39.424666+0000","last_peered":"2024-08-31T04:23:39.424666+0000","last_clean":"2024-08-31T04:23:39.424666+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:23:39.424666+0000","last_undegraded":"2024-08-31T04:23:39.424666+0000","last_fullsized":"2024-08-31T04:23:39.424666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:39.426246+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:23:39.426246+0000","last_peered":"2024-08-31T04:23:39.426246+0000","last_clean":"2024-08-31T04:23:39.426246+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:23:39.426246+0000","last_undegraded":"2024-08-31T04:23:39.426246+0000","last_fullsized":"2024-08-31T04:23:39.426246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373771+0000","last_change":"2024-08-31T04:22:57.237756+0000","last_active":"2024-08-31T04:23:34.373771+0000","last_peered":"2024-08-31T04:23:34.373771+0000","last_clean":"2024-08-31T04:23:34.373771+0000","last_became_active":"2024-08-31T04:22:57.237387+0000","last_became_peered":"2024-08-31T04:22:57.237387+0000","last_unstale":"2024-08-31T04:23:34.373771+0000","last_undegraded":"2024-08-31T04:23:34.373771+0000","last_fullsized":"2024-08-31T04:23:34.373771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:19.598899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371375+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:23:34.371375+0000","last_peered":"2024-08-31T04:23:34.371375+0000","last_clean":"2024-08-31T04:23:34.371375+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:23:34.371375+0000","last_undegraded":"2024-08-31T04:23:34.371375+0000","last_fullsized":"2024-08-31T04:23:34.371375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:55.454487+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:23:55.454487+0000","last_peered":"2024-08-31T04:23:55.454487+0000","last_clean":"2024-08-31T04:23:55.454487+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:23:55.454487+0000","last_undegraded":"2024-08-31T04:23:55.454487+0000","last_fullsized":"2024-08-31T04:23:55.454487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371545+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:23:34.371545+0000","last_peered":"2024-08-31T04:23:34.371545+0000","last_clean":"2024-08-31T04:23:34.371545+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:23:34.371545+0000","last_undegraded":"2024-08-31T04:23:34.371545+0000","last_fullsized":"2024-08-31T04:23:34.371545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371481+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:23:34.371481+0000","last_peered":"2024-08-31T04:23:34.371481+0000","last_clean":"2024-08-31T04:23:34.371481+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:23:34.371481+0000","last_undegraded":"2024-08-31T04:23:34.371481+0000","last_fullsized":"2024-08-31T04:23:34.371481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366880+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:23:34.366880+0000","last_peered":"2024-08-31T04:23:34.366880+0000","last_clean":"2024-08-31T04:23:34.366880+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:23:34.366880+0000","last_undegraded":"2024-08-31T04:23:34.366880+0000","last_fullsized":"2024-08-31T04:23:34.366880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.379293+0000","last_change":"2024-08-31T04:23:34.379163+0000","last_active":"2024-08-31T04:23:34.379293+0000","last_peered":"2024-08-31T04:23:34.379293+0000","last_clean":"2024-08-31T04:23:34.379293+0000","last_became_active":"2024-08-31T04:23:34.378478+0000","last_became_peered":"2024-08-31T04:23:34.378478+0000","last_unstale":"2024-08-31T04:23:34.379293+0000","last_undegraded":"2024-08-31T04:23:34.379293+0000","last_fullsized":"2024-08-31T04:23:34.379293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:13:22.843766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371165+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:23:34.371165+0000","last_peered":"2024-08-31T04:23:34.371165+0000","last_clean":"2024-08-31T04:23:34.371165+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:23:34.371165+0000","last_undegraded":"2024-08-31T04:23:34.371165+0000","last_fullsized":"2024-08-31T04:23:34.371165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369671+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:23:34.369671+0000","last_peered":"2024-08-31T04:23:34.369671+0000","last_clean":"2024-08-31T04:23:34.369671+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:23:34.369671+0000","last_undegraded":"2024-08-31T04:23:34.369671+0000","last_fullsized":"2024-08-31T04:23:34.369671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365970+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:23:34.365970+0000","last_peered":"2024-08-31T04:23:34.365970+0000","last_clean":"2024-08-31T04:23:34.365970+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:23:34.365970+0000","last_undegraded":"2024-08-31T04:23:34.365970+0000","last_fullsized":"2024-08-31T04:23:34.365970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367262+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:23:34.367262+0000","last_peered":"2024-08-31T04:23:34.367262+0000","last_clean":"2024-08-31T04:23:34.367262+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:23:34.367262+0000","last_undegraded":"2024-08-31T04:23:34.367262+0000","last_fullsized":"2024-08-31T04:23:34.367262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372423+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:23:34.372423+0000","last_peered":"2024-08-31T04:23:34.372423+0000","last_clean":"2024-08-31T04:23:34.372423+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:23:34.372423+0000","last_undegraded":"2024-08-31T04:23:34.372423+0000","last_fullsized":"2024-08-31T04:23:34.372423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495243+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:23:34.495243+0000","last_peered":"2024-08-31T04:23:34.495243+0000","last_clean":"2024-08-31T04:23:34.495243+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:23:34.495243+0000","last_undegraded":"2024-08-31T04:23:34.495243+0000","last_fullsized":"2024-08-31T04:23:34.495243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374084+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:23:34.374084+0000","last_peered":"2024-08-31T04:23:34.374084+0000","last_clean":"2024-08-31T04:23:34.374084+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:23:34.374084+0000","last_undegraded":"2024-08-31T04:23:34.374084+0000","last_fullsized":"2024-08-31T04:23:34.374084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494741+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:23:34.494741+0000","last_peered":"2024-08-31T04:23:34.494741+0000","last_clean":"2024-08-31T04:23:34.494741+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:23:34.494741+0000","last_undegraded":"2024-08-31T04:23:34.494741+0000","last_fullsized":"2024-08-31T04:23:34.494741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496097+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:23:34.496097+0000","last_peered":"2024-08-31T04:23:34.496097+0000","last_clean":"2024-08-31T04:23:34.496097+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:23:34.496097+0000","last_undegraded":"2024-08-31T04:23:34.496097+0000","last_fullsized":"2024-08-31T04:23:34.496097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365813+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:23:34.365813+0000","last_peered":"2024-08-31T04:23:34.365813+0000","last_clean":"2024-08-31T04:23:34.365813+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:23:34.365813+0000","last_undegraded":"2024-08-31T04:23:34.365813+0000","last_fullsized":"2024-08-31T04:23:34.365813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367007+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:23:34.367007+0000","last_peered":"2024-08-31T04:23:34.367007+0000","last_clean":"2024-08-31T04:23:34.367007+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:23:34.367007+0000","last_undegraded":"2024-08-31T04:23:34.367007+0000","last_fullsized":"2024-08-31T04:23:34.367007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.372144+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:23:34.372144+0000","last_peered":"2024-08-31T04:23:34.372144+0000","last_clean":"2024-08-31T04:23:34.372144+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:23:34.372144+0000","last_undegraded":"2024-08-31T04:23:34.372144+0000","last_fullsized":"2024-08-31T04:23:34.372144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370323+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:23:34.370323+0000","last_peered":"2024-08-31T04:23:34.370323+0000","last_clean":"2024-08-31T04:23:34.370323+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:23:34.370323+0000","last_undegraded":"2024-08-31T04:23:34.370323+0000","last_fullsized":"2024-08-31T04:23:34.370323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367508+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:23:34.367508+0000","last_peered":"2024-08-31T04:23:34.367508+0000","last_clean":"2024-08-31T04:23:34.367508+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:23:34.367508+0000","last_undegraded":"2024-08-31T04:23:34.367508+0000","last_fullsized":"2024-08-31T04:23:34.367508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.495486+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:23:34.495486+0000","last_peered":"2024-08-31T04:23:34.495486+0000","last_clean":"2024-08-31T04:23:34.495486+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:23:34.495486+0000","last_undegraded":"2024-08-31T04:23:34.495486+0000","last_fullsized":"2024-08-31T04:23:34.495486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.376991+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:23:34.376991+0000","last_peered":"2024-08-31T04:23:34.376991+0000","last_clean":"2024-08-31T04:23:34.376991+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:23:34.376991+0000","last_undegraded":"2024-08-31T04:23:34.376991+0000","last_fullsized":"2024-08-31T04:23:34.376991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370111+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:23:34.370111+0000","last_peered":"2024-08-31T04:23:34.370111+0000","last_clean":"2024-08-31T04:23:34.370111+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:23:34.370111+0000","last_undegraded":"2024-08-31T04:23:34.370111+0000","last_fullsized":"2024-08-31T04:23:34.370111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.365887+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:23:34.365887+0000","last_peered":"2024-08-31T04:23:34.365887+0000","last_clean":"2024-08-31T04:23:34.365887+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:23:34.365887+0000","last_undegraded":"2024-08-31T04:23:34.365887+0000","last_fullsized":"2024-08-31T04:23:34.365887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371328+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:23:34.371328+0000","last_peered":"2024-08-31T04:23:34.371328+0000","last_clean":"2024-08-31T04:23:34.371328+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:23:34.371328+0000","last_undegraded":"2024-08-31T04:23:34.371328+0000","last_fullsized":"2024-08-31T04:23:34.371328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.374684+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:23:34.374684+0000","last_peered":"2024-08-31T04:23:34.374684+0000","last_clean":"2024-08-31T04:23:34.374684+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:23:34.374684+0000","last_undegraded":"2024-08-31T04:23:34.374684+0000","last_fullsized":"2024-08-31T04:23:34.374684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369752+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:23:34.369752+0000","last_peered":"2024-08-31T04:23:34.369752+0000","last_clean":"2024-08-31T04:23:34.369752+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:23:34.369752+0000","last_undegraded":"2024-08-31T04:23:34.369752+0000","last_fullsized":"2024-08-31T04:23:34.369752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.496507+0000","last_change":"2024-08-31T04:22:57.252212+0000","last_active":"2024-08-31T04:23:34.496507+0000","last_peered":"2024-08-31T04:23:34.496507+0000","last_clean":"2024-08-31T04:23:34.496507+0000","last_became_active":"2024-08-31T04:22:57.250923+0000","last_became_peered":"2024-08-31T04:22:57.250923+0000","last_unstale":"2024-08-31T04:23:34.496507+0000","last_undegraded":"2024-08-31T04:23:34.496507+0000","last_fullsized":"2024-08-31T04:23:34.496507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:56:18.585443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.494697+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:23:34.494697+0000","last_peered":"2024-08-31T04:23:34.494697+0000","last_clean":"2024-08-31T04:23:34.494697+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:23:34.494697+0000","last_undegraded":"2024-08-31T04:23:34.494697+0000","last_fullsized":"2024-08-31T04:23:34.494697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373787+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:23:34.373787+0000","last_peered":"2024-08-31T04:23:34.373787+0000","last_clean":"2024-08-31T04:23:34.373787+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:23:34.373787+0000","last_undegraded":"2024-08-31T04:23:34.373787+0000","last_fullsized":"2024-08-31T04:23:34.373787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.368409+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:23:34.368409+0000","last_peered":"2024-08-31T04:23:34.368409+0000","last_clean":"2024-08-31T04:23:34.368409+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:23:34.368409+0000","last_undegraded":"2024-08-31T04:23:34.368409+0000","last_fullsized":"2024-08-31T04:23:34.368409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.373147+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:23:34.373147+0000","last_peered":"2024-08-31T04:23:34.373147+0000","last_clean":"2024-08-31T04:23:34.373147+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:23:34.373147+0000","last_undegraded":"2024-08-31T04:23:34.373147+0000","last_fullsized":"2024-08-31T04:23:34.373147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.371187+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:23:34.371187+0000","last_peered":"2024-08-31T04:23:34.371187+0000","last_clean":"2024-08-31T04:23:34.371187+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:23:34.371187+0000","last_undegraded":"2024-08-31T04:23:34.371187+0000","last_fullsized":"2024-08-31T04:23:34.371187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369435+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:23:34.369435+0000","last_peered":"2024-08-31T04:23:34.369435+0000","last_clean":"2024-08-31T04:23:34.369435+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:23:34.369435+0000","last_undegraded":"2024-08-31T04:23:34.369435+0000","last_fullsized":"2024-08-31T04:23:34.369435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369592+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:23:34.369592+0000","last_peered":"2024-08-31T04:23:34.369592+0000","last_clean":"2024-08-31T04:23:34.369592+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:23:34.369592+0000","last_undegraded":"2024-08-31T04:23:34.369592+0000","last_fullsized":"2024-08-31T04:23:34.369592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367487+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:23:34.367487+0000","last_peered":"2024-08-31T04:23:34.367487+0000","last_clean":"2024-08-31T04:23:34.367487+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:23:34.367487+0000","last_undegraded":"2024-08-31T04:23:34.367487+0000","last_fullsized":"2024-08-31T04:23:34.367487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56287,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":162,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":168861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":481736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1622016,"data_stored":1120243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103201,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":485055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299430,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":480297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1552384,"data_stored":1076200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":476135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1564672,"data_stored":1072376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":482771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":476329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":528086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":528522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":52477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":53830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:23:58.873 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T04:23:58.874 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T04:23:58.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T04:23:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:58 smithi002 ceph-mon[18656]: pgmap v293: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T04:23:59.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:58 smithi064 ceph-mon[22007]: pgmap v293: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T04:23:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:58 smithi132 ceph-mon[22335]: pgmap v293: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T04:23:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:59.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 -- 172.21.15.2:0/2913031305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 msgr2=0x7f44b4103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:59.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/2913031305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b4103450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009900 tx=0x7f44b002a410 comp rx=0 tx=0).stop 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 -- 172.21.15.2:0/2913031305 shutdown_connections 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/2913031305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 0x7f44b410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/2913031305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 0x7f44b41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/2913031305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b4103450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 -- 172.21.15.2:0/2913031305 >> 172.21.15.2:0/2913031305 conn(0x7f44b4079d70 msgr2=0x7f44b407a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 -- 172.21.15.2:0/2913031305 shutdown_connections 2024-08-31T04:23:59.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 -- 172.21.15.2:0/2913031305 wait complete. 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.651+0000 7f44bc6a7640 1 Processor -- start 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 -- start start 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 0x7f44b4110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 0x7f44b4110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4113870 con 0x7f44b4103040 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f44b41136f0 con 0x7f44b4108af0 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bc6a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f44b41139f0 con 0x7f44b41081a0 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36944/0 (socket says 172.21.15.2:36944) 2024-08-31T04:23:59.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 -- 172.21.15.2:0/1051205820 learned_addr learned my addr 172.21.15.2:0/1051205820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44bac44640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 0x7f44b4110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44b9c42640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 0x7f44b4110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 -- 172.21.15.2:0/1051205820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 msgr2=0x7f44b4110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 0x7f44b4110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 -- 172.21.15.2:0/1051205820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 msgr2=0x7f44b4110880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 0x7f44b4110880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.652+0000 7f44ba443640 1 -- 172.21.15.2:0/1051205820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b41a8430 con 0x7f44b4103040 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44ba443640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b003f030 con 0x7f44b4103040 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b41a86c0 con 0x7f44b4103040 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44b0003cb0 con 0x7f44b4103040 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0035070 con 0x7f44b4103040 2024-08-31T04:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.653+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b41a8ba0 con 0x7f44b4103040 2024-08-31T04:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.654+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b4103450 con 0x7f44b4103040 2024-08-31T04:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.656+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f44b0042030 con 0x7f44b4103040 2024-08-31T04:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.656+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 0x7f44a00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.657+0000 7f44b9c42640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 0x7f44a00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.657+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f44b0105f80 con 0x7f44b4103040 2024-08-31T04:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.657+0000 7f44b9c42640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 0x7f44a00b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005fd0 tx=0x7f44a4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.660+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f44b00ccb20 con 0x7f44b4103040 2024-08-31T04:23:59.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.917+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f44b402e430 con 0x7f44b4103040 2024-08-31T04:23:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.920+0000 7f44ab7fe640 1 -- 172.21.15.2:0/1051205820 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f44b00d5060 con 0x7f44b4103040 2024-08-31T04:23:59.921 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-08-31T04:23:59.922 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDfmtJmp2fCNhAAMnDWhfC91keKpljXE3ahhQ== 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 msgr2=0x7f44a00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 0x7f44a00b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005fd0 tx=0x7f44a4005850 comp rx=0 tx=0).stop 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 msgr2=0x7f44b410fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b00042f0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 shutdown_connections 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44b4108af0 0x7f44b4110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b41081a0 0x7f44b4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f44a00b4c10 0x7f44a00b7120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 --2- 172.21.15.2:0/1051205820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b4103040 0x7f44b410fe00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:59.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 >> 172.21.15.2:0/1051205820 conn(0x7f44b4079d70 msgr2=0x7f44b41061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:59.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 shutdown_connections 2024-08-31T04:23:59.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:23:59.922+0000 7f44bc6a7640 1 -- 172.21.15.2:0/1051205820 wait complete. 2024-08-31T04:24:00.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:23:59 smithi064 ceph-mon[22007]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:00.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:23:59 smithi132 ceph-mon[22335]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:00.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:23:59 smithi002 ceph-mon[18656]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:00.613 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:24:00.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T04:24:00.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T04:24:00.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T04:24:00.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:00 smithi002 ceph-mon[18656]: pgmap v294: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-08-31T04:24:00.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:00 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:24:00.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:00 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:24:00.981 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:00 smithi064 ceph-mon[22007]: pgmap v294: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-08-31T04:24:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:00 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:24:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:00 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:24:01.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:00 smithi132 ceph-mon[22335]: pgmap v294: 129 pgs: 129 active+clean; 632 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-08-31T04:24:01.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:00 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:24:01.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:00 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1051205820' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 -- 172.21.15.2:0/2612444229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0109250 msgr2=0x7f0bb0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 --2- 172.21.15.2:0/2612444229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0109250 0x7f0bb0109660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009900 tx=0x7f0b9802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 -- 172.21.15.2:0/2612444229 shutdown_connections 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 --2- 172.21.15.2:0/2612444229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0109250 0x7f0bb0109660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 --2- 172.21.15.2:0/2612444229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 --2- 172.21.15.2:0/2612444229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0103910 0x7f0bb0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 -- 172.21.15.2:0/2612444229 >> 172.21.15.2:0/2612444229 conn(0x7f0bb00ff380 msgr2=0x7f0bb01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 -- 172.21.15.2:0/2612444229 shutdown_connections 2024-08-31T04:24:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.469+0000 7f0bb6005640 1 -- 172.21.15.2:0/2612444229 wait complete. 2024-08-31T04:24:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 Processor -- start 2024-08-31T04:24:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 -- start start 2024-08-31T04:24:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0109250 0x7f0bb019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0113860 con 0x7f0bb0103910 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01136e0 con 0x7f0bb0109250 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0bb6005640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01139e0 con 0x7f0bb0109ba0 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0baf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0baf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36962/0 (socket says 172.21.15.2:36962) 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0baf7fe640 1 -- 172.21.15.2:0/221801132 learned_addr learned my addr 172.21.15.2:0/221801132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.470+0000 7f0ba6ffd640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0109250 0x7f0bb019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baffff640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 -- 172.21.15.2:0/221801132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 msgr2=0x7f0bb019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 -- 172.21.15.2:0/221801132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0109250 msgr2=0x7f0bb019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0109250 0x7f0bb019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 -- 172.21.15.2:0/221801132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb01a0120 con 0x7f0bb0103910 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baffff640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0baf7fe640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000d950 tx=0x7f0ba000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0017070 con 0x7f0bb0103910 2024-08-31T04:24:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba0009c30 con 0x7f0bb0103910 2024-08-31T04:24:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb01a0410 con 0x7f0bb0103910 2024-08-31T04:24:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000f620 con 0x7f0bb0103910 2024-08-31T04:24:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.471+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb01a6c30 con 0x7f0bb0103910 2024-08-31T04:24:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.472+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb0103d20 con 0x7f0bb0103910 2024-08-31T04:24:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.475+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f0ba0005030 con 0x7f0bb0103910 2024-08-31T04:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.476+0000 7f0bad7fa640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 0x7f0b9c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.476+0000 7f0ba6ffd640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 0x7f0b9c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.476+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f0ba00e53a0 con 0x7f0bb0103910 2024-08-31T04:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.476+0000 7f0ba6ffd640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 0x7f0b9c0b7150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009230 tx=0x7f0b98031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:01.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.479+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0ba00abee0 con 0x7f0bb0103910 2024-08-31T04:24:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.666+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f0bb019b3a0 con 0x7f0bb0103910 2024-08-31T04:24:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.666+0000 7f0bad7fa640 1 -- 172.21.15.2:0/221801132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v56) ==== 86+0+133 (secure 0 0 0) 0x7f0ba00ab7e0 con 0x7f0bb0103910 2024-08-31T04:24:01.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 msgr2=0x7f0b9c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 0x7f0b9c0b7150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009230 tx=0x7f0b98031400 comp rx=0 tx=0).stop 2024-08-31T04:24:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 msgr2=0x7f0bb019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000d950 tx=0x7f0ba000de10 comp rx=0 tx=0).stop 2024-08-31T04:24:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 shutdown_connections 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bb0109ba0 0x7f0bb019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb0109250 0x7f0bb019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b9c0b4c40 0x7f0b9c0b7150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 --2- 172.21.15.2:0/221801132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bb0103910 0x7f0bb019a270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 >> 172.21.15.2:0/221801132 conn(0x7f0bb00ff380 msgr2=0x7f0bb01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 shutdown_connections 2024-08-31T04:24:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:01.669+0000 7f0bb6005640 1 -- 172.21.15.2:0/221801132 wait complete. 2024-08-31T04:24:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:01 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/221801132' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:24:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:01 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/221801132' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:24:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:01 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/221801132' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:24:02.408 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":56,"timestamp":"2024-08-31T04:22:47.630713+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T04:24:02.408 INFO:tasks.ceph_manager:config epoch is 56 2024-08-31T04:24:02.408 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T04:24:02.408 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T04:24:02.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T04:24:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:03.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:02 smithi002 ceph-mon[18656]: pgmap v295: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-08-31T04:24:03.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 -- 172.21.15.2:0/3494883286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c105010 msgr2=0x7f7f5c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:03.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 --2- 172.21.15.2:0/3494883286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c105010 0x7f7f5c10d650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009900 tx=0x7f7f4c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:03.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 -- 172.21.15.2:0/3494883286 shutdown_connections 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 --2- 172.21.15.2:0/3494883286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c105010 0x7f7f5c10d650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 --2- 172.21.15.2:0/3494883286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 0x7f7f5c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 --2- 172.21.15.2:0/3494883286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 -- 172.21.15.2:0/3494883286 >> 172.21.15.2:0/3494883286 conn(0x7f7f5c0794d0 msgr2=0x7f7f5c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 -- 172.21.15.2:0/3494883286 shutdown_connections 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 -- 172.21.15.2:0/3494883286 wait complete. 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.205+0000 7f7f640b5640 1 Processor -- start 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 -- start start 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c105010 0x7f7f5c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 0x7f7f5c1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1137f0 con 0x7f7f5c1045e0 2024-08-31T04:24:03.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c113670 con 0x7f7f5c105010 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f640b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c113970 con 0x7f7f5c10db90 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36978/0 (socket says 172.21.15.2:36978) 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 -- 172.21.15.2:0/351286844 learned_addr learned my addr 172.21.15.2:0/351286844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61650640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c105010 0x7f7f5c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f62652640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 0x7f7f5c1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 -- 172.21.15.2:0/351286844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 msgr2=0x7f7f5c1a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 0x7f7f5c1a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 -- 172.21.15.2:0/351286844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c105010 msgr2=0x7f7f5c19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c105010 0x7f7f5c19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.206+0000 7f7f61e51640 1 -- 172.21.15.2:0/351286844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c1a2460 con 0x7f7f5c1045e0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f61e51640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d770 tx=0x7f7f5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58017070 con 0x7f7f5c1045e0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1a2750 con 0x7f7f5c1045e0 2024-08-31T04:24:03.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f58009c30 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58003cc0 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.207+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a8eb0 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.208+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c1049f0 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.209+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7f58003e60 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.210+0000 7f7f52ffd640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 0x7f7f480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.211+0000 7f7f61650640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 0x7f7f480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.211+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f7f580e5490 con 0x7f7f5c1045e0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.211+0000 7f7f61650640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 0x7f7f480b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009230 tx=0x7f7f4c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:03.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.214+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f58009de0 con 0x7f7f5c1045e0 2024-08-31T04:24:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:02 smithi132 ceph-mon[22335]: pgmap v295: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-08-31T04:24:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:02 smithi064 ceph-mon[22007]: pgmap v295: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-08-31T04:24:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.451+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7f5c1a9150 con 0x7f7f5c1045e0 2024-08-31T04:24:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.456+0000 7f7f52ffd640 1 -- 172.21.15.2:0/351286844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+293199 (secure 0 0 0) 0x7f7f580ab980 con 0x7f7f5c1045e0 2024-08-31T04:24:03.462 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 msgr2=0x7f7f480b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 0x7f7f480b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009230 tx=0x7f7f4c031400 comp rx=0 tx=0).stop 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 msgr2=0x7f7f5c19c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d770 tx=0x7f7f5800dc30 comp rx=0 tx=0).stop 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 shutdown_connections 2024-08-31T04:24:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f5c10db90 0x7f7f5c1a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c105010 0x7f7f5c19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7f480b4c10 0x7f7f480b7120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 --2- 172.21.15.2:0/351286844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1045e0 0x7f7f5c19c4f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 >> 172.21.15.2:0/351286844 conn(0x7f7f5c0794d0 msgr2=0x7f7f5c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 shutdown_connections 2024-08-31T04:24:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:03.459+0000 7f7f640b5640 1 -- 172.21.15.2:0/351286844 wait complete. 2024-08-31T04:24:04.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/351286844' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:24:04.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1444417427},{"type":"v1","addr":"172.21.15.2:6801","nonce":1444417427}]},"active_addr":"172.21.15.2:6801/1444417427","active_change":"2024-08-31T04:16:32.968630+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24184,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24191,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3923362305}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2150317341}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1486124624}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2713533173}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4081601109}]}]} 2024-08-31T04:24:04.124 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T04:24:04.124 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T04:24:04.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:24:04.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:03 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/351286844' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:24:04.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:03 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/351286844' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:24:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 -- 172.21.15.2:0/886659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108ab0 msgr2=0x7fddd810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/886659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108ab0 0x7fddd810f2e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009900 tx=0x7fddd002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 -- 172.21.15.2:0/886659371 shutdown_connections 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/886659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108ab0 0x7fddd810f2e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/886659371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108160 0x7fddd8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/886659371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 0x7fddd8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 -- 172.21.15.2:0/886659371 >> 172.21.15.2:0/886659371 conn(0x7fddd80794e0 msgr2=0x7fddd80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 -- 172.21.15.2:0/886659371 shutdown_connections 2024-08-31T04:24:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.823+0000 7fdddcfe7640 1 -- 172.21.15.2:0/886659371 wait complete. 2024-08-31T04:24:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 Processor -- start 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 -- start start 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 0x7fddd819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108ab0 0x7fddd819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8112730 con 0x7fddd8108160 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fddd81125b0 con 0x7fddd8102820 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.824+0000 7fdddcfe7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fddd81128b0 con 0x7fddd8108ab0 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37000/0 (socket says 172.21.15.2:37000) 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 -- 172.21.15.2:0/2412109448 learned_addr learned my addr 172.21.15.2:0/2412109448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd659c640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 0x7fddd819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd6d9d640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108ab0 0x7fddd819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 -- 172.21.15.2:0/2412109448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108ab0 msgr2=0x7fddd819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108ab0 0x7fddd819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 -- 172.21.15.2:0/2412109448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 msgr2=0x7fddd819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 0x7fddd819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 -- 172.21.15.2:0/2412109448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd81a0080 con 0x7fddd8108160 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddd5d9b640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00d740 tx=0x7fddcc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.825+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc017070 con 0x7fddd8108160 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.826+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd81a0370 con 0x7fddd8108160 2024-08-31T04:24:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.826+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddcc00de50 con 0x7fddd8108160 2024-08-31T04:24:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.826+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc004ce0 con 0x7fddd8108160 2024-08-31T04:24:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.826+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81a6b90 con 0x7fddd8108160 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.827+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd8103aa0 con 0x7fddd8108160 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.828+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fddcc004e80 con 0x7fddd8108160 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.829+0000 7fddc77fe640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 0x7fddc00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.829+0000 7fddd659c640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 0x7fddc00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.829+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fddcc0e5580 con 0x7fddd8108160 2024-08-31T04:24:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.830+0000 7fddd659c640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 0x7fddc00b7150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fddc8007ec0 tx=0x7fddc80075b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:04.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:04.835+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fddcc0ac0c0 con 0x7fddd8108160 2024-08-31T04:24:05.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.021+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddd810b8b0 con 0x7fddd8108160 2024-08-31T04:24:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.023+0000 7fddc77fe640 1 -- 172.21.15.2:0/2412109448 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24908 (secure 0 0 0) 0x7fddcc0ab9c0 con 0x7fddd8108160 2024-08-31T04:24:05.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:05.026 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:34.362402+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 msgr2=0x7fddc00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 0x7fddc00b7150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fddc8007ec0 tx=0x7fddc80075b0 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 msgr2=0x7fddd819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00d740 tx=0x7fddcc00dc00 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 shutdown_connections 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc00b4c40 0x7fddc00b7150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8108160 0x7fddd819a770 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8108ab0 0x7fddd819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 --2- 172.21.15.2:0/2412109448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8102820 0x7fddd819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 >> 172.21.15.2:0/2412109448 conn(0x7fddd80794e0 msgr2=0x7fddd806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 shutdown_connections 2024-08-31T04:24:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:05.025+0000 7fdddcfe7640 1 -- 172.21.15.2:0/2412109448 wait complete. 2024-08-31T04:24:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:04 smithi002 ceph-mon[18656]: pgmap v296: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-08-31T04:24:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:04 smithi132 ceph-mon[22335]: pgmap v296: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-08-31T04:24:05.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:04 smithi064 ceph-mon[22007]: pgmap v296: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-08-31T04:24:05.728 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T04:24:05.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:24:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:06.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:05 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2412109448' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:06.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:05 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2412109448' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:06.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:05 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2412109448' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:06.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 -- 172.21.15.2:0/1333619466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102420 msgr2=0x7f7410102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:06.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 --2- 172.21.15.2:0/1333619466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102420 0x7f7410102830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f740c009900 tx=0x7f740c02a480 comp rx=0 tx=0).stop 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 -- 172.21.15.2:0/1333619466 shutdown_connections 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 --2- 172.21.15.2:0/1333619466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f741010ffd0 0x7f74101123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 --2- 172.21.15.2:0/1333619466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7410102d70 0x7f741010fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 --2- 172.21.15.2:0/1333619466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102420 0x7f7410102830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 -- 172.21.15.2:0/1333619466 >> 172.21.15.2:0/1333619466 conn(0x7f7410079470 msgr2=0x7f7410079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 -- 172.21.15.2:0/1333619466 shutdown_connections 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.468+0000 7f7417f12640 1 -- 172.21.15.2:0/1333619466 wait complete. 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 Processor -- start 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 -- start start 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7410102420 0x7f741019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f741010ffd0 0x7f74101a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7410115b00 con 0x7f7410102d70 2024-08-31T04:24:06.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7410115980 con 0x7f7410102420 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7417f12640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7410115c80 con 0x7f741010ffd0 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f74154ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f74154ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43432/0 (socket says 172.21.15.2:43432) 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f74154ad640 1 -- 172.21.15.2:0/1533354118 learned_addr learned my addr 172.21.15.2:0/1533354118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f7415cae640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7410102420 0x7f741019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.469+0000 7f74164af640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f741010ffd0 0x7f74101a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 -- 172.21.15.2:0/1533354118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f741010ffd0 msgr2=0x7f74101a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f741010ffd0 0x7f74101a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 -- 172.21.15.2:0/1533354118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7410102420 msgr2=0x7f741019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7410102420 0x7f741019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 -- 172.21.15.2:0/1533354118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74101a2460 con 0x7f7410102d70 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f74154ad640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f740000b4a0 tx=0x7f740000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400014070 con 0x7f7410102d70 2024-08-31T04:24:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7400010ac0 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400017c30 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74101a2750 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.470+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74101a8eb0 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.471+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7410102830 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.473+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7400017070 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.473+0000 7f7406ffd640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 0x7f73fc0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.473+0000 7f7415cae640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 0x7f73fc0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.474+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f74000e4950 con 0x7f7410102d70 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.474+0000 7f7415cae640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 0x7f73fc0b71a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f740c031440 tx=0x7f740c005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.478+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74000ab4f0 con 0x7f7410102d70 2024-08-31T04:24:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.664+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74101a9110 con 0x7f7410102d70 2024-08-31T04:24:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.665+0000 7f7406ffd640 1 -- 172.21.15.2:0/1533354118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24908 (secure 0 0 0) 0x7f74000aadf0 con 0x7f7410102d70 2024-08-31T04:24:06.667 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:06.667 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:23:34.362402+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 msgr2=0x7f73fc0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 0x7f73fc0b71a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f740c031440 tx=0x7f740c005e80 comp rx=0 tx=0).stop 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 msgr2=0x7f741019ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f740000b4a0 tx=0x7f740000b960 comp rx=0 tx=0).stop 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 shutdown_connections 2024-08-31T04:24:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73fc0b4c90 0x7f73fc0b71a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7410102d70 0x7f741019ca90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f741010ffd0 0x7f74101a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 --2- 172.21.15.2:0/1533354118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7410102420 0x7f741019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 >> 172.21.15.2:0/1533354118 conn(0x7f7410079470 msgr2=0x7f7410108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 shutdown_connections 2024-08-31T04:24:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:06.668+0000 7f7417f12640 1 -- 172.21.15.2:0/1533354118 wait complete. 2024-08-31T04:24:07.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:06 smithi002 ceph-mon[18656]: pgmap v297: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-08-31T04:24:07.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:06 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1533354118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:06 smithi064 ceph-mon[22007]: pgmap v297: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-08-31T04:24:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:06 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1533354118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:07.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:06 smithi132 ceph-mon[22335]: pgmap v297: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-08-31T04:24:07.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:06 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1533354118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:07.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T04:24:07.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T04:24:07.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T04:24:07.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T04:24:07.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T04:24:07.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T04:24:07.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T04:24:07.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T04:24:07.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T04:24:07.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T04:24:07.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T04:24:07.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T04:24:08.159 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:08.608 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:09.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:08 smithi002 ceph-mon[18656]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-08-31T04:24:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:08 smithi064 ceph-mon[22007]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-08-31T04:24:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:08 smithi132 ceph-mon[22335]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 -- 172.21.15.2:0/1604662498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94108aa0 msgr2=0x7fab9410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 --2- 172.21.15.2:0/1604662498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94108aa0 0x7fab9410f2d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009ca0 tx=0x7fab8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 -- 172.21.15.2:0/1604662498 shutdown_connections 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 --2- 172.21.15.2:0/1604662498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94108aa0 0x7fab9410f2d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 --2- 172.21.15.2:0/1604662498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab94108150 0x7fab94108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 --2- 172.21.15.2:0/1604662498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab94102810 0x7fab94102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 -- 172.21.15.2:0/1604662498 >> 172.21.15.2:0/1604662498 conn(0x7fab940794d0 msgr2=0x7fab940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 -- 172.21.15.2:0/1604662498 shutdown_connections 2024-08-31T04:24:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 -- 172.21.15.2:0/1604662498 wait complete. 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.463+0000 7fab99cac640 1 Processor -- start 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 -- start start 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 0x7fab94104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab94108150 0x7fab941053d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab94108aa0 0x7fab94105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab94112700 con 0x7fab94102810 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fab94112580 con 0x7fab94108aa0 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab99cac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fab94112880 con 0x7fab94108150 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 0x7fab94104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 0x7fab94104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43488/0 (socket says 172.21.15.2:43488) 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 -- 172.21.15.2:0/605472124 learned_addr learned my addr 172.21.15.2:0/605472124 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab93fff640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab94108aa0 0x7fab94105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab92ffd640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab94108150 0x7fab941053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 -- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab94108150 msgr2=0x7fab941053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab94108150 0x7fab941053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 -- 172.21.15.2:0/605472124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab94108aa0 msgr2=0x7fab94105910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab94108aa0 0x7fab94105910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.464+0000 7fab937fe640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab941a8430 con 0x7fab94102810 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab937fe640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 0x7fab94104e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab8400d950 tx=0x7fab8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84017030 con 0x7fab94102810 2024-08-31T04:24:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab84004020 con 0x7fab94102810 2024-08-31T04:24:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab941a8720 con 0x7fab94102810 2024-08-31T04:24:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab840047a0 con 0x7fab94102810 2024-08-31T04:24:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.465+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab941a8c60 con 0x7fab94102810 2024-08-31T04:24:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.466+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab940638f0 con 0x7fab94102810 2024-08-31T04:24:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.467+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fab84009a30 con 0x7fab94102810 2024-08-31T04:24:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab90ff9640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fab7c0b4c10 0x7fab7c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab92ffd640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fab7c0b4c10 0x7fab7c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fab840e5810 con 0x7fab94102810 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab90ff9640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] conn(0x7fab7c0bffa0 0x7fab7c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab8401ee70 con 0x7fab7c0bffa0 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.468+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fab840e5c60 con 0x7fab94102810 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.469+0000 7fab92ffd640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fab7c0b4c10 0x7fab7c0b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab94107820 tx=0x7fab8800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.469+0000 7fab93fff640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] conn(0x7fab7c0bffa0 0x7fab7c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.469+0000 7fab93fff640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] conn(0x7fab7c0bffa0 0x7fab7c0c2490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.470+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== osd.11 v2:172.21.15.132:6824/655576737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab8401ee70 con 0x7fab7c0bffa0 2024-08-31T04:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.483+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 --> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab94063cf0 con 0x7fab7c0bffa0 2024-08-31T04:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab90ff9640 1 -- 172.21.15.2:0/605472124 <== osd.11 v2:172.21.15.132:6824/655576737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fab94063cf0 con 0x7fab7c0bffa0 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] conn(0x7fab7c0bffa0 msgr2=0x7fab7c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] conn(0x7fab7c0bffa0 0x7fab7c0c2490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fab7c0b4c10 msgr2=0x7fab7c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fab7c0b4c10 0x7fab7c0b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab94107820 tx=0x7fab8800a2d0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 msgr2=0x7fab94104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab99cac640 1 --2- 172.21.15.2:0/605472124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab94102810 0x7fab94104e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab8400d950 tx=0x7fab8400de10 comp rx=0 tx=0).stop 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.484+0000 7fab93fff640 1 -- 172.21.15.2:0/605472124 reap_dead start 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.485+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 shutdown_connections 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.485+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 >> 172.21.15.2:0/605472124 conn(0x7fab940794d0 msgr2=0x7fab9406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.485+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 shutdown_connections 2024-08-31T04:24:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:09.485+0000 7fab99cac640 1 -- 172.21.15.2:0/605472124 wait complete. 2024-08-31T04:24:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 -- 172.21.15.2:0/3088965946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30001050a0 msgr2=0x7f300010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 --2- 172.21.15.2:0/3088965946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30001050a0 0x7f300010d5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009900 tx=0x7f2ff402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 -- 172.21.15.2:0/3088965946 shutdown_connections 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 --2- 172.21.15.2:0/3088965946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30001050a0 0x7f300010d5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 --2- 172.21.15.2:0/3088965946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f300010dbb0 0x7f30001100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 --2- 172.21.15.2:0/3088965946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3000104750 0x7f3000104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.815+0000 7f3005d4f640 1 -- 172.21.15.2:0/3088965946 >> 172.21.15.2:0/3088965946 conn(0x7f30000794d0 msgr2=0x7f30000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.816+0000 7f3005d4f640 1 -- 172.21.15.2:0/3088965946 shutdown_connections 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.816+0000 7f3005d4f640 1 -- 172.21.15.2:0/3088965946 wait complete. 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.816+0000 7f3005d4f640 1 Processor -- start 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.816+0000 7f3005d4f640 1 -- start start 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 0x7f3000102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30001050a0 0x7f30001029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f300010dbb0 0x7f3000102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30001137d0 con 0x7f3000104750 2024-08-31T04:24:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3000113650 con 0x7f300010dbb0 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f3005d4f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3000113950 con 0x7f30001050a0 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 0x7f3000102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 0x7f3000102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43460/0 (socket says 172.21.15.2:43460) 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 -- 172.21.15.2:0/1309964268 learned_addr learned my addr 172.21.15.2:0/1309964268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2ffffff640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f300010dbb0 0x7f3000102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30001050a0 0x7f30001029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 -- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30001050a0 msgr2=0x7f30001029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30001050a0 0x7f30001029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 -- 172.21.15.2:0/1309964268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f300010dbb0 msgr2=0x7f3000102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f300010dbb0 0x7f3000102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2fff7fe640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30001a84c0 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.817+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30001050a0 0x7f30001029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 0x7f3000102490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000d770 tx=0x7f2ff000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0017070 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30001a87b0 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ff0009c30 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0003cc0 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.818+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a8d10 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.819+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30000638f0 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.821+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f2ff0003e60 con 0x7f3000104750 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.821+0000 7f2ffcff9640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2fe80b4c10 0x7f2fe80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.821+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2fe80b4c10 0x7f2fe80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.821+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f2ff00e5690 con 0x7f3000104750 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffcff9640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] conn(0x7f2fe80bffa0 0x7f2fe80c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe80c2b60 con 0x7f2fe80bffa0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2ff00e5ae0 con 0x7f3000104750 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2fe80b4c10 0x7f2fe80b7120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009230 tx=0x7f2ff4000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffffff640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] conn(0x7f2fe80bffa0 0x7f2fe80c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.822+0000 7f2ffffff640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] conn(0x7f2fe80bffa0 0x7f2fe80c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.823+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== osd.2 v2:172.21.15.132:6800/1699390891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fe80c2b60 con 0x7f2fe80bffa0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.837+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 --> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3000063cf0 con 0x7f2fe80bffa0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.837+0000 7f2ffcff9640 1 -- 172.21.15.2:0/1309964268 <== osd.2 v2:172.21.15.132:6800/1699390891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3000063cf0 con 0x7f2fe80bffa0 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] conn(0x7f2fe80bffa0 msgr2=0x7f2fe80c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] conn(0x7f2fe80bffa0 0x7f2fe80c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2fe80b4c10 msgr2=0x7f2fe80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2fe80b4c10 0x7f2fe80b7120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009230 tx=0x7f2ff4000bc0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 msgr2=0x7f3000102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 --2- 172.21.15.2:0/1309964268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3000104750 0x7f3000102490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000d770 tx=0x7f2ff000dc30 comp rx=0 tx=0).stop 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f2ffffff640 1 -- 172.21.15.2:0/1309964268 reap_dead start 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 shutdown_connections 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 >> 172.21.15.2:0/1309964268 conn(0x7f30000794d0 msgr2=0x7f30001005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 shutdown_connections 2024-08-31T04:24:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:08.838+0000 7f3005d4f640 1 -- 172.21.15.2:0/1309964268 wait complete. 2024-08-31T04:24:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:10.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 -- 172.21.15.2:0/2902511218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04109240 msgr2=0x7faa04109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/2902511218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04109240 0x7faa04109650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009900 tx=0x7fa9f402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 -- 172.21.15.2:0/2902511218 shutdown_connections 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/2902511218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04109240 0x7faa04109650 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/2902511218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109b90 0x7faa041103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/2902511218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04103900 0x7faa04103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 -- 172.21.15.2:0/2902511218 >> 172.21.15.2:0/2902511218 conn(0x7faa0407b5f0 msgr2=0x7faa0407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 -- 172.21.15.2:0/2902511218 shutdown_connections 2024-08-31T04:24:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.201+0000 7faa0bfa5640 1 -- 172.21.15.2:0/2902511218 wait complete. 2024-08-31T04:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 Processor -- start 2024-08-31T04:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 -- start start 2024-08-31T04:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 0x7faa040754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109240 0x7faa040759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04109b90 0x7faa04075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa04113850 con 0x7faa04103900 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa041136d0 con 0x7faa04109b90 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0bfa5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faa041139d0 con 0x7faa04109240 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 0x7faa040754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 0x7faa040754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43506/0 (socket says 172.21.15.2:43506) 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 -- 172.21.15.2:0/1112302884 learned_addr learned my addr 172.21.15.2:0/1112302884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0a542640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04109b90 0x7faa04075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 -- 172.21.15.2:0/1112302884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109240 msgr2=0x7faa040759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09540640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109240 0x7faa040759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109240 0x7faa040759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 -- 172.21.15.2:0/1112302884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04109b90 msgr2=0x7faa04075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04109b90 0x7faa04075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09d41640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa041a8540 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa0a542640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa04109b90 0x7faa04075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.202+0000 7faa09540640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa04109240 0x7faa040759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7faa09d41640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 0x7faa040754b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa0000db80 tx=0x7faa0000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00017070 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa00003b70 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa041a8830 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000106c0 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.203+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa041a8dc0 con 0x7faa04103900 2024-08-31T04:24:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.204+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa040638f0 con 0x7faa04103900 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.205+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7faa00004020 con 0x7faa04103900 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7fa9faffd640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9f00b4c90 0x7fa9f00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7faa09540640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9f00b4c90 0x7fa9f00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7faa000e5ff0 con 0x7faa04103900 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7fa9faffd640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] conn(0x7fa9f00c0020 0x7fa9f00c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:10.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9f00c2be0 con 0x7fa9f00c0020 2024-08-31T04:24:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.206+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7faa000e6420 con 0x7faa04103900 2024-08-31T04:24:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.207+0000 7faa0a542640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] conn(0x7fa9f00c0020 0x7fa9f00c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.207+0000 7faa09540640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9f00b4c90 0x7fa9f00b71a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.207+0000 7faa0a542640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] conn(0x7fa9f00c0020 0x7fa9f00c2510 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.208+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== osd.6 v2:172.21.15.2:6818/2257797183 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9f00c2be0 con 0x7fa9f00c0020 2024-08-31T04:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.221+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 --> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa04063cf0 con 0x7fa9f00c0020 2024-08-31T04:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7fa9faffd640 1 -- 172.21.15.2:0/1112302884 <== osd.6 v2:172.21.15.2:6818/2257797183 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa04063cf0 con 0x7fa9f00c0020 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] conn(0x7fa9f00c0020 msgr2=0x7fa9f00c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] conn(0x7fa9f00c0020 0x7fa9f00c2510 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9f00b4c90 msgr2=0x7fa9f00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa9f00b4c90 0x7fa9f00b71a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f4031400 comp rx=0 tx=0).stop 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 msgr2=0x7faa040754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 --2- 172.21.15.2:0/1112302884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa04103900 0x7faa040754b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa0000db80 tx=0x7faa0000b630 comp rx=0 tx=0).stop 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0a542640 1 -- 172.21.15.2:0/1112302884 reap_dead start 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 shutdown_connections 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 >> 172.21.15.2:0/1112302884 conn(0x7faa0407b5f0 msgr2=0x7faa04107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 shutdown_connections 2024-08-31T04:24:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:10.222+0000 7faa0bfa5640 1 -- 172.21.15.2:0/1112302884 wait complete. 2024-08-31T04:24:11.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:10 smithi002 ceph-mon[18656]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-31T04:24:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:11.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:10 smithi132 ceph-mon[22335]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-31T04:24:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:10 smithi064 ceph-mon[22007]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-31T04:24:11.604 INFO:teuthology.orchestra.run.smithi002.stdout:81604378697 2024-08-31T04:24:11.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 -- 172.21.15.2:0/2723600464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288105050 msgr2=0x7ff28810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2723600464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288105050 0x7ff28810d690 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009900 tx=0x7ff27c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 -- 172.21.15.2:0/2723600464 shutdown_connections 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2723600464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288105050 0x7ff28810d690 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2723600464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28810dbd0 0x7ff2881100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2723600464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288104620 0x7ff288104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 -- 172.21.15.2:0/2723600464 >> 172.21.15.2:0/2723600464 conn(0x7ff2880794d0 msgr2=0x7ff2880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 -- 172.21.15.2:0/2723600464 shutdown_connections 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.033+0000 7ff28fbee640 1 -- 172.21.15.2:0/2723600464 wait complete. 2024-08-31T04:24:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 Processor -- start 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 -- start start 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 0x7ff28819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288105050 0x7ff28819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28810dbd0 0x7ff28819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881137d0 con 0x7ff288104620 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff288113650 con 0x7ff28810dbd0 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28fbee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff288113950 con 0x7ff288105050 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 0x7ff28819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 0x7ff28819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43520/0 (socket says 172.21.15.2:43520) 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 -- 172.21.15.2:0/2333067941 learned_addr learned my addr 172.21.15.2:0/2333067941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28e18b640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28810dbd0 0x7ff28819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 -- 172.21.15.2:0/2333067941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288105050 msgr2=0x7ff28819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288105050 0x7ff28819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 -- 172.21.15.2:0/2333067941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28810dbd0 msgr2=0x7ff28819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff28810dbd0 0x7ff28819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.034+0000 7ff28d98a640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2881a00b0 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff28d98a640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 0x7ff28819a200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ccb0 tx=0x7ff27800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278003b70 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2881a03a0 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff27800ae50 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27800f6b0 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.035+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a6bc0 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.036+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff288063870 con 0x7ff288104620 2024-08-31T04:24:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.038+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7ff278004000 con 0x7ff288104620 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.038+0000 7ff286ffd640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2700b4c40 0x7ff2700b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.038+0000 7ff28d189640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2700b4c40 0x7ff2700b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.038+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7ff2780e5c80 con 0x7ff288104620 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff286ffd640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] conn(0x7ff2700bffd0 0x7ff2700c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2700c2b90 con 0x7ff2700bffd0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff2780e60d0 con 0x7ff288104620 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff28e18b640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] conn(0x7ff2700bffd0 0x7ff2700c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff28d189640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2700b4c40 0x7ff2700b7150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff27c02a930 tx=0x7ff27c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.039+0000 7ff28e18b640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] conn(0x7ff2700bffd0 0x7ff2700c24c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.040+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== osd.3 v2:172.21.15.2:6810/2669191868 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2700c2b90 con 0x7ff2700bffd0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.055+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 --> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff288063c70 con 0x7ff2700bffd0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.055+0000 7ff286ffd640 1 -- 172.21.15.2:0/2333067941 <== osd.3 v2:172.21.15.2:6810/2669191868 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff288063c70 con 0x7ff2700bffd0 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] conn(0x7ff2700bffd0 msgr2=0x7ff2700c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] conn(0x7ff2700bffd0 0x7ff2700c24c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2700b4c40 msgr2=0x7ff2700b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff2700b4c40 0x7ff2700b7150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff27c02a930 tx=0x7ff27c031400 comp rx=0 tx=0).stop 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 msgr2=0x7ff28819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 --2- 172.21.15.2:0/2333067941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff288104620 0x7ff28819a200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ccb0 tx=0x7ff27800a620 comp rx=0 tx=0).stop 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28e18b640 1 -- 172.21.15.2:0/2333067941 reap_dead start 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 shutdown_connections 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 >> 172.21.15.2:0/2333067941 conn(0x7ff2880794d0 msgr2=0x7ff288100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 shutdown_connections 2024-08-31T04:24:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.056+0000 7ff28fbee640 1 -- 172.21.15.2:0/2333067941 wait complete. 2024-08-31T04:24:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:12 smithi002 ceph-mon[18656]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 -- 172.21.15.2:0/2101289345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 msgr2=0x7f6648108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 --2- 172.21.15.2:0/2101289345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f6648108550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f663c009900 tx=0x7f663c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 -- 172.21.15.2:0/2101289345 shutdown_connections 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 --2- 172.21.15.2:0/2101289345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f6648108550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 --2- 172.21.15.2:0/2101289345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6648108a90 0x7f664810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 --2- 172.21.15.2:0/2101289345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6648102800 0x7f6648102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 -- 172.21.15.2:0/2101289345 >> 172.21.15.2:0/2101289345 conn(0x7f66480794d0 msgr2=0x7f66480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 -- 172.21.15.2:0/2101289345 shutdown_connections 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.579+0000 7f664ce20640 1 -- 172.21.15.2:0/2101289345 wait complete. 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 Processor -- start 2024-08-31T04:24:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 -- start start 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6648102800 0x7f664819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f664819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6648108a90 0x7f664819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66481126e0 con 0x7f6648108140 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6648112560 con 0x7f6648108a90 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664ce20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6648112860 con 0x7f6648102800 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f6645d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f664819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f6645d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f664819a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43540/0 (socket says 172.21.15.2:43540) 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f6645d9b640 1 -- 172.21.15.2:0/2238761779 learned_addr learned my addr 172.21.15.2:0/2238761779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.580+0000 7f664659c640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6648102800 0x7f664819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6646d9d640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6648108a90 0x7f664819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 -- 172.21.15.2:0/2238761779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6648102800 msgr2=0x7f664819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6648102800 0x7f664819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 -- 172.21.15.2:0/2238761779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6648108a90 msgr2=0x7f664819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6648108a90 0x7f664819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66481a0230 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f6645d9b640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f664819a860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f663c031a90 tx=0x7f663c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c03f030 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66481a04c0 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f663c003cb0 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c035070 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.581+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a6c80 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.582+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66480638f0 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.584+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f663c042030 con 0x7f6648108140 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.584+0000 7f66377fe640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66300b4c10 0x7f66300b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f664659c640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66300b4c10 0x7f66300b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f663c1061e0 con 0x7f6648108140 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f66377fe640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] conn(0x7f66300bffa0 0x7f66300c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66300c2b60 con 0x7f66300bffa0 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f663c106630 con 0x7f6648108140 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f6646d9d640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] conn(0x7f66300bffa0 0x7f66300c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f664659c640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66300b4c10 0x7f66300b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66380058c0 tx=0x7f663800a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.585+0000 7f6646d9d640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] conn(0x7f66300bffa0 0x7f66300c2490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.586+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== osd.9 v2:172.21.15.2:6826/3837959291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66300c2b60 con 0x7f66300bffa0 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.600+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 --> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6648063d70 con 0x7f66300bffa0 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.600+0000 7f66377fe640 1 -- 172.21.15.2:0/2238761779 <== osd.9 v2:172.21.15.2:6826/3837959291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6648063d70 con 0x7f66300bffa0 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] conn(0x7f66300bffa0 msgr2=0x7f66300c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] conn(0x7f66300bffa0 0x7f66300c2490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66300b4c10 msgr2=0x7f66300b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f66300b4c10 0x7f66300b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66380058c0 tx=0x7f663800a250 comp rx=0 tx=0).stop 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 msgr2=0x7f664819a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 --2- 172.21.15.2:0/2238761779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6648108140 0x7f664819a860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f663c031a90 tx=0x7f663c004270 comp rx=0 tx=0).stop 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f6646d9d640 1 -- 172.21.15.2:0/2238761779 reap_dead start 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 shutdown_connections 2024-08-31T04:24:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 >> 172.21.15.2:0/2238761779 conn(0x7f66480794d0 msgr2=0x7f664806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 shutdown_connections 2024-08-31T04:24:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:12.601+0000 7f664ce20640 1 -- 172.21.15.2:0/2238761779 wait complete. 2024-08-31T04:24:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:12 smithi064 ceph-mon[22007]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T04:24:13.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:12 smithi132 ceph-mon[22335]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T04:24:13.809 INFO:teuthology.orchestra.run.smithi002.stdout:249108103205 2024-08-31T04:24:13.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T04:24:13.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 -- 172.21.15.2:0/2872447420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea0075e20 msgr2=0x7f7ea010fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/2872447420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea0075e20 0x7f7ea010fa70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009900 tx=0x7f7e8802a410 comp rx=0 tx=0).stop 2024-08-31T04:24:13.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 -- 172.21.15.2:0/2872447420 shutdown_connections 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/2872447420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea0075e20 0x7f7ea010fa70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/2872447420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ea010ffb0 0x7f7ea01123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/2872447420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ea00754d0 0x7f7ea00758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 -- 172.21.15.2:0/2872447420 >> 172.21.15.2:0/2872447420 conn(0x7f7ea007b670 msgr2=0x7f7ea007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 -- 172.21.15.2:0/2872447420 shutdown_connections 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.939+0000 7f7ea5d50640 1 -- 172.21.15.2:0/2872447420 wait complete. 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 Processor -- start 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 -- start start 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 0x7f7ea019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ea0075e20 0x7f7ea019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ea010ffb0 0x7f7ea01a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0115a50 con 0x7f7ea00754d0 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01158d0 con 0x7f7ea0075e20 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7ea5d50640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0115bd0 con 0x7f7ea010ffb0 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7e9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 0x7f7ea019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7e9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 0x7f7ea019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43554/0 (socket says 172.21.15.2:43554) 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.940+0000 7f7e9f7fe640 1 -- 172.21.15.2:0/22711710 learned_addr learned my addr 172.21.15.2:0/22711710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9ffff640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ea010ffb0 0x7f7ea01a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e96ffd640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ea0075e20 0x7f7ea019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 -- 172.21.15.2:0/22711710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ea010ffb0 msgr2=0x7f7ea01a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ea010ffb0 0x7f7ea01a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 -- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ea0075e20 msgr2=0x7f7ea019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ea0075e20 0x7f7ea019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea01a24b0 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9f7fe640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 0x7f7ea019c540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000d950 tx=0x7f7e9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90017030 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e90004020 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e900047a0 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea01a27a0 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.941+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea01a8f00 con 0x7f7ea00754d0 2024-08-31T04:24:13.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.943+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ea0103030 con 0x7f7ea00754d0 2024-08-31T04:24:13.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.944+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7e90009a30 con 0x7f7ea00754d0 2024-08-31T04:24:13.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9d7fa640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e8c0b4c10 0x7f7e8c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e96ffd640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e8c0b4c10 0x7f7e8c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f7e900e51a0 con 0x7f7ea00754d0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9d7fa640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] conn(0x7f7e8c0bffa0 0x7f7e8c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e900056a0 con 0x7f7e8c0bffa0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f7e900ec050 con 0x7f7ea00754d0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e9ffff640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] conn(0x7f7e8c0bffa0 0x7f7e8c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.945+0000 7f7e96ffd640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e8c0b4c10 0x7f7e8c0b7120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009230 tx=0x7f7e88031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.946+0000 7f7e9ffff640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] conn(0x7f7e8c0bffa0 0x7f7e8c0c2490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.947+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== osd.7 v2:172.21.15.64:6816/2487011735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e900056a0 con 0x7f7e8c0bffa0 2024-08-31T04:24:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.963+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 --> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ea00769e0 con 0x7f7e8c0bffa0 2024-08-31T04:24:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7e9d7fa640 1 -- 172.21.15.2:0/22711710 <== osd.7 v2:172.21.15.64:6816/2487011735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7ea00769e0 con 0x7f7e8c0bffa0 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] conn(0x7f7e8c0bffa0 msgr2=0x7f7e8c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] conn(0x7f7e8c0bffa0 0x7f7e8c0c2490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e8c0b4c10 msgr2=0x7f7e8c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e8c0b4c10 0x7f7e8c0b7120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009230 tx=0x7f7e88031400 comp rx=0 tx=0).stop 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 msgr2=0x7f7ea019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 --2- 172.21.15.2:0/22711710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ea00754d0 0x7f7ea019c540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000d950 tx=0x7f7e9000de10 comp rx=0 tx=0).stop 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7e9ffff640 1 -- 172.21.15.2:0/22711710 reap_dead start 2024-08-31T04:24:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 shutdown_connections 2024-08-31T04:24:13.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 >> 172.21.15.2:0/22711710 conn(0x7f7ea007b670 msgr2=0x7f7ea0101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:13.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.964+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 shutdown_connections 2024-08-31T04:24:13.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:13.965+0000 7f7ea5d50640 1 -- 172.21.15.2:0/22711710 wait complete. 2024-08-31T04:24:14.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 -- 172.21.15.2:0/249577271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 msgr2=0x7f3254102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 --2- 172.21.15.2:0/249577271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f3254102c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3250009900 tx=0x7f325002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 -- 172.21.15.2:0/249577271 shutdown_connections 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 --2- 172.21.15.2:0/249577271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3254108ac0 0x7f325410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 --2- 172.21.15.2:0/249577271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3254108170 0x7f3254108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 --2- 172.21.15.2:0/249577271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f3254102c90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 -- 172.21.15.2:0/249577271 >> 172.21.15.2:0/249577271 conn(0x7f3254079530 msgr2=0x7f3254079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 -- 172.21.15.2:0/249577271 shutdown_connections 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 -- 172.21.15.2:0/249577271 wait complete. 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.390+0000 7f325c420640 1 Processor -- start 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 -- start start 2024-08-31T04:24:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f325419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3254108170 0x7f325419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3254108ac0 0x7f325419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32541138a0 con 0x7f3254102880 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3254113720 con 0x7f3254108ac0 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325c420640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3254113a20 con 0x7f3254108170 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f325419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f325419a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43578/0 (socket says 172.21.15.2:43578) 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 -- 172.21.15.2:0/3244647648 learned_addr learned my addr 172.21.15.2:0/3244647648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f32599bb640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3254108170 0x7f325419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a9bd640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3254108ac0 0x7f325419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 -- 172.21.15.2:0/3244647648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3254108170 msgr2=0x7f325419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3254108170 0x7f325419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 -- 172.21.15.2:0/3244647648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3254108ac0 msgr2=0x7f325419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3254108ac0 0x7f325419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541a0180 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.391+0000 7f325a1bc640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f325419a210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3250005940 tx=0x7f32500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325003f030 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3250003cb0 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541a0410 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250035070 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32541a6bd0 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.392+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32540638f0 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.394+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f3250042030 con 0x7f3254102880 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f324b7fe640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f32400b4c10 0x7f32400b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f32599bb640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f32400b4c10 0x7f32400b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f3250106360 con 0x7f3254102880 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f324b7fe640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] conn(0x7f32400bffa0 0x7f32400c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3250040e70 con 0x7f32400bffa0 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.395+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f32501067b0 con 0x7f3254102880 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.396+0000 7f325a9bd640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] conn(0x7f32400bffa0 0x7f32400c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.396+0000 7f32599bb640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f32400b4c10 0x7f32400b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3244005fd0 tx=0x7f3244005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.396+0000 7f325a9bd640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] conn(0x7f32400bffa0 0x7f32400c2490 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.397+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== osd.0 v2:172.21.15.2:6802/1178687126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3250040e70 con 0x7f32400bffa0 2024-08-31T04:24:14.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 --> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3254063d70 con 0x7f32400bffa0 2024-08-31T04:24:14.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f324b7fe640 1 -- 172.21.15.2:0/3244647648 <== osd.0 v2:172.21.15.2:6802/1178687126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3254063d70 con 0x7f32400bffa0 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] conn(0x7f32400bffa0 msgr2=0x7f32400c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] conn(0x7f32400bffa0 0x7f32400c2490 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f32400b4c10 msgr2=0x7f32400b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f32400b4c10 0x7f32400b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3244005fd0 tx=0x7f3244005850 comp rx=0 tx=0).stop 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 msgr2=0x7f325419a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 --2- 172.21.15.2:0/3244647648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3254102880 0x7f325419a210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3250005940 tx=0x7f32500042f0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325a9bd640 1 -- 172.21.15.2:0/3244647648 reap_dead start 2024-08-31T04:24:14.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 shutdown_connections 2024-08-31T04:24:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.411+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 >> 172.21.15.2:0/3244647648 conn(0x7f3254079530 msgr2=0x7f3254106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.412+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 shutdown_connections 2024-08-31T04:24:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:14.412+0000 7f325c420640 1 -- 172.21.15.2:0/3244647648 wait complete. 2024-08-31T04:24:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:14 smithi002 ceph-mon[18656]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:24:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- 172.21.15.2:0/3540277625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8109b90 msgr2=0x7f51c81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 --2- 172.21.15.2:0/3540277625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8109b90 0x7f51c81103c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009ca0 tx=0x7f51c002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- 172.21.15.2:0/3540277625 shutdown_connections 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 --2- 172.21.15.2:0/3540277625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8109b90 0x7f51c81103c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 --2- 172.21.15.2:0/3540277625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51c8109240 0x7f51c8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 --2- 172.21.15.2:0/3540277625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c8103900 0x7f51c8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- 172.21.15.2:0/3540277625 >> 172.21.15.2:0/3540277625 conn(0x7f51c807b5f0 msgr2=0x7f51c807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- 172.21.15.2:0/3540277625 shutdown_connections 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- 172.21.15.2:0/3540277625 wait complete. 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 Processor -- start 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.009+0000 7f51ce56d640 1 -- start start 2024-08-31T04:24:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 0x7f51c80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51c8109240 0x7f51c80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c8109b90 0x7f51c8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51c8113850 con 0x7f51c8103900 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51c81136d0 con 0x7f51c8109240 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ce56d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51c81139d0 con 0x7f51c8109b90 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 0x7f51c80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 0x7f51c80754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43610/0 (socket says 172.21.15.2:43610) 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 -- 172.21.15.2:0/448297458 learned_addr learned my addr 172.21.15.2:0/448297458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c77fe640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51c8109240 0x7f51c80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51ccb0a640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c8109b90 0x7f51c8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 -- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c8109b90 msgr2=0x7f51c8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c8109b90 0x7f51c8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 -- 172.21.15.2:0/448297458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51c8109240 msgr2=0x7f51c80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51c8109240 0x7f51c80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.010+0000 7f51c7fff640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c81a8500 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51c7fff640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 0x7f51c80754b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c890 tx=0x7f51b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004220 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c81a87f0 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51b80043c0 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004a00 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.011+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c81a8d30 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.012+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51c80638f0 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.013+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f51b80079b0 con 0x7f51c8103900 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c57fa640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51b00b4c10 0x7f51b00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c77fe640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51b00b4c10 0x7f51b00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f51b80e59f0 con 0x7f51c8103900 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c57fa640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] conn(0x7f51b00bffa0 0x7f51b00c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51b8012ec0 con 0x7f51b00bffa0 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.014+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f51b80e5e40 con 0x7f51c8103900 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.015+0000 7f51c77fe640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51b00b4c10 0x7f51b00b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51bc005d90 tx=0x7f51bc005d20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.015+0000 7f51ccb0a640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] conn(0x7f51b00bffa0 0x7f51b00c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.015+0000 7f51ccb0a640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] conn(0x7f51b00bffa0 0x7f51b00c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.016+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== osd.5 v2:172.21.15.132:6808/3694952222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51b8012ec0 con 0x7f51b00bffa0 2024-08-31T04:24:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.033+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 --> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51c8063cf0 con 0x7f51b00bffa0 2024-08-31T04:24:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51c57fa640 1 -- 172.21.15.2:0/448297458 <== osd.5 v2:172.21.15.132:6808/3694952222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f51c8063cf0 con 0x7f51b00bffa0 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] conn(0x7f51b00bffa0 msgr2=0x7f51b00c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] conn(0x7f51b00bffa0 0x7f51b00c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51b00b4c10 msgr2=0x7f51b00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51b00b4c10 0x7f51b00b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51bc005d90 tx=0x7f51bc005d20 comp rx=0 tx=0).stop 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 msgr2=0x7f51c80754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ce56d640 1 --2- 172.21.15.2:0/448297458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c8103900 0x7f51c80754b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c890 tx=0x7f51b800cd50 comp rx=0 tx=0).stop 2024-08-31T04:24:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.034+0000 7f51ccb0a640 1 -- 172.21.15.2:0/448297458 reap_dead start 2024-08-31T04:24:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.035+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 shutdown_connections 2024-08-31T04:24:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.035+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 >> 172.21.15.2:0/448297458 conn(0x7f51c807b5f0 msgr2=0x7f51c8105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.035+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 shutdown_connections 2024-08-31T04:24:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.035+0000 7f51ce56d640 1 -- 172.21.15.2:0/448297458 wait complete. 2024-08-31T04:24:15.119 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:14 smithi132 ceph-mon[22335]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:24:15.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:14 smithi064 ceph-mon[22007]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:24:15.513 INFO:teuthology.orchestra.run.smithi002.stdout:180388626485 2024-08-31T04:24:15.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T04:24:16.108 INFO:teuthology.orchestra.run.smithi002.stdout:296352743452 2024-08-31T04:24:16.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T04:24:16.508 INFO:teuthology.orchestra.run.smithi002.stdout:38654705747 2024-08-31T04:24:16.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 -- 172.21.15.2:0/2020955388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109ba0 msgr2=0x7f83f81103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 --2- 172.21.15.2:0/2020955388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109ba0 0x7f83f81103d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009ca0 tx=0x7f83f002a8b0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 -- 172.21.15.2:0/2020955388 shutdown_connections 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 --2- 172.21.15.2:0/2020955388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109ba0 0x7f83f81103d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 --2- 172.21.15.2:0/2020955388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8109250 0x7f83f8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 --2- 172.21.15.2:0/2020955388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f8103960 0x7f83f8103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 -- 172.21.15.2:0/2020955388 >> 172.21.15.2:0/2020955388 conn(0x7f83f807b6b0 msgr2=0x7f83f807bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 -- 172.21.15.2:0/2020955388 shutdown_connections 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.751+0000 7f83fe427640 1 -- 172.21.15.2:0/2020955388 wait complete. 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 Processor -- start 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 -- start start 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8103960 0x7f83f819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 0x7f83f819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f8109ba0 0x7f83f819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81138c0 con 0x7f83f8109250 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113740 con 0x7f83f8103960 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.752+0000 7f83fe427640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113a40 con 0x7f83f8109ba0 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 0x7f83f819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 0x7f83f819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40228/0 (socket says 172.21.15.2:40228) 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 -- 172.21.15.2:0/3297407823 learned_addr learned my addr 172.21.15.2:0/3297407823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83fc9c4640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f8109ba0 0x7f83f819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83f7fff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8103960 0x7f83f819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 -- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f8109ba0 msgr2=0x7f83f819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f8109ba0 0x7f83f819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 -- 172.21.15.2:0/3297407823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8103960 msgr2=0x7f83f819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8103960 0x7f83f819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81a0200 con 0x7f83f8109250 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83f7fff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f8103960 0x7f83f819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83effff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 0x7f83f819a830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f83e000e9f0 tx=0x7f83e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e000ccc0 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f81a04f0 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e00108e0 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0018860 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.753+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f81a6c50 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.754+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83f80638f0 con 0x7f83f8109250 2024-08-31T04:24:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.756+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f83e0010430 con 0x7f83f8109250 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.756+0000 7f83f5ffb640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f83e40b4c10 0x7f83e40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f7fff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f83e40b4c10 0x7f83e40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f83e00e6280 con 0x7f83f8109250 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f5ffb640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] conn(0x7f83e40bffa0 0x7f83e40c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83e40c2b60 con 0x7f83e40bffa0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f83e00e6630 con 0x7f83f8109250 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83f7fff640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f83e40b4c10 0x7f83e40b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009930 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.757+0000 7f83fc9c4640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] conn(0x7f83e40bffa0 0x7f83e40c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.758+0000 7f83fc9c4640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] conn(0x7f83e40bffa0 0x7f83e40c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.758+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== osd.8 v2:172.21.15.132:6816/3969222999 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83e40c2b60 con 0x7f83e40bffa0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.773+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 --> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83f8063cf0 con 0x7f83e40bffa0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.773+0000 7f83f5ffb640 1 -- 172.21.15.2:0/3297407823 <== osd.8 v2:172.21.15.132:6816/3969222999 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f83f8063cf0 con 0x7f83e40bffa0 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] conn(0x7f83e40bffa0 msgr2=0x7f83e40c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] conn(0x7f83e40bffa0 0x7f83e40c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f83e40b4c10 msgr2=0x7f83e40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f83e40b4c10 0x7f83e40b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009930 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 msgr2=0x7f83f819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 --2- 172.21.15.2:0/3297407823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83f8109250 0x7f83f819a830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f83e000e9f0 tx=0x7f83e000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fc9c4640 1 -- 172.21.15.2:0/3297407823 reap_dead start 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 shutdown_connections 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 >> 172.21.15.2:0/3297407823 conn(0x7f83f807b6b0 msgr2=0x7f83f81072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 shutdown_connections 2024-08-31T04:24:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:15.774+0000 7f83fe427640 1 -- 172.21.15.2:0/3297407823 wait complete. 2024-08-31T04:24:17.119 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:16 smithi064 ceph-mon[22007]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:24:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:16 smithi002 ceph-mon[18656]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:24:17.310 INFO:teuthology.orchestra.run.smithi002.stdout:223338299435 2024-08-31T04:24:17.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T04:24:17.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:16 smithi132 ceph-mon[22335]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:24:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:17.775 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:17.785 INFO:teuthology.orchestra.run.smithi002.stdout:107374182468 2024-08-31T04:24:17.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T04:24:18.228 INFO:teuthology.orchestra.run.smithi002.stdout:197568495665 2024-08-31T04:24:18.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T04:24:18.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 -- 172.21.15.2:0/3497222634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790109ba0 msgr2=0x7f97901103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 --2- 172.21.15.2:0/3497222634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790109ba0 0x7f97901103d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9788009ca0 tx=0x7f978802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 -- 172.21.15.2:0/3497222634 shutdown_connections 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 --2- 172.21.15.2:0/3497222634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790109ba0 0x7f97901103d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 --2- 172.21.15.2:0/3497222634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9790109250 0x7f9790109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 --2- 172.21.15.2:0/3497222634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790103910 0x7f9790103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 -- 172.21.15.2:0/3497222634 >> 172.21.15.2:0/3497222634 conn(0x7f97900ff380 msgr2=0x7f97901017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 -- 172.21.15.2:0/3497222634 shutdown_connections 2024-08-31T04:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.899+0000 7f97970a8640 1 -- 172.21.15.2:0/3497222634 wait complete. 2024-08-31T04:24:18.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 Processor -- start 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 -- start start 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 0x7f979019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790109250 0x7f979019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9790109ba0 0x7f979019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9790113860 con 0x7f9790103910 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97901136e0 con 0x7f9790109ba0 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f97970a8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f97901139e0 con 0x7f9790109250 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.900+0000 7f9794e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 0x7f979019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 0x7f979019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40244/0 (socket says 172.21.15.2:40244) 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 -- 172.21.15.2:0/1803186660 learned_addr learned my addr 172.21.15.2:0/1803186660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9787fff640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790109250 0x7f979019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9795645640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9790109ba0 0x7f979019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 -- 172.21.15.2:0/1803186660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790109250 msgr2=0x7f979019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790109250 0x7f979019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 -- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9790109ba0 msgr2=0x7f979019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9790109ba0 0x7f979019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901a0140 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9787fff640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9790109250 0x7f979019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9794e44640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 0x7f979019a1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f978c00d770 tx=0x7f978c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c017070 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97901a0430 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f978c0054d0 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.901+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c004c30 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.902+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a6b90 con 0x7f9790103910 2024-08-31T04:24:18.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.902+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97900638f0 con 0x7f9790103910 2024-08-31T04:24:18.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.904+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f978c004dd0 con 0x7f9790103910 2024-08-31T04:24:18.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9785ffb640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f97780b4c10 0x7f97780b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:18.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9787fff640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f97780b4c10 0x7f97780b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:18.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f978c0e56d0 con 0x7f9790103910 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9785ffb640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] conn(0x7f97780bffa0 0x7f97780c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97780c2b60 con 0x7f97780bffa0 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f978c0e5b20 con 0x7f9790103910 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9787fff640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f97780b4c10 0x7f97780b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9790102a80 tx=0x7f978000b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.905+0000 7f9795645640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] conn(0x7f97780bffa0 0x7f97780c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:18.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.906+0000 7f9795645640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] conn(0x7f97780bffa0 0x7f97780c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:18.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.907+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== osd.10 v2:172.21.15.64:6824/431915757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97780c2b60 con 0x7f97780bffa0 2024-08-31T04:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.920+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 --> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9790063d70 con 0x7f97780bffa0 2024-08-31T04:24:18.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f9785ffb640 1 -- 172.21.15.2:0/1803186660 <== osd.10 v2:172.21.15.64:6824/431915757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9790063d70 con 0x7f97780bffa0 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] conn(0x7f97780bffa0 msgr2=0x7f97780c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] conn(0x7f97780bffa0 0x7f97780c2490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f97780b4c10 msgr2=0x7f97780b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f97780b4c10 0x7f97780b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9790102a80 tx=0x7f978000b5f0 comp rx=0 tx=0).stop 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 msgr2=0x7f979019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f97970a8640 1 --2- 172.21.15.2:0/1803186660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9790103910 0x7f979019a1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f978c00d770 tx=0x7f978c00dc30 comp rx=0 tx=0).stop 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.921+0000 7f9795645640 1 -- 172.21.15.2:0/1803186660 reap_dead start 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.922+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 shutdown_connections 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.922+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 >> 172.21.15.2:0/1803186660 conn(0x7f97900ff380 msgr2=0x7f9790106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.922+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 shutdown_connections 2024-08-31T04:24:18.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:18.922+0000 7f97970a8640 1 -- 172.21.15.2:0/1803186660 wait complete. 2024-08-31T04:24:19.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:18 smithi002 ceph-mon[18656]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 -- 172.21.15.2:0/4065724497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109bd0 msgr2=0x7f50d8110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 --2- 172.21.15.2:0/4065724497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109bd0 0x7f50d8110400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009ca0 tx=0x7f50d002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 -- 172.21.15.2:0/4065724497 shutdown_connections 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 --2- 172.21.15.2:0/4065724497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109bd0 0x7f50d8110400 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 --2- 172.21.15.2:0/4065724497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8109280 0x7f50d8109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 --2- 172.21.15.2:0/4065724497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d8103940 0x7f50d8103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 -- 172.21.15.2:0/4065724497 >> 172.21.15.2:0/4065724497 conn(0x7f50d80ff3d0 msgr2=0x7f50d8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 -- 172.21.15.2:0/4065724497 shutdown_connections 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.147+0000 7f50ddc69640 1 -- 172.21.15.2:0/4065724497 wait complete. 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 Processor -- start 2024-08-31T04:24:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 -- start start 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8103940 0x7f50d819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 0x7f50d819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d8109bd0 0x7f50d819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8113890 con 0x7f50d8109280 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8113710 con 0x7f50d8103940 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50ddc69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8113a10 con 0x7f50d8109bd0 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 0x7f50d819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.148+0000 7f50d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 0x7f50d819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40266/0 (socket says 172.21.15.2:40266) 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 -- 172.21.15.2:0/1904667601 learned_addr learned my addr 172.21.15.2:0/1904667601 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d7fff640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d8109bd0 0x7f50d819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d77fe640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8103940 0x7f50d819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 -- 172.21.15.2:0/1904667601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d8109bd0 msgr2=0x7f50d819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d8109bd0 0x7f50d819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 -- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8103940 msgr2=0x7f50d819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8103940 0x7f50d819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d81a02b0 con 0x7f50d8109280 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d77fe640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d8103940 0x7f50d819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d6ffd640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 0x7f50d819a8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00e9f0 tx=0x7f50cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00ccc0 con 0x7f50d8109280 2024-08-31T04:24:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d81a05a0 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50cc0108e0 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc018860 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.149+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d81a6d00 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.150+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50d8063870 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.152+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f50cc010430 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d4ff9640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c00b4c10 0x7f50c00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d77fe640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c00b4c10 0x7f50c00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f50cc0e6190 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d4ff9640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] conn(0x7f50c00bffa0 0x7f50c00c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50c00c2b60 con 0x7f50c00bffa0 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f50cc0e65e0 con 0x7f50d8109280 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d77fe640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c00b4c10 0x7f50c00b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009c20 tx=0x7f50c8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.153+0000 7f50d7fff640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] conn(0x7f50c00bffa0 0x7f50c00c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.154+0000 7f50d7fff640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] conn(0x7f50c00bffa0 0x7f50c00c2490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.155+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== osd.4 v2:172.21.15.64:6808/4269153190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50c00c2b60 con 0x7f50c00bffa0 2024-08-31T04:24:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.168+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 --> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50d8063c70 con 0x7f50c00bffa0 2024-08-31T04:24:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50d4ff9640 1 -- 172.21.15.2:0/1904667601 <== osd.4 v2:172.21.15.64:6808/4269153190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f50d8063c70 con 0x7f50c00bffa0 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] conn(0x7f50c00bffa0 msgr2=0x7f50c00c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] conn(0x7f50c00bffa0 0x7f50c00c2490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c00b4c10 msgr2=0x7f50c00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c00b4c10 0x7f50c00b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009c20 tx=0x7f50c8005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 msgr2=0x7f50d819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50ddc69640 1 --2- 172.21.15.2:0/1904667601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d8109280 0x7f50d819a8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00e9f0 tx=0x7f50cc00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:24:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.169+0000 7f50d7fff640 1 -- 172.21.15.2:0/1904667601 reap_dead start 2024-08-31T04:24:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.170+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 shutdown_connections 2024-08-31T04:24:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.170+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 >> 172.21.15.2:0/1904667601 conn(0x7f50d80ff3d0 msgr2=0x7f50d81088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.170+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 shutdown_connections 2024-08-31T04:24:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:19.170+0000 7f50ddc69640 1 -- 172.21.15.2:0/1904667601 wait complete. 2024-08-31T04:24:19.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:18 smithi064 ceph-mon[22007]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:24:19.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:18 smithi132 ceph-mon[22335]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:24:19.780 INFO:teuthology.orchestra.run.smithi002.stdout:154618822715 2024-08-31T04:24:19.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T04:24:20.446 INFO:teuthology.orchestra.run.smithi002.stdout:270582939683 2024-08-31T04:24:20.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T04:24:21.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:20 smithi002 ceph-mon[18656]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:21.040 INFO:teuthology.orchestra.run.smithi002.stdout:133143986241 2024-08-31T04:24:21.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T04:24:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:20 smithi064 ceph-mon[22007]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:21.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:20 smithi132 ceph-mon[22335]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:21.360 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 -- 172.21.15.2:0/3381490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc774108b10 msgr2=0x7fc77410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 --2- 172.21.15.2:0/3381490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc774108b10 0x7fc77410f340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009ca0 tx=0x7fc76c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 -- 172.21.15.2:0/3381490883 shutdown_connections 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 --2- 172.21.15.2:0/3381490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc774108b10 0x7fc77410f340 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 --2- 172.21.15.2:0/3381490883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7741081c0 0x7fc7741085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 --2- 172.21.15.2:0/3381490883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc774102880 0x7fc774102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 -- 172.21.15.2:0/3381490883 >> 172.21.15.2:0/3381490883 conn(0x7fc774079510 msgr2=0x7fc774079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 -- 172.21.15.2:0/3381490883 shutdown_connections 2024-08-31T04:24:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.597+0000 7fc778d98640 1 -- 172.21.15.2:0/3381490883 wait complete. 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 Processor -- start 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 -- start start 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc774102880 0x7fc77419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 0x7fc77419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc774108b10 0x7fc77419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741127e0 con 0x7fc7741081c0 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc774112660 con 0x7fc774102880 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc778d98640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc774112960 con 0x7fc774108b10 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 0x7fc77419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:21.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 0x7fc77419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40278/0 (socket says 172.21.15.2:40278) 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 -- 172.21.15.2:0/3420359879 learned_addr learned my addr 172.21.15.2:0/3420359879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc77259c640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc774102880 0x7fc77419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc772d9d640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc774108b10 0x7fc77419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 -- 172.21.15.2:0/3420359879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc774108b10 msgr2=0x7fc77419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc774108b10 0x7fc77419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 -- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc774102880 msgr2=0x7fc77419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc774102880 0x7fc77419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc771d9b640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7741a01d0 con 0x7fc7741081c0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.598+0000 7fc772d9d640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc774108b10 0x7fc77419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc771d9b640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 0x7fc77419a800 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d750 tx=0x7fc76800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768017070 con 0x7fc7741081c0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7680054d0 con 0x7fc7741081c0 2024-08-31T04:24:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7741a04c0 con 0x7fc7741081c0 2024-08-31T04:24:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768004c30 con 0x7fc7741081c0 2024-08-31T04:24:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.599+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a6c20 con 0x7fc7741081c0 2024-08-31T04:24:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.600+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc774063870 con 0x7fc7741081c0 2024-08-31T04:24:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.602+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fc768004dd0 con 0x7fc7741081c0 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.602+0000 7fc7637fe640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc75c0b4c10 0x7fc75c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.602+0000 7fc77259c640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc75c0b4c10 0x7fc75c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.602+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fc7680e5580 con 0x7fc7741081c0 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.603+0000 7fc7637fe640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] conn(0x7fc75c0bffa0 0x7fc75c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.603+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc768001d30 con 0x7fc75c0bffa0 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.603+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc7680e59d0 con 0x7fc7741081c0 2024-08-31T04:24:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.603+0000 7fc77259c640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc75c0b4c10 0x7fc75c0b7120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc76400bbe0 tx=0x7fc76400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.603+0000 7fc772d9d640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] conn(0x7fc75c0bffa0 0x7fc75c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.604+0000 7fc772d9d640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] conn(0x7fc75c0bffa0 0x7fc75c0c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.604+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== osd.1 v2:172.21.15.64:6800/4211233345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc768001d30 con 0x7fc75c0bffa0 2024-08-31T04:24:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.619+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 --> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc774063c70 con 0x7fc75c0bffa0 2024-08-31T04:24:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.619+0000 7fc7637fe640 1 -- 172.21.15.2:0/3420359879 <== osd.1 v2:172.21.15.64:6800/4211233345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc774063c70 con 0x7fc75c0bffa0 2024-08-31T04:24:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] conn(0x7fc75c0bffa0 msgr2=0x7fc75c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] conn(0x7fc75c0bffa0 0x7fc75c0c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc75c0b4c10 msgr2=0x7fc75c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc75c0b4c10 0x7fc75c0b7120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc76400bbe0 tx=0x7fc76400b390 comp rx=0 tx=0).stop 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 msgr2=0x7fc77419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 --2- 172.21.15.2:0/3420359879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7741081c0 0x7fc77419a800 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d750 tx=0x7fc76800dc10 comp rx=0 tx=0).stop 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc772d9d640 1 -- 172.21.15.2:0/3420359879 reap_dead start 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 shutdown_connections 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 >> 172.21.15.2:0/3420359879 conn(0x7fc774079510 msgr2=0x7fc7741017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 shutdown_connections 2024-08-31T04:24:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:21.620+0000 7fc778d98640 1 -- 172.21.15.2:0/3420359879 wait complete. 2024-08-31T04:24:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:60129542223 2024-08-31T04:24:22.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T04:24:22.615 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:22.622 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 -- 172.21.15.2:0/4257962718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338101fe0 msgr2=0x7f73381023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 --2- 172.21.15.2:0/4257962718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338101fe0 0x7f73381023f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7328009900 tx=0x7f732802a410 comp rx=0 tx=0).stop 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 -- 172.21.15.2:0/4257962718 shutdown_connections 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 --2- 172.21.15.2:0/4257962718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338108270 0x7f733810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 --2- 172.21.15.2:0/4257962718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 0x7f7338107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 --2- 172.21.15.2:0/4257962718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338101fe0 0x7f73381023f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 -- 172.21.15.2:0/4257962718 >> 172.21.15.2:0/4257962718 conn(0x7f7338079d30 msgr2=0x7f733807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 -- 172.21.15.2:0/4257962718 shutdown_connections 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.817+0000 7f733e447640 1 -- 172.21.15.2:0/4257962718 wait complete. 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.818+0000 7f733e447640 1 Processor -- start 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.818+0000 7f733e447640 1 -- start start 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338101fe0 0x7f733819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 0x7f733819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73381138b0 con 0x7f7338108270 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7338113730 con 0x7f7338101fe0 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733e447640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7338113a30 con 0x7f7338107920 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40288/0 (socket says 172.21.15.2:40288) 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 -- 172.21.15.2:0/872754800 learned_addr learned my addr 172.21.15.2:0/872754800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f73377fe640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 0x7f733819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f7337fff640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338101fe0 0x7f733819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 -- 172.21.15.2:0/872754800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 msgr2=0x7f733819a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 0x7f733819a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 -- 172.21.15.2:0/872754800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338101fe0 msgr2=0x7f733819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338101fe0 0x7f733819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 -- 172.21.15.2:0/872754800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73381a0190 con 0x7f7338108270 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.819+0000 7f733c9e4640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f733000cce0 tx=0x7f733000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.820+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733000f450 con 0x7f7338108270 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.820+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f733000faa0 con 0x7f7338108270 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.820+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73381a0480 con 0x7f7338108270 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.820+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330018b70 con 0x7f7338108270 2024-08-31T04:24:22.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.820+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73381a6ca0 con 0x7f7338108270 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.821+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73381023f0 con 0x7f7338108270 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.823+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7330018d10 con 0x7f7338108270 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.824+0000 7f73357fa640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 0x7f73200b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.824+0000 7f7337fff640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 0x7f73200b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.824+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f73300e5b40 con 0x7f7338108270 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.825+0000 7f7337fff640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 0x7f73200b71d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7328031440 tx=0x7f7328005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:22.827+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7330014030 con 0x7f7338108270 2024-08-31T04:24:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:22.862 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.044+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f733802e430 con 0x7f7338108270 2024-08-31T04:24:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.045+0000 7f73357fa640 1 -- 172.21.15.2:0/872754800 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f73300ac7f0 con 0x7f7338108270 2024-08-31T04:24:23.046 INFO:teuthology.orchestra.run.smithi002.stdout:296352743454 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 msgr2=0x7f73200b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 0x7f73200b71d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7328031440 tx=0x7f7328005e80 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 msgr2=0x7f733819fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f733000cce0 tx=0x7f733000a620 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 shutdown_connections 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f73200b4cc0 0x7f73200b71d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7338108270 0x7f733819fb20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7338107920 0x7f733819a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 --2- 172.21.15.2:0/872754800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7338101fe0 0x7f733819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 >> 172.21.15.2:0/872754800 conn(0x7f7338079d30 msgr2=0x7f7338105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 shutdown_connections 2024-08-31T04:24:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.047+0000 7f733e447640 1 -- 172.21.15.2:0/872754800 wait complete. 2024-08-31T04:24:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:22 smithi002 ceph-mon[18656]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:23.316 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:22 smithi064 ceph-mon[22007]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:23.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:22 smithi132 ceph-mon[22335]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:23.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 -- 172.21.15.2:0/3312658662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89341081c0 msgr2=0x7f89341085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 --2- 172.21.15.2:0/3312658662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89341081c0 0x7f89341085d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:23.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 -- 172.21.15.2:0/3312658662 shutdown_connections 2024-08-31T04:24:23.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 --2- 172.21.15.2:0/3312658662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89341081c0 0x7f89341085d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 --2- 172.21.15.2:0/3312658662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8934108b10 0x7f893410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 --2- 172.21.15.2:0/3312658662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f8934102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.528+0000 7f893a99f640 1 -- 172.21.15.2:0/3312658662 >> 172.21.15.2:0/3312658662 conn(0x7f8934079510 msgr2=0x7f8934079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:23.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.529+0000 7f893a99f640 1 -- 172.21.15.2:0/3312658662 shutdown_connections 2024-08-31T04:24:23.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.529+0000 7f893a99f640 1 -- 172.21.15.2:0/3312658662 wait complete. 2024-08-31T04:24:23.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.529+0000 7f893a99f640 1 Processor -- start 2024-08-31T04:24:23.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.529+0000 7f893a99f640 1 -- start start 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f89341991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89341081c0 0x7f8934199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89341127a0 con 0x7f8934108b10 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8934112620 con 0x7f8934102880 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f893a99f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8934112920 con 0x7f89341081c0 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40298/0 (socket says 172.21.15.2:40298) 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 -- 172.21.15.2:0/619759152 learned_addr learned my addr 172.21.15.2:0/619759152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8933fff640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f89341991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f892bfff640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89341081c0 0x7f8934199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:23.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 -- 172.21.15.2:0/619759152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89341081c0 msgr2=0x7f8934199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89341081c0 0x7f8934199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 -- 172.21.15.2:0/619759152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 msgr2=0x7f89341991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f89341991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 -- 172.21.15.2:0/619759152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893419f140 con 0x7f8934108b10 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8933fff640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f89341991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.530+0000 7f8938f3c640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f892c00eb10 tx=0x7f892c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.531+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c004b20 con 0x7f8934108b10 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.531+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893419f430 con 0x7f8934108b10 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.531+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892c004cc0 con 0x7f8934108b10 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.531+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c010670 con 0x7f8934108b10 2024-08-31T04:24:23.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.531+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341a5b90 con 0x7f8934108b10 2024-08-31T04:24:23.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.532+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8934103b00 con 0x7f8934108b10 2024-08-31T04:24:23.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.533+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f892c005000 con 0x7f8934108b10 2024-08-31T04:24:23.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.534+0000 7f8931ffb640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 0x7f89200b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:23.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.534+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f892c0e5fd0 con 0x7f8934108b10 2024-08-31T04:24:23.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.534+0000 7f8933fff640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 0x7f89200b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:23.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.534+0000 7f8933fff640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 0x7f89200b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8924005d00 tx=0x7f8924005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:23.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.537+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f892c056130 con 0x7f8934108b10 2024-08-31T04:24:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.732+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f893419a300 con 0x7f8934108b10 2024-08-31T04:24:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.732+0000 7f8931ffb640 1 -- 172.21.15.2:0/619759152 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f892c0acb70 con 0x7f8934108b10 2024-08-31T04:24:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:223338299436 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 msgr2=0x7f89200b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 0x7f89200b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8924005d00 tx=0x7f8924005ed0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 msgr2=0x7f893419ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f892c00eb10 tx=0x7f892c00c2d0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 shutdown_connections 2024-08-31T04:24:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f89200b4c10 0x7f89200b7120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8934108b10 0x7f893419ea10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89341081c0 0x7f8934199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 --2- 172.21.15.2:0/619759152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8934102880 0x7f89341991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 >> 172.21.15.2:0/619759152 conn(0x7f8934079510 msgr2=0x7f8934106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 shutdown_connections 2024-08-31T04:24:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:23.734+0000 7f893a99f640 1 -- 172.21.15.2:0/619759152 wait complete. 2024-08-31T04:24:24.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/872754800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:24:24.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:23 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/619759152' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:24:24.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.218+0000 7f317c245640 1 -- 172.21.15.2:0/2238252877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 msgr2=0x7f3174102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:24.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.218+0000 7f317c245640 1 --2- 172.21.15.2:0/2238252877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f3174102c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:24.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 -- 172.21.15.2:0/2238252877 shutdown_connections 2024-08-31T04:24:24.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 --2- 172.21.15.2:0/2238252877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 0x7f317410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 --2- 172.21.15.2:0/2238252877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f3174108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 --2- 172.21.15.2:0/2238252877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f3174102c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 -- 172.21.15.2:0/2238252877 >> 172.21.15.2:0/2238252877 conn(0x7f31740794b0 msgr2=0x7f31740798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 -- 172.21.15.2:0/2238252877 shutdown_connections 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 -- 172.21.15.2:0/2238252877 wait complete. 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 Processor -- start 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.219+0000 7f317c245640 1 -- start start 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f317419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 0x7f317419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113890 con 0x7f3174102810 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113710 con 0x7f3174108150 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317c245640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113a10 con 0x7f3174108aa0 2024-08-31T04:24:24.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40320/0 (socket says 172.21.15.2:40320) 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 -- 172.21.15.2:0/2030371162 learned_addr learned my addr 172.21.15.2:0/2030371162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f317a7e2640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 0x7f317419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f31797e0640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f317419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 -- 172.21.15.2:0/2030371162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 msgr2=0x7f317419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 0x7f317419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 -- 172.21.15.2:0/2030371162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 msgr2=0x7f317419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f317419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 -- 172.21.15.2:0/2030371162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a01f0 con 0x7f3174102810 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f31797e0640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f317419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.220+0000 7f3179fe1640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3170005940 tx=0x7f31700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.221+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317003f030 con 0x7f3174102810 2024-08-31T04:24:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.221+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3170003cb0 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.221+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a0480 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.221+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170035070 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.221+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a6c40 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.222+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3174103a90 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.223+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f3170042030 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.224+0000 7f316affd640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 0x7f31600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.224+0000 7f31797e0640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 0x7f31600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.224+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f3170106250 con 0x7f3174102810 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.224+0000 7f31797e0640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 0x7f31600b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3174079f10 tx=0x7f3164005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.227+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f31700ccdf0 con 0x7f3174102810 2024-08-31T04:24:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/872754800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:24:24.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:23 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/619759152' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:24:24.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/872754800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:24:24.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:23 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/619759152' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:24:24.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.419+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f317410a290 con 0x7f3174102810 2024-08-31T04:24:24.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.419+0000 7f316affd640 1 -- 172.21.15.2:0/2030371162 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31700cc6f0 con 0x7f3174102810 2024-08-31T04:24:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:81604378700 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.421+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 msgr2=0x7f31600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.421+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 0x7f31600b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3174079f10 tx=0x7f3164005e50 comp rx=0 tx=0).stop 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.421+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 msgr2=0x7f317419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.421+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3170005940 tx=0x7f31700042f0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 shutdown_connections 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174108aa0 0x7f317419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3174108150 0x7f317419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f31600b4c10 0x7f31600b7120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 --2- 172.21.15.2:0/2030371162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3174102810 0x7f317419a280 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 >> 172.21.15.2:0/2030371162 conn(0x7f31740794b0 msgr2=0x7f3174106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 shutdown_connections 2024-08-31T04:24:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:24.422+0000 7f317c245640 1 -- 172.21.15.2:0/2030371162 wait complete. 2024-08-31T04:24:24.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743452 got 296352743454 for osd.11 2024-08-31T04:24:24.735 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:24.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:24 smithi002 ceph-mon[18656]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:24.963 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:24 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2030371162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:24:25.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:24 smithi064 ceph-mon[22007]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:25.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:24 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2030371162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:24:25.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:24 smithi132 ceph-mon[22335]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:24:25.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:24 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2030371162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 -- 172.21.15.2:0/3305866653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102880 msgr2=0x7f3c74102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/3305866653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102880 0x7f3c74102c90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009900 tx=0x7f3c6402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 -- 172.21.15.2:0/3305866653 shutdown_connections 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/3305866653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74108ac0 0x7f3c7410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/3305866653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c74108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/3305866653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102880 0x7f3c74102c90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 -- 172.21.15.2:0/3305866653 >> 172.21.15.2:0/3305866653 conn(0x7f3c74079500 msgr2=0x7f3c74079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:25.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 -- 172.21.15.2:0/3305866653 shutdown_connections 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.369+0000 7f3c78aa5640 1 -- 172.21.15.2:0/3305866653 wait complete. 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 Processor -- start 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 -- start start 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 0x7f3c7419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c7419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741127b0 con 0x7f3c74108ac0 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74112630 con 0x7f3c74108170 2024-08-31T04:24:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c78aa5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74112930 con 0x7f3c74102880 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c72d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c72d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60586/0 (socket says 172.21.15.2:60586) 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c72d9d640 1 -- 172.21.15.2:0/4214802733 learned_addr learned my addr 172.21.15.2:0/4214802733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.370+0000 7f3c71d9b640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c7419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c7259c640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 0x7f3c7419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 -- 172.21.15.2:0/4214802733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 msgr2=0x7f3c7419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 0x7f3c7419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 -- 172.21.15.2:0/4214802733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 msgr2=0x7f3c7419b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c7419b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 -- 172.21.15.2:0/4214802733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c741a6410 con 0x7f3c74108ac0 2024-08-31T04:24:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c7259c640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 0x7f3c7419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c71d9b640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c7419b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c72d9d640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00cad0 tx=0x7f3c6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00ae20 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c741a6700 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c6c005020 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00f6b0 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.371+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741a6c40 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.372+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c74103ab0 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.374+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f3c6c0051d0 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.374+0000 7f3c637fe640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 0x7f3c5c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.374+0000 7f3c7259c640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 0x7f3c5c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.374+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f3c6c0e5c00 con 0x7f3c74108ac0 2024-08-31T04:24:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.375+0000 7f3c7259c640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 0x7f3c5c0b7150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000c00 tx=0x7f3c64031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.378+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c6c014030 con 0x7f3c74108ac0 2024-08-31T04:24:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.565+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3c74102c90 con 0x7f3c74108ac0 2024-08-31T04:24:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.566+0000 7f3c637fe640 1 -- 172.21.15.2:0/4214802733 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c74102c90 con 0x7f3c74108ac0 2024-08-31T04:24:25.567 INFO:teuthology.orchestra.run.smithi002.stdout:133143986242 2024-08-31T04:24:25.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 msgr2=0x7f3c5c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:25.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 0x7f3c5c0b7150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000c00 tx=0x7f3c64031400 comp rx=0 tx=0).stop 2024-08-31T04:24:25.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 msgr2=0x7f3c7419bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00cad0 tx=0x7f3c6c00cf90 comp rx=0 tx=0).stop 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 shutdown_connections 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f3c5c0b4c40 0x7f3c5c0b7150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74108ac0 0x7f3c7419bc00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c74108170 0x7f3c7419b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 --2- 172.21.15.2:0/4214802733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c74102880 0x7f3c7419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 >> 172.21.15.2:0/4214802733 conn(0x7f3c74079500 msgr2=0x7f3c741012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 shutdown_connections 2024-08-31T04:24:25.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:25.568+0000 7f3c78aa5640 1 -- 172.21.15.2:0/4214802733 wait complete. 2024-08-31T04:24:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 -- 172.21.15.2:0/1448453658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109b90 msgr2=0x7f7c2c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 --2- 172.21.15.2:0/1448453658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109b90 0x7f7c2c1103c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009ca0 tx=0x7f7c2402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 -- 172.21.15.2:0/1448453658 shutdown_connections 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 --2- 172.21.15.2:0/1448453658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109b90 0x7f7c2c1103c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 --2- 172.21.15.2:0/1448453658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109240 0x7f7c2c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 --2- 172.21.15.2:0/1448453658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 0x7f7c2c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.009+0000 7f7c32353640 1 -- 172.21.15.2:0/1448453658 >> 172.21.15.2:0/1448453658 conn(0x7f7c2c07b5f0 msgr2=0x7f7c2c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.010+0000 7f7c32353640 1 -- 172.21.15.2:0/1448453658 shutdown_connections 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.010+0000 7f7c32353640 1 -- 172.21.15.2:0/1448453658 wait complete. 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.010+0000 7f7c32353640 1 Processor -- start 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.010+0000 7f7c32353640 1 -- start start 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 0x7f7c2c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 0x7f7c2c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c113850 con 0x7f7c2c109240 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c1136d0 con 0x7f7c2c103900 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c32353640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c1139d0 con 0x7f7c2c109b90 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60610/0 (socket says 172.21.15.2:60610) 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 -- 172.21.15.2:0/819503916 learned_addr learned my addr 172.21.15.2:0/819503916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c308f0640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 0x7f7c2c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2bfff640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 0x7f7c2c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 -- 172.21.15.2:0/819503916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 msgr2=0x7f7c2c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 0x7f7c2c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 -- 172.21.15.2:0/819503916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 msgr2=0x7f7c2c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 0x7f7c2c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 -- 172.21.15.2:0/819503916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c1a01b0 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c308f0640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 0x7f7c2c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.011+0000 7f7c2b7fe640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000e9c0 tx=0x7f7c2000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.012+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000ccc0 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.012+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c1a04a0 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.012+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c200054d0 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.012+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20010430 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.012+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c1a6c00 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.013+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c103d10 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.014+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7c20005000 con 0x7f7c2c109240 2024-08-31T04:24:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.015+0000 7f7c297fa640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 0x7f7c140b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.015+0000 7f7c2bfff640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 0x7f7c140b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.016+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f7c200e5d90 con 0x7f7c2c109240 2024-08-31T04:24:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.016+0000 7f7c2bfff640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 0x7f7c140b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c005fd0 tx=0x7f7c1c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.019+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c20056130 con 0x7f7c2c109240 2024-08-31T04:24:26.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:25 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4214802733' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:24:26.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.208+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7c2c19b370 con 0x7f7c2c109240 2024-08-31T04:24:26.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.208+0000 7f7c297fa640 1 -- 172.21.15.2:0/819503916 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7c200052f0 con 0x7f7c2c109240 2024-08-31T04:24:26.210 INFO:teuthology.orchestra.run.smithi002.stdout:197568495667 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 msgr2=0x7f7c140b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 0x7f7c140b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c005fd0 tx=0x7f7c1c005850 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 msgr2=0x7f7c2c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000e9c0 tx=0x7f7c2000ee80 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 shutdown_connections 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7c140b4c10 0x7f7c140b7120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c2c109240 0x7f7c2c19a7e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c109b90 0x7f7c2c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 --2- 172.21.15.2:0/819503916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c2c103900 0x7f7c2c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.210+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 >> 172.21.15.2:0/819503916 conn(0x7f7c2c07b5f0 msgr2=0x7f7c2c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:26.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.211+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 shutdown_connections 2024-08-31T04:24:26.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:26.211+0000 7f7c32353640 1 -- 172.21.15.2:0/819503916 wait complete. 2024-08-31T04:24:26.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:25 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4214802733' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:24:26.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:25 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4214802733' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:24:26.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299435 got 223338299436 for osd.8 2024-08-31T04:24:26.437 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:26.880 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378697 got 81604378700 for osd.2 2024-08-31T04:24:26.880 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:26 smithi002 ceph-mon[18656]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:26 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/819503916' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:24:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:26 smithi064 ceph-mon[22007]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:26 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/819503916' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:24:27.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:26 smithi132 ceph-mon[22335]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:24:27.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:26 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/819503916' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:24:27.547 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495665 got 197568495667 for osd.7 2024-08-31T04:24:27.547 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3922480301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 msgr2=0x7f8cb8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3922480301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb8108580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009900 tx=0x7f8cac02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3922480301 shutdown_connections 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3922480301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb8108580 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3922480301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8108ac0 0x7f8cb810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3922480301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8102880 0x7f8cb8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3922480301 >> 172.21.15.2:0/3922480301 conn(0x7f8cb8079500 msgr2=0x7f8cb8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3922480301 shutdown_connections 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.740+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3922480301 wait complete. 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 Processor -- start 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 -- start start 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8102880 0x7f8cb8199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8108ac0 0x7f8cb819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb81126f0 con 0x7f8cb8108170 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8112570 con 0x7f8cb8102880 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbfd3d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8112870 con 0x7f8cb8108ac0 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.741+0000 7f8cbd2d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60620/0 (socket says 172.21.15.2:60620) 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 -- 172.21.15.2:0/3475390095 learned_addr learned my addr 172.21.15.2:0/3475390095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbdad9640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8102880 0x7f8cb8199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbe2da640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8108ac0 0x7f8cb819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 -- 172.21.15.2:0/3475390095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8108ac0 msgr2=0x7f8cb819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8108ac0 0x7f8cb819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 -- 172.21.15.2:0/3475390095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8102880 msgr2=0x7f8cb8199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8102880 0x7f8cb8199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 -- 172.21.15.2:0/3475390095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb819efb0 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbd2d8640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8cac032fd0 tx=0x7f8cac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac03f030 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cac004490 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb819f240 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac035070 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.742+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb819f720 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.743+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb8103ab0 con 0x7f8cb8108170 2024-08-31T04:24:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.745+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f8cac042030 con 0x7f8cb8108170 2024-08-31T04:24:27.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.745+0000 7f8cb6ffd640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 0x7f8ca00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:27.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.746+0000 7f8cbdad9640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 0x7f8ca00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:27.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.746+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f8cac106080 con 0x7f8cb8108170 2024-08-31T04:24:27.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.746+0000 7f8cbdad9640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 0x7f8ca00b7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007ec0 tx=0x7f8ca80075b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:27.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.749+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8cac0ccc20 con 0x7f8cb8108170 2024-08-31T04:24:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.955+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8cb8102c90 con 0x7f8cb8108170 2024-08-31T04:24:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.955+0000 7f8cb6ffd640 1 -- 172.21.15.2:0/3475390095 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8cac0cc520 con 0x7f8cb8108170 2024-08-31T04:24:27.957 INFO:teuthology.orchestra.run.smithi002.stdout:38654705749 2024-08-31T04:24:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.957+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 msgr2=0x7f8ca00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.957+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 0x7f8ca00b7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007ec0 tx=0x7f8ca80075b0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.957+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 msgr2=0x7f8cb81996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.957+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8cac032fd0 tx=0x7f8cac004270 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 shutdown_connections 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ca00b4c40 0x7f8ca00b7150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8108170 0x7f8cb81996a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb8108ac0 0x7f8cb819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 --2- 172.21.15.2:0/3475390095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb8102880 0x7f8cb8199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 >> 172.21.15.2:0/3475390095 conn(0x7f8cb8079500 msgr2=0x7f8cb8105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 shutdown_connections 2024-08-31T04:24:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:27.958+0000 7f8cbfd3d640 1 -- 172.21.15.2:0/3475390095 wait complete. 2024-08-31T04:24:28.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986241 got 133143986242 for osd.4 2024-08-31T04:24:28.634 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 -- 172.21.15.2:0/2465981591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30103940 msgr2=0x7f6f30103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 --2- 172.21.15.2:0/2465981591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30103940 0x7f6f30103d50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009900 tx=0x7f6f2002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 -- 172.21.15.2:0/2465981591 shutdown_connections 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 --2- 172.21.15.2:0/2465981591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109bd0 0x7f6f30110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 --2- 172.21.15.2:0/2465981591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30109280 0x7f6f30109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 --2- 172.21.15.2:0/2465981591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30103940 0x7f6f30103d50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 -- 172.21.15.2:0/2465981591 >> 172.21.15.2:0/2465981591 conn(0x7f6f300ff3d0 msgr2=0x7f6f30101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:28.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 -- 172.21.15.2:0/2465981591 shutdown_connections 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.806+0000 7f6f36a37640 1 -- 172.21.15.2:0/2465981591 wait complete. 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 Processor -- start 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 -- start start 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30103940 0x7f6f3019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109280 0x7f6f3019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113950 con 0x7f6f30109bd0 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f301137d0 con 0x7f6f30103940 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f36a37640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113ad0 con 0x7f6f30109280 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.807+0000 7f6f34fd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60640/0 (socket says 172.21.15.2:60640) 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 -- 172.21.15.2:0/34576947 learned_addr learned my addr 172.21.15.2:0/34576947 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f2f7fe640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109280 0x7f6f3019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f2ffff640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30103940 0x7f6f3019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 -- 172.21.15.2:0/34576947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109280 msgr2=0x7f6f3019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109280 0x7f6f3019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 -- 172.21.15.2:0/34576947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30103940 msgr2=0x7f6f3019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30103940 0x7f6f3019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 -- 172.21.15.2:0/34576947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f301a02f0 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f34fd4640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800b970 tx=0x7f6f2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28019070 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f28014440 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301a05e0 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f280075d0 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.808+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301a6d40 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.809+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30103dd0 con 0x7f6f30109bd0 2024-08-31T04:24:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.812+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f6f2801c070 con 0x7f6f30109bd0 2024-08-31T04:24:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.812+0000 7f6f2d7fa640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 0x7f6f180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.813+0000 7f6f2ffff640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 0x7f6f180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.813+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f6f280e4fd0 con 0x7f6f30109bd0 2024-08-31T04:24:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.813+0000 7f6f2ffff640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 0x7f6f180b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f20031440 tx=0x7f6f20005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:28.816+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f280ab520 con 0x7f6f30109bd0 2024-08-31T04:24:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.002+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6f3019b4b0 con 0x7f6f30109bd0 2024-08-31T04:24:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.002+0000 7f6f2d7fa640 1 -- 172.21.15.2:0/34576947 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6f3019b4b0 con 0x7f6f30109bd0 2024-08-31T04:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout:154618822718 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 msgr2=0x7f6f180b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 0x7f6f180b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f20031440 tx=0x7f6f20005e80 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 msgr2=0x7f6f3019fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800b970 tx=0x7f6f2800bd70 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 shutdown_connections 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6f180b4c10 0x7f6f180b7120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f30109bd0 0x7f6f3019fbc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f30109280 0x7f6f3019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 --2- 172.21.15.2:0/34576947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f30103940 0x7f6f3019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 >> 172.21.15.2:0/34576947 conn(0x7f6f300ff3d0 msgr2=0x7f6f301017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 shutdown_connections 2024-08-31T04:24:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.004+0000 7f6f36a37640 1 -- 172.21.15.2:0/34576947 wait complete. 2024-08-31T04:24:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:28 smithi002 ceph-mon[18656]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T04:24:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:28 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3475390095' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:24:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:28 smithi064 ceph-mon[22007]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T04:24:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:28 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3475390095' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:24:29.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:28 smithi132 ceph-mon[22335]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T04:24:29.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:28 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3475390095' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout:107374182471 2024-08-31T04:24:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 -- 172.21.15.2:0/629379292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 msgr2=0x7fb81c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 --2- 172.21.15.2:0/629379292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c1103c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb814009ca0 tx=0x7fb81402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 -- 172.21.15.2:0/629379292 shutdown_connections 2024-08-31T04:24:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 --2- 172.21.15.2:0/629379292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c1103c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 --2- 172.21.15.2:0/629379292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 0x7fb81c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 --2- 172.21.15.2:0/629379292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 0x7fb81c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 -- 172.21.15.2:0/629379292 >> 172.21.15.2:0/629379292 conn(0x7fb81c07b5f0 msgr2=0x7fb81c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 -- 172.21.15.2:0/629379292 shutdown_connections 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.487+0000 7fb82285b640 1 -- 172.21.15.2:0/629379292 wait complete. 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 Processor -- start 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 -- start start 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 0x7fb81c19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 0x7fb81c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c113850 con 0x7fb81c109b90 2024-08-31T04:24:29.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1136d0 con 0x7fb81c109240 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.488+0000 7fb82285b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1139d0 con 0x7fb81c103900 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60660/0 (socket says 172.21.15.2:60660) 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 -- 172.21.15.2:0/2487835499 learned_addr learned my addr 172.21.15.2:0/2487835499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb81bfff640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 0x7fb81c19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb81b7fe640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 0x7fb81c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 -- 172.21.15.2:0/2487835499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 msgr2=0x7fb81c19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 0x7fb81c19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 -- 172.21.15.2:0/2487835499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 msgr2=0x7fb81c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 0x7fb81c19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 -- 172.21.15.2:0/2487835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1a0070 con 0x7fb81c109b90 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb820df8640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb8140098d0 tx=0x7fb8140317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:29.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814003b70 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb814003d10 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c1a0300 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.489+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81402fa20 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.490+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1a0840 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.491+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c103d10 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.493+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fb81402fbc0 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.494+0000 7fb8197fa640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 0x7fb8040b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.494+0000 7fb81bfff640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 0x7fb8040b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.494+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fb814106bd0 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.494+0000 7fb81bfff640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 0x7fb8040b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009bd0 tx=0x7fb80c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.497+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8140cd770 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.686+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb81c19b2f0 con 0x7fb81c109b90 2024-08-31T04:24:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.686+0000 7fb8197fa640 1 -- 172.21.15.2:0/2487835499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb81c19b2f0 con 0x7fb81c109b90 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 msgr2=0x7fb8040b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 0x7fb8040b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009bd0 tx=0x7fb80c005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 msgr2=0x7fb81c19fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb8140098d0 tx=0x7fb8140317b0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 shutdown_connections 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8040b4c40 0x7fb8040b7150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb81c109b90 0x7fb81c19fa00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb81c109240 0x7fb81c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 --2- 172.21.15.2:0/2487835499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb81c103900 0x7fb81c19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 >> 172.21.15.2:0/2487835499 conn(0x7fb81c07b5f0 msgr2=0x7fb81c105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 shutdown_connections 2024-08-31T04:24:29.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:29.689+0000 7fb82285b640 1 -- 172.21.15.2:0/2487835499 wait complete. 2024-08-31T04:24:30.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:29 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/34576947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:24:30.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:29 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2487835499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:24:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:29 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/34576947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:24:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:29 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2487835499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:24:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:29 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/34576947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:24:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:29 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2487835499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:24:30.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705747 got 38654705749 for osd.0 2024-08-31T04:24:30.361 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:30.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:30 smithi002 ceph-mon[18656]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:31.006 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182471 for osd.3 2024-08-31T04:24:31.006 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3766906557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac10dbe0 msgr2=0x7fbdac1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3766906557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac10dbe0 0x7fbdac1100d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009900 tx=0x7fbda402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3766906557 shutdown_connections 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3766906557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac10dbe0 0x7fbdac1100d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3766906557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac1050d0 0x7fbdac10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3766906557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 0x7fbdac104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3766906557 >> 172.21.15.2:0/3766906557 conn(0x7fbdac0794d0 msgr2=0x7fbdac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3766906557 shutdown_connections 2024-08-31T04:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.187+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3766906557 wait complete. 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 Processor -- start 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 -- start start 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 0x7fbdac19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac10dbe0 0x7fbdac19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac113860 con 0x7fbdac1050d0 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1136e0 con 0x7fbdac104780 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdb12d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1139e0 con 0x7fbdac10dbe0 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.188+0000 7fbdaa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60684/0 (socket says 172.21.15.2:60684) 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 -- 172.21.15.2:0/3512694236 learned_addr learned my addr 172.21.15.2:0/3512694236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdab7fe640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac10dbe0 0x7fbdac19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaaffd640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 0x7fbdac19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 -- 172.21.15.2:0/3512694236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac10dbe0 msgr2=0x7fbdac19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac10dbe0 0x7fbdac19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 -- 172.21.15.2:0/3512694236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 msgr2=0x7fbdac19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 0x7fbdac19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 -- 172.21.15.2:0/3512694236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac1a00c0 con 0x7fbdac1050d0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdaa7fc640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400d750 tx=0x7fbd9400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94017070 con 0x7fbdac1050d0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd940054d0 con 0x7fbdac1050d0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac1a03b0 con 0x7fbdac1050d0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94004c30 con 0x7fbdac1050d0 2024-08-31T04:24:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.189+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a6bd0 con 0x7fbdac1050d0 2024-08-31T04:24:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.191+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac06c020 con 0x7fbdac1050d0 2024-08-31T04:24:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.192+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fbd94004dd0 con 0x7fbdac1050d0 2024-08-31T04:24:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.193+0000 7fbda3fff640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 0x7fbd980b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.193+0000 7fbdaaffd640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 0x7fbd980b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.193+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fbd940e5580 con 0x7fbdac1050d0 2024-08-31T04:24:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.194+0000 7fbdaaffd640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 0x7fbd980b71d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007350 tx=0x7fbd9c0072e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.196+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd940ac140 con 0x7fbdac1050d0 2024-08-31T04:24:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:30 smithi064 ceph-mon[22007]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:31.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:30 smithi132 ceph-mon[22335]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:31.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.388+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbdac104b90 con 0x7fbdac1050d0 2024-08-31T04:24:31.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.388+0000 7fbda3fff640 1 -- 172.21.15.2:0/3512694236 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd940aba40 con 0x7fbdac1050d0 2024-08-31T04:24:31.390 INFO:teuthology.orchestra.run.smithi002.stdout:180388626489 2024-08-31T04:24:31.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 msgr2=0x7fbd980b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:31.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 0x7fbd980b71d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007350 tx=0x7fbd9c0072e0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 msgr2=0x7fbdac19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400d750 tx=0x7fbd9400dc10 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 shutdown_connections 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd980b4cc0 0x7fbd980b71d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1050d0 0x7fbdac19a7b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdac10dbe0 0x7fbdac19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 --2- 172.21.15.2:0/3512694236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdac104780 0x7fbdac19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 >> 172.21.15.2:0/3512694236 conn(0x7fbdac0794d0 msgr2=0x7fbdac107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 shutdown_connections 2024-08-31T04:24:31.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:31.390+0000 7fbdb12d7640 1 -- 172.21.15.2:0/3512694236 wait complete. 2024-08-31T04:24:31.947 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822715 got 154618822718 for osd.5 2024-08-31T04:24:31.947 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:32.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:31 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3512694236' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:24:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:31 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3512694236' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:24:32.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:31 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3512694236' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:24:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.611+0000 7fd53651a640 1 -- 172.21.15.2:0/4232390974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109b90 msgr2=0x7fd5301103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.611+0000 7fd53651a640 1 --2- 172.21.15.2:0/4232390974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109b90 0x7fd5301103c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd528009ca0 tx=0x7fd52802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 -- 172.21.15.2:0/4232390974 shutdown_connections 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 --2- 172.21.15.2:0/4232390974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109b90 0x7fd5301103c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 --2- 172.21.15.2:0/4232390974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109240 0x7fd530109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 --2- 172.21.15.2:0/4232390974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 0x7fd530103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 -- 172.21.15.2:0/4232390974 >> 172.21.15.2:0/4232390974 conn(0x7fd53007b5f0 msgr2=0x7fd53007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 -- 172.21.15.2:0/4232390974 shutdown_connections 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 -- 172.21.15.2:0/4232390974 wait complete. 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 Processor -- start 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.612+0000 7fd53651a640 1 -- start start 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 0x7fd53019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109b90 0x7fd53019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd530113850 con 0x7fd530109240 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5301136d0 con 0x7fd530103900 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd53651a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd5301139d0 con 0x7fd530109b90 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60704/0 (socket says 172.21.15.2:60704) 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 -- 172.21.15.2:0/2690715321 learned_addr learned my addr 172.21.15.2:0/2690715321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52ffff640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 0x7fd53019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd534ab7640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109b90 0x7fd53019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 -- 172.21.15.2:0/2690715321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109b90 msgr2=0x7fd53019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109b90 0x7fd53019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 -- 172.21.15.2:0/2690715321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 msgr2=0x7fd53019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 0x7fd53019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 -- 172.21.15.2:0/2690715321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5301a0270 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.613+0000 7fd52f7fe640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d750 tx=0x7fd52400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.614+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524017070 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.614+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5301a0560 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.614+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5240054d0 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.614+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524004c30 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.614+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5301a6cc0 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.615+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd530103d10 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.616+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fd524004dd0 con 0x7fd530109240 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.617+0000 7fd52d7fa640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 0x7fd5180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.617+0000 7fd52ffff640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 0x7fd5180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.617+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fd5240e54b0 con 0x7fd530109240 2024-08-31T04:24:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.617+0000 7fd52ffff640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 0x7fd5180b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd520009bd0 tx=0x7fd520005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.620+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5240ab9a0 con 0x7fd530109240 2024-08-31T04:24:32.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.805+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd53019b430 con 0x7fd530109240 2024-08-31T04:24:32.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.806+0000 7fd52d7fa640 1 -- 172.21.15.2:0/2690715321 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5240b0160 con 0x7fd530109240 2024-08-31T04:24:32.807 INFO:teuthology.orchestra.run.smithi002.stdout:249108103209 2024-08-31T04:24:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 msgr2=0x7fd5180b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 0x7fd5180b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd520009bd0 tx=0x7fd520005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 msgr2=0x7fd53019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d750 tx=0x7fd52400dc10 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 shutdown_connections 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd5180b4c10 0x7fd5180b7120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd530109240 0x7fd53019a8a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd530109b90 0x7fd53019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 --2- 172.21.15.2:0/2690715321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd530103900 0x7fd53019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 >> 172.21.15.2:0/2690715321 conn(0x7fd53007b5f0 msgr2=0x7fd530107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 shutdown_connections 2024-08-31T04:24:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:32.808+0000 7fd53651a640 1 -- 172.21.15.2:0/2690715321 wait complete. 2024-08-31T04:24:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:32 smithi002 ceph-mon[18656]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T04:24:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:32 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2690715321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:24:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:32 smithi064 ceph-mon[22007]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T04:24:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:32 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2690715321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:24:33.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:32 smithi132 ceph-mon[22335]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T04:24:33.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:32 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2690715321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:24:33.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626489 for osd.6 2024-08-31T04:24:33.432 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:34.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T04:24:34.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:33 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]} : dispatch 2024-08-31T04:24:34.053 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103205 got 249108103209 for osd.9 2024-08-31T04:24:34.053 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:34.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 -- 172.21.15.2:0/732291254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c108140 msgr2=0x7f826c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:34.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 --2- 172.21.15.2:0/732291254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c108140 0x7f826c108550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f825c009900 tx=0x7f825c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:34.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 -- 172.21.15.2:0/732291254 shutdown_connections 2024-08-31T04:24:34.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 --2- 172.21.15.2:0/732291254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c108140 0x7f826c108550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 --2- 172.21.15.2:0/732291254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108a90 0x7f826c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 --2- 172.21.15.2:0/732291254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c102800 0x7f826c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 -- 172.21.15.2:0/732291254 >> 172.21.15.2:0/732291254 conn(0x7f826c0794d0 msgr2=0x7f826c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 -- 172.21.15.2:0/732291254 shutdown_connections 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.259+0000 7f82734d9640 1 -- 172.21.15.2:0/732291254 wait complete. 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 Processor -- start 2024-08-31T04:24:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 -- start start 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 0x7f826c19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c108a90 0x7f826c1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1126e0 con 0x7f826c102800 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f826c112560 con 0x7f826c108140 2024-08-31T04:24:34.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f82734d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f826c112860 con 0x7f826c108a90 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f8271275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f8271275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60722/0 (socket says 172.21.15.2:60722) 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f8271275640 1 -- 172.21.15.2:0/3452329882 learned_addr learned my addr 172.21.15.2:0/3452329882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f8271a76640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c108a90 0x7f826c1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.260+0000 7f8270a74640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 0x7f826c19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 -- 172.21.15.2:0/3452329882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c108a90 msgr2=0x7f826c1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c108a90 0x7f826c1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 -- 172.21.15.2:0/3452329882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 msgr2=0x7f826c19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 0x7f826c19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 -- 172.21.15.2:0/3452329882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c1a2440 con 0x7f826c102800 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8270a74640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 0x7f826c19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f8271275640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f826800d770 tx=0x7f826800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268017070 con 0x7f826c102800 2024-08-31T04:24:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c1a2730 con 0x7f826c102800 2024-08-31T04:24:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82680054d0 con 0x7f826c102800 2024-08-31T04:24:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268004c30 con 0x7f826c102800 2024-08-31T04:24:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.261+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c1a8e90 con 0x7f826c102800 2024-08-31T04:24:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.262+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c102c10 con 0x7f826c102800 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.264+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f8268004dd0 con 0x7f826c102800 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.264+0000 7f82627fc640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 0x7f82580b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.265+0000 7f8270a74640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 0x7f82580b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.265+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9576+0+0 (secure 0 0 0) 0x7f82680e5690 con 0x7f826c102800 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.265+0000 7f8270a74640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 0x7f82580b71a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f825c0096c0 tx=0x7f825c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.268+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82680ac1a0 con 0x7f826c102800 2024-08-31T04:24:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T04:24:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T04:24:34.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-08-31T04:24:34.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]} : dispatch 2024-08-31T04:24:34.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-31T04:24:34.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.319 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:33 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]} : dispatch 2024-08-31T04:24:34.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T04:24:34.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-08-31T04:24:34.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:33 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]} : dispatch 2024-08-31T04:24:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.458+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f826c1a90f0 con 0x7f826c102800 2024-08-31T04:24:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.458+0000 7f82627fc640 1 -- 172.21.15.2:0/3452329882 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82680abaa0 con 0x7f826c102800 2024-08-31T04:24:34.460 INFO:teuthology.orchestra.run.smithi002.stdout:60129542226 2024-08-31T04:24:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 msgr2=0x7f82580b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 0x7f82580b71a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f825c0096c0 tx=0x7f825c031400 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 msgr2=0x7f826c19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f826800d770 tx=0x7f826800dc30 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 shutdown_connections 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f826c108a90 0x7f826c1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f826c108140 0x7f826c19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82580b4c90 0x7f82580b71a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 --2- 172.21.15.2:0/3452329882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826c102800 0x7f826c19c4d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 >> 172.21.15.2:0/3452329882 conn(0x7f826c0794d0 msgr2=0x7f826c06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 shutdown_connections 2024-08-31T04:24:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:34.461+0000 7f82734d9640 1 -- 172.21.15.2:0/3452329882 wait complete. 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-08-31T04:24:35.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-31T04:24:35.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-08-31T04:24:35.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-08-31T04:24:35.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-08-31T04:24:35.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T04:24:35.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:34 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3452329882' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:24:35.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542223 got 60129542226 for osd.1 2024-08-31T04:24:35.112 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T04:24:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-08-31T04:24:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-08-31T04:24:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:34 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3452329882' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T04:24:35.319 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:34 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3452329882' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:24:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 -- 172.21.15.2:0/418712561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c108b10 msgr2=0x7f745c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 --2- 172.21.15.2:0/418712561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c108b10 0x7f745c10f340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7454009ca0 tx=0x7f745402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 -- 172.21.15.2:0/418712561 shutdown_connections 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 --2- 172.21.15.2:0/418712561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c108b10 0x7f745c10f340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 --2- 172.21.15.2:0/418712561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c1081c0 0x7f745c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 --2- 172.21.15.2:0/418712561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c102880 0x7f745c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.333+0000 7f74634d4640 1 -- 172.21.15.2:0/418712561 >> 172.21.15.2:0/418712561 conn(0x7f745c079510 msgr2=0x7f745c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.334+0000 7f74634d4640 1 -- 172.21.15.2:0/418712561 shutdown_connections 2024-08-31T04:24:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.334+0000 7f74634d4640 1 -- 172.21.15.2:0/418712561 wait complete. 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 Processor -- start 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 -- start start 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 0x7f745c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 0x7f745c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f745c1127c0 con 0x7f745c102880 2024-08-31T04:24:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f745c112640 con 0x7f745c108b10 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f74634d4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f745c112940 con 0x7f745c1081c0 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f7461270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f7461270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55146/0 (socket says 172.21.15.2:55146) 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f7461270640 1 -- 172.21.15.2:0/3733708099 learned_addr learned my addr 172.21.15.2:0/3733708099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f7461a71640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 0x7f745c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.335+0000 7f7460a6f640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 0x7f745c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 -- 172.21.15.2:0/3733708099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 msgr2=0x7f745c19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 0x7f745c19b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 -- 172.21.15.2:0/3733708099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 msgr2=0x7f745c19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 0x7f745c19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 -- 172.21.15.2:0/3733708099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c198e80 con 0x7f745c102880 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7460a6f640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 0x7f745c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461a71640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 0x7f745c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f7461270640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f745800c920 tx=0x7f745800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458007c70 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c199170 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7458007e10 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458018820 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.336+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c1996b0 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.337+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c103b00 con 0x7f745c102880 2024-08-31T04:24:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.339+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f745800f450 con 0x7f745c102880 2024-08-31T04:24:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.340+0000 7f74527fc640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 0x7f74480b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.340+0000 7f7460a6f640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 0x7f74480b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.340+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f74580e5d50 con 0x7f745c102880 2024-08-31T04:24:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.340+0000 7f7460a6f640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 0x7f74480b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f745c107e90 tx=0x7f744c005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.343+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7458014030 con 0x7f745c102880 2024-08-31T04:24:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.532+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f745c102c90 con 0x7f745c102880 2024-08-31T04:24:35.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.532+0000 7f74527fc640 1 -- 172.21.15.2:0/3733708099 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f74580ac810 con 0x7f745c102880 2024-08-31T04:24:35.534 INFO:teuthology.orchestra.run.smithi002.stdout:270582939686 2024-08-31T04:24:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 msgr2=0x7f74480b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 0x7f74480b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f745c107e90 tx=0x7f744c005e50 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 msgr2=0x7f745c19b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f745800c920 tx=0x7f745800cde0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 shutdown_connections 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f745c108b10 0x7f745c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c1081c0 0x7f745c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74480b4c40 0x7f74480b7150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 --2- 172.21.15.2:0/3733708099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f745c102880 0x7f745c19b090 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 >> 172.21.15.2:0/3733708099 conn(0x7f745c079510 msgr2=0x7f745c106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 shutdown_connections 2024-08-31T04:24:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:35.535+0000 7f74634d4640 1 -- 172.21.15.2:0/3733708099 wait complete. 2024-08-31T04:24:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:35 smithi002 ceph-mon[18656]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T04:24:36.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:35 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3733708099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:24:36.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:35 smithi064 ceph-mon[22007]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T04:24:36.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:35 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3733708099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:24:36.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:35 smithi132 ceph-mon[22335]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T04:24:36.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:35 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3733708099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:24:36.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939683 got 270582939686 for osd.10 2024-08-31T04:24:36.362 DEBUG:teuthology.parallel:result is None 2024-08-31T04:24:36.362 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T04:24:36.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:24:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:37.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:36 smithi002 ceph-mon[18656]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-31T04:24:37.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:36 smithi002 ceph-mon[18656]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 -- 172.21.15.2:0/1063041437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4108150 msgr2=0x7fbdc4108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 --2- 172.21.15.2:0/1063041437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4108150 0x7fbdc4108560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009900 tx=0x7fbdac02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 -- 172.21.15.2:0/1063041437 shutdown_connections 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 --2- 172.21.15.2:0/1063041437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4108150 0x7fbdc4108560 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 --2- 172.21.15.2:0/1063041437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 0x7fbdc410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 --2- 172.21.15.2:0/1063041437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4102810 0x7fbdc4102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 -- 172.21.15.2:0/1063041437 >> 172.21.15.2:0/1063041437 conn(0x7fbdc40794d0 msgr2=0x7fbdc40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 -- 172.21.15.2:0/1063041437 shutdown_connections 2024-08-31T04:24:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.093+0000 7fbdca76a640 1 -- 172.21.15.2:0/1063041437 wait complete. 2024-08-31T04:24:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 Processor -- start 2024-08-31T04:24:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 -- start start 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4108150 0x7fbdc419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 0x7fbdc419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4113830 con 0x7fbdc4102810 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41136b0 con 0x7fbdc4108aa0 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.094+0000 7fbdca76a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41139b0 con 0x7fbdc4108150 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55154/0 (socket says 172.21.15.2:55154) 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 -- 172.21.15.2:0/3392203952 learned_addr learned my addr 172.21.15.2:0/3392203952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdbbfff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4108150 0x7fbdc419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc8d07640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 0x7fbdc419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 -- 172.21.15.2:0/3392203952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4108150 msgr2=0x7fbdc419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4108150 0x7fbdc419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 -- 172.21.15.2:0/3392203952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 msgr2=0x7fbdc419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 0x7fbdc419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 -- 172.21.15.2:0/3392203952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc41a0210 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc3fff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e9f0 tx=0x7fbdb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400cd80 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc41a0500 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb40054d0 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4010690 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.095+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41a6c60 con 0x7fbdc4102810 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.096+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc4103a90 con 0x7fbdc4102810 2024-08-31T04:24:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.099+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fbdb4004e50 con 0x7fbdc4102810 2024-08-31T04:24:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.099+0000 7fbdc1ffb640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 0x7fbdb00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.100+0000 7fbdbbfff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 0x7fbdb00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.100+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fbdb40e5fb0 con 0x7fbdc4102810 2024-08-31T04:24:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.100+0000 7fbdbbfff640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 0x7fbdb00b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000c00 tx=0x7fbdac031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.103+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbdb4056130 con 0x7fbdc4102810 2024-08-31T04:24:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.282+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbdc410a8a0 con 0x7fbdb00b4c10 2024-08-31T04:24:37.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.289+0000 7fbdc1ffb640 1 -- 172.21.15.2:0/3392203952 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340248 (secure 0 0 0) 0x7fbdc410a8a0 con 0x7fbdb00b4c10 2024-08-31T04:24:37.294 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 msgr2=0x7fbdb00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 0x7fbdb00b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000c00 tx=0x7fbdac031400 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 msgr2=0x7fbdc419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e9f0 tx=0x7fbdb400edf0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 shutdown_connections 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdc4108aa0 0x7fbdc419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdc4108150 0x7fbdc419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbdb00b4c10 0x7fbdb00b7120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 --2- 172.21.15.2:0/3392203952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdc4102810 0x7fbdc419a2a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 >> 172.21.15.2:0/3392203952 conn(0x7fbdc40794d0 msgr2=0x7fbdc4104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 shutdown_connections 2024-08-31T04:24:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:37.292+0000 7fbdca76a640 1 -- 172.21.15.2:0/3392203952 wait complete. 2024-08-31T04:24:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:36 smithi064 ceph-mon[22007]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-31T04:24:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:36 smithi064 ceph-mon[22007]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-08-31T04:24:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:36 smithi132 ceph-mon[22335]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-31T04:24:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:36 smithi132 ceph-mon[22335]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-08-31T04:24:38.006 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-08-31T04:24:37.090630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":449,"num_read_kb":325,"num_write":296,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404344,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537480,"statfs":{"total":1151940427776,"available":1151526379520,"internally_reserved":0,"allocated":13762560,"data_stored":7883174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002694"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903727+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903727+0000","last_peered":"2024-08-31T04:24:34.903727+0000","last_clean":"2024-08-31T04:24:34.903727+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903727+0000","last_undegraded":"2024-08-31T04:24:34.903727+0000","last_fullsized":"2024-08-31T04:24:34.903727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903553+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:24:33.903553+0000","last_peered":"2024-08-31T04:24:33.903553+0000","last_clean":"2024-08-31T04:24:33.903553+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:24:33.903553+0000","last_undegraded":"2024-08-31T04:24:33.903553+0000","last_fullsized":"2024-08-31T04:24:33.903553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905768+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:33.905768+0000","last_peered":"2024-08-31T04:24:33.905768+0000","last_clean":"2024-08-31T04:24:33.905768+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:33.905768+0000","last_undegraded":"2024-08-31T04:24:33.905768+0000","last_fullsized":"2024-08-31T04:24:33.905768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369945+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:23:34.369945+0000","last_peered":"2024-08-31T04:23:34.369945+0000","last_clean":"2024-08-31T04:23:34.369945+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:23:34.369945+0000","last_undegraded":"2024-08-31T04:23:34.369945+0000","last_fullsized":"2024-08-31T04:23:34.369945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902996+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:33.902996+0000","last_peered":"2024-08-31T04:24:33.902996+0000","last_clean":"2024-08-31T04:24:33.902996+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:33.902996+0000","last_undegraded":"2024-08-31T04:24:33.902996+0000","last_fullsized":"2024-08-31T04:24:33.902996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903985+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:24:34.903985+0000","last_peered":"2024-08-31T04:24:34.903985+0000","last_clean":"2024-08-31T04:24:34.903985+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:24:34.903985+0000","last_undegraded":"2024-08-31T04:24:34.903985+0000","last_fullsized":"2024-08-31T04:24:34.903985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903147+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:33.903147+0000","last_peered":"2024-08-31T04:24:33.903147+0000","last_clean":"2024-08-31T04:24:33.903147+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:33.903147+0000","last_undegraded":"2024-08-31T04:24:33.903147+0000","last_fullsized":"2024-08-31T04:24:33.903147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902128+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:24:34.902128+0000","last_peered":"2024-08-31T04:24:34.902128+0000","last_clean":"2024-08-31T04:24:34.902128+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:24:34.902128+0000","last_undegraded":"2024-08-31T04:24:34.902128+0000","last_fullsized":"2024-08-31T04:24:34.902128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162940+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:24:35.162940+0000","last_peered":"2024-08-31T04:24:35.162940+0000","last_clean":"2024-08-31T04:24:35.162940+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:24:35.162940+0000","last_undegraded":"2024-08-31T04:24:35.162940+0000","last_fullsized":"2024-08-31T04:24:35.162940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902549+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:33.902549+0000","last_peered":"2024-08-31T04:24:33.902549+0000","last_clean":"2024-08-31T04:24:33.902549+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:33.902549+0000","last_undegraded":"2024-08-31T04:24:33.902549+0000","last_fullsized":"2024-08-31T04:24:33.902549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902903+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902903+0000","last_peered":"2024-08-31T04:24:34.902903+0000","last_clean":"2024-08-31T04:24:34.902903+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902903+0000","last_undegraded":"2024-08-31T04:24:34.902903+0000","last_fullsized":"2024-08-31T04:24:34.902903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902849+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:24:33.902849+0000","last_peered":"2024-08-31T04:24:33.902849+0000","last_clean":"2024-08-31T04:24:33.902849+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:24:33.902849+0000","last_undegraded":"2024-08-31T04:24:33.902849+0000","last_fullsized":"2024-08-31T04:24:33.902849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903339+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903339+0000","last_peered":"2024-08-31T04:24:34.903339+0000","last_clean":"2024-08-31T04:24:34.903339+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903339+0000","last_undegraded":"2024-08-31T04:24:34.903339+0000","last_fullsized":"2024-08-31T04:24:34.903339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902737+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902737+0000","last_peered":"2024-08-31T04:24:34.902737+0000","last_clean":"2024-08-31T04:24:34.902737+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902737+0000","last_undegraded":"2024-08-31T04:24:34.902737+0000","last_fullsized":"2024-08-31T04:24:34.902737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366977+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:23:34.366977+0000","last_peered":"2024-08-31T04:23:34.366977+0000","last_clean":"2024-08-31T04:23:34.366977+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:23:34.366977+0000","last_undegraded":"2024-08-31T04:23:34.366977+0000","last_fullsized":"2024-08-31T04:23:34.366977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904990+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:33.904990+0000","last_peered":"2024-08-31T04:24:33.904990+0000","last_clean":"2024-08-31T04:24:33.904990+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:33.904990+0000","last_undegraded":"2024-08-31T04:24:33.904990+0000","last_fullsized":"2024-08-31T04:24:33.904990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903317+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903317+0000","last_peered":"2024-08-31T04:24:34.903317+0000","last_clean":"2024-08-31T04:24:34.903317+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903317+0000","last_undegraded":"2024-08-31T04:24:34.903317+0000","last_fullsized":"2024-08-31T04:24:34.903317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903081+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:24:33.903081+0000","last_peered":"2024-08-31T04:24:33.903081+0000","last_clean":"2024-08-31T04:24:33.903081+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:24:33.903081+0000","last_undegraded":"2024-08-31T04:24:33.903081+0000","last_fullsized":"2024-08-31T04:24:33.903081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903872+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903872+0000","last_peered":"2024-08-31T04:24:34.903872+0000","last_clean":"2024-08-31T04:24:34.903872+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903872+0000","last_undegraded":"2024-08-31T04:24:34.903872+0000","last_fullsized":"2024-08-31T04:24:34.903872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902455+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902455+0000","last_peered":"2024-08-31T04:24:34.902455+0000","last_clean":"2024-08-31T04:24:34.902455+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902455+0000","last_undegraded":"2024-08-31T04:24:34.902455+0000","last_fullsized":"2024-08-31T04:24:34.902455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369702+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:23:34.369702+0000","last_peered":"2024-08-31T04:23:34.369702+0000","last_clean":"2024-08-31T04:23:34.369702+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:23:34.369702+0000","last_undegraded":"2024-08-31T04:23:34.369702+0000","last_fullsized":"2024-08-31T04:23:34.369702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903158+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903158+0000","last_peered":"2024-08-31T04:24:34.903158+0000","last_clean":"2024-08-31T04:24:34.903158+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903158+0000","last_undegraded":"2024-08-31T04:24:34.903158+0000","last_fullsized":"2024-08-31T04:24:34.903158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903836+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903836+0000","last_peered":"2024-08-31T04:24:34.903836+0000","last_clean":"2024-08-31T04:24:34.903836+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903836+0000","last_undegraded":"2024-08-31T04:24:34.903836+0000","last_fullsized":"2024-08-31T04:24:34.903836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":5,"reported_epoch":85,"state":"activating","last_fresh":"2024-08-31T04:24:35.066409+0000","last_change":"2024-08-31T04:24:34.903494+0000","last_active":"2024-08-31T04:24:34.903280+0000","last_peered":"2024-08-31T04:23:34.495302+0000","last_clean":"2024-08-31T04:23:34.495302+0000","last_became_active":"2024-08-31T04:22:57.250958+0000","last_became_peered":"2024-08-31T04:22:57.250958+0000","last_unstale":"2024-08-31T04:24:35.066409+0000","last_undegraded":"2024-08-31T04:24:35.066409+0000","last_fullsized":"2024-08-31T04:24:35.066409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":["9","3","7","11"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903383+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:24:34.903383+0000","last_peered":"2024-08-31T04:24:34.903383+0000","last_clean":"2024-08-31T04:24:34.903383+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:24:34.903383+0000","last_undegraded":"2024-08-31T04:24:34.903383+0000","last_fullsized":"2024-08-31T04:24:34.903383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902747+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:33.902747+0000","last_peered":"2024-08-31T04:24:33.902747+0000","last_clean":"2024-08-31T04:24:33.902747+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:33.902747+0000","last_undegraded":"2024-08-31T04:24:33.902747+0000","last_fullsized":"2024-08-31T04:24:33.902747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899720+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:24:34.899720+0000","last_peered":"2024-08-31T04:24:34.899720+0000","last_clean":"2024-08-31T04:24:34.899720+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:24:34.899720+0000","last_undegraded":"2024-08-31T04:24:34.899720+0000","last_fullsized":"2024-08-31T04:24:34.899720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903133+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:33.903133+0000","last_peered":"2024-08-31T04:24:33.903133+0000","last_clean":"2024-08-31T04:24:33.903133+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:33.903133+0000","last_undegraded":"2024-08-31T04:24:33.903133+0000","last_fullsized":"2024-08-31T04:24:33.903133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367104+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.367104+0000","last_peered":"2024-08-31T04:23:34.367104+0000","last_clean":"2024-08-31T04:23:34.367104+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:23:34.367104+0000","last_undegraded":"2024-08-31T04:23:34.367104+0000","last_fullsized":"2024-08-31T04:23:34.367104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175761+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:24:35.175761+0000","last_peered":"2024-08-31T04:24:35.175761+0000","last_clean":"2024-08-31T04:24:35.175761+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:24:35.175761+0000","last_undegraded":"2024-08-31T04:24:35.175761+0000","last_fullsized":"2024-08-31T04:24:35.175761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903204+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903204+0000","last_peered":"2024-08-31T04:24:34.903204+0000","last_clean":"2024-08-31T04:24:34.903204+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903204+0000","last_undegraded":"2024-08-31T04:24:34.903204+0000","last_fullsized":"2024-08-31T04:24:34.903204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902897+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:33.902897+0000","last_peered":"2024-08-31T04:24:33.902897+0000","last_clean":"2024-08-31T04:24:33.902897+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:33.902897+0000","last_undegraded":"2024-08-31T04:24:33.902897+0000","last_fullsized":"2024-08-31T04:24:33.902897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175688+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:24:35.175688+0000","last_peered":"2024-08-31T04:24:35.175688+0000","last_clean":"2024-08-31T04:24:35.175688+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:24:35.175688+0000","last_undegraded":"2024-08-31T04:24:35.175688+0000","last_fullsized":"2024-08-31T04:24:35.175688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163308+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163308+0000","last_peered":"2024-08-31T04:24:35.163308+0000","last_clean":"2024-08-31T04:24:35.163308+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163308+0000","last_undegraded":"2024-08-31T04:24:35.163308+0000","last_fullsized":"2024-08-31T04:24:35.163308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899462+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899462+0000","last_peered":"2024-08-31T04:24:34.899462+0000","last_clean":"2024-08-31T04:24:34.899462+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899462+0000","last_undegraded":"2024-08-31T04:24:34.899462+0000","last_fullsized":"2024-08-31T04:24:34.899462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.909200+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:24:34.909200+0000","last_peered":"2024-08-31T04:24:34.909200+0000","last_clean":"2024-08-31T04:24:34.909200+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:24:34.909200+0000","last_undegraded":"2024-08-31T04:24:34.909200+0000","last_fullsized":"2024-08-31T04:24:34.909200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899274+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:24:34.899274+0000","last_peered":"2024-08-31T04:24:34.899274+0000","last_clean":"2024-08-31T04:24:34.899274+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:24:34.899274+0000","last_undegraded":"2024-08-31T04:24:34.899274+0000","last_fullsized":"2024-08-31T04:24:34.899274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899665+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899665+0000","last_peered":"2024-08-31T04:24:34.899665+0000","last_clean":"2024-08-31T04:24:34.899665+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899665+0000","last_undegraded":"2024-08-31T04:24:34.899665+0000","last_fullsized":"2024-08-31T04:24:34.899665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899079+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:24:34.899079+0000","last_peered":"2024-08-31T04:24:34.899079+0000","last_clean":"2024-08-31T04:24:34.899079+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:24:34.899079+0000","last_undegraded":"2024-08-31T04:24:34.899079+0000","last_fullsized":"2024-08-31T04:24:34.899079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162741+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.162741+0000","last_peered":"2024-08-31T04:24:35.162741+0000","last_clean":"2024-08-31T04:24:35.162741+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.162741+0000","last_undegraded":"2024-08-31T04:24:35.162741+0000","last_fullsized":"2024-08-31T04:24:35.162741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902421+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902421+0000","last_peered":"2024-08-31T04:24:34.902421+0000","last_clean":"2024-08-31T04:24:34.902421+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902421+0000","last_undegraded":"2024-08-31T04:24:34.902421+0000","last_fullsized":"2024-08-31T04:24:34.902421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903751+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:24:33.903751+0000","last_peered":"2024-08-31T04:24:33.903751+0000","last_clean":"2024-08-31T04:24:33.903751+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:24:33.903751+0000","last_undegraded":"2024-08-31T04:24:33.903751+0000","last_fullsized":"2024-08-31T04:24:33.903751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902599+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902599+0000","last_peered":"2024-08-31T04:24:34.902599+0000","last_clean":"2024-08-31T04:24:34.902599+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902599+0000","last_undegraded":"2024-08-31T04:24:34.902599+0000","last_fullsized":"2024-08-31T04:24:34.902599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162974+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.162974+0000","last_peered":"2024-08-31T04:24:35.162974+0000","last_clean":"2024-08-31T04:24:35.162974+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.162974+0000","last_undegraded":"2024-08-31T04:24:35.162974+0000","last_fullsized":"2024-08-31T04:24:35.162974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163451+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:24:35.163451+0000","last_peered":"2024-08-31T04:24:35.163451+0000","last_clean":"2024-08-31T04:24:35.163451+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:24:35.163451+0000","last_undegraded":"2024-08-31T04:24:35.163451+0000","last_fullsized":"2024-08-31T04:24:35.163451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904175+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904175+0000","last_peered":"2024-08-31T04:24:34.904175+0000","last_clean":"2024-08-31T04:24:34.904175+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904175+0000","last_undegraded":"2024-08-31T04:24:34.904175+0000","last_fullsized":"2024-08-31T04:24:34.904175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163017+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:24:35.163017+0000","last_peered":"2024-08-31T04:24:35.163017+0000","last_clean":"2024-08-31T04:24:35.163017+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:24:35.163017+0000","last_undegraded":"2024-08-31T04:24:35.163017+0000","last_fullsized":"2024-08-31T04:24:35.163017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902460+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902460+0000","last_peered":"2024-08-31T04:24:34.902460+0000","last_clean":"2024-08-31T04:24:34.902460+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902460+0000","last_undegraded":"2024-08-31T04:24:34.902460+0000","last_fullsized":"2024-08-31T04:24:34.902460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369551+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:23:34.369551+0000","last_peered":"2024-08-31T04:23:34.369551+0000","last_clean":"2024-08-31T04:23:34.369551+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:23:34.369551+0000","last_undegraded":"2024-08-31T04:23:34.369551+0000","last_fullsized":"2024-08-31T04:23:34.369551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163666+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:24:35.163666+0000","last_peered":"2024-08-31T04:24:35.163666+0000","last_clean":"2024-08-31T04:24:35.163666+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:24:35.163666+0000","last_undegraded":"2024-08-31T04:24:35.163666+0000","last_fullsized":"2024-08-31T04:24:35.163666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899735+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899735+0000","last_peered":"2024-08-31T04:24:34.899735+0000","last_clean":"2024-08-31T04:24:34.899735+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899735+0000","last_undegraded":"2024-08-31T04:24:34.899735+0000","last_fullsized":"2024-08-31T04:24:34.899735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900596+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900596+0000","last_peered":"2024-08-31T04:24:34.900596+0000","last_clean":"2024-08-31T04:24:34.900596+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900596+0000","last_undegraded":"2024-08-31T04:24:34.900596+0000","last_fullsized":"2024-08-31T04:24:34.900596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367139+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:23:34.367139+0000","last_peered":"2024-08-31T04:23:34.367139+0000","last_clean":"2024-08-31T04:23:34.367139+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:23:34.367139+0000","last_undegraded":"2024-08-31T04:23:34.367139+0000","last_fullsized":"2024-08-31T04:23:34.367139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904048+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:24:33.904048+0000","last_peered":"2024-08-31T04:24:33.904048+0000","last_clean":"2024-08-31T04:24:33.904048+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:24:33.904048+0000","last_undegraded":"2024-08-31T04:24:33.904048+0000","last_fullsized":"2024-08-31T04:24:33.904048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900723+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900723+0000","last_peered":"2024-08-31T04:24:34.900723+0000","last_clean":"2024-08-31T04:24:34.900723+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900723+0000","last_undegraded":"2024-08-31T04:24:34.900723+0000","last_fullsized":"2024-08-31T04:24:34.900723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901214+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:24:34.901214+0000","last_peered":"2024-08-31T04:24:34.901214+0000","last_clean":"2024-08-31T04:24:34.901214+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:24:34.901214+0000","last_undegraded":"2024-08-31T04:24:34.901214+0000","last_fullsized":"2024-08-31T04:24:34.901214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902567+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:33.902567+0000","last_peered":"2024-08-31T04:24:33.902567+0000","last_clean":"2024-08-31T04:24:33.902567+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:33.902567+0000","last_undegraded":"2024-08-31T04:24:33.902567+0000","last_fullsized":"2024-08-31T04:24:33.902567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162525+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:24:35.162525+0000","last_peered":"2024-08-31T04:24:35.162525+0000","last_clean":"2024-08-31T04:24:35.162525+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:24:35.162525+0000","last_undegraded":"2024-08-31T04:24:35.162525+0000","last_fullsized":"2024-08-31T04:24:35.162525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.516303+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:24:35.516303+0000","last_peered":"2024-08-31T04:24:35.516303+0000","last_clean":"2024-08-31T04:24:35.516303+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:24:35.516303+0000","last_undegraded":"2024-08-31T04:24:35.516303+0000","last_fullsized":"2024-08-31T04:24:35.516303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":2,"reported_epoch":84,"state":"peering","last_fresh":"2024-08-31T04:23:04.268077+0000","last_change":"2024-08-31T04:24:34.098165+0000","last_active":"2024-08-31T04:23:03.258282+0000","last_peered":"2024-08-31T04:23:03.258282+0000","last_clean":"2024-08-31T04:23:03.258282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-31T04:23:04.268077+0000","last_undegraded":"2024-08-31T04:23:04.268077+0000","last_fullsized":"2024-08-31T04:23:04.268077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163003+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:24:35.163003+0000","last_peered":"2024-08-31T04:24:35.163003+0000","last_clean":"2024-08-31T04:24:35.163003+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:24:35.163003+0000","last_undegraded":"2024-08-31T04:24:35.163003+0000","last_fullsized":"2024-08-31T04:24:35.163003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901294+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901294+0000","last_peered":"2024-08-31T04:24:34.901294+0000","last_clean":"2024-08-31T04:24:34.901294+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901294+0000","last_undegraded":"2024-08-31T04:24:34.901294+0000","last_fullsized":"2024-08-31T04:24:34.901294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367016+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:23:34.367016+0000","last_peered":"2024-08-31T04:23:34.367016+0000","last_clean":"2024-08-31T04:23:34.367016+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:23:34.367016+0000","last_undegraded":"2024-08-31T04:23:34.367016+0000","last_fullsized":"2024-08-31T04:23:34.367016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164616+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:24:35.164616+0000","last_peered":"2024-08-31T04:24:35.164616+0000","last_clean":"2024-08-31T04:24:35.164616+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:24:35.164616+0000","last_undegraded":"2024-08-31T04:24:35.164616+0000","last_fullsized":"2024-08-31T04:24:35.164616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903598+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903598+0000","last_peered":"2024-08-31T04:24:34.903598+0000","last_clean":"2024-08-31T04:24:34.903598+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903598+0000","last_undegraded":"2024-08-31T04:24:34.903598+0000","last_fullsized":"2024-08-31T04:24:34.903598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902763+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:24:33.902763+0000","last_peered":"2024-08-31T04:24:33.902763+0000","last_clean":"2024-08-31T04:24:33.902763+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:24:33.902763+0000","last_undegraded":"2024-08-31T04:24:33.902763+0000","last_fullsized":"2024-08-31T04:24:33.902763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":195,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515228+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:24:35.515228+0000","last_peered":"2024-08-31T04:24:35.515228+0000","last_clean":"2024-08-31T04:24:35.515228+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:24:35.515228+0000","last_undegraded":"2024-08-31T04:24:35.515228+0000","last_fullsized":"2024-08-31T04:24:35.515228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":124,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902970+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.902970+0000","last_peered":"2024-08-31T04:24:34.902970+0000","last_clean":"2024-08-31T04:24:34.902970+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.902970+0000","last_undegraded":"2024-08-31T04:24:34.902970+0000","last_fullsized":"2024-08-31T04:24:34.902970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904119+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:24:34.904119+0000","last_peered":"2024-08-31T04:24:34.904119+0000","last_clean":"2024-08-31T04:24:34.904119+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:24:34.904119+0000","last_undegraded":"2024-08-31T04:24:34.904119+0000","last_fullsized":"2024-08-31T04:24:34.904119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902335+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902335+0000","last_peered":"2024-08-31T04:24:34.902335+0000","last_clean":"2024-08-31T04:24:34.902335+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902335+0000","last_undegraded":"2024-08-31T04:24:34.902335+0000","last_fullsized":"2024-08-31T04:24:34.902335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177602+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.177602+0000","last_peered":"2024-08-31T04:24:35.177602+0000","last_clean":"2024-08-31T04:24:35.177602+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.177602+0000","last_undegraded":"2024-08-31T04:24:35.177602+0000","last_fullsized":"2024-08-31T04:24:35.177602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369989+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:23:34.369989+0000","last_peered":"2024-08-31T04:23:34.369989+0000","last_clean":"2024-08-31T04:23:34.369989+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:23:34.369989+0000","last_undegraded":"2024-08-31T04:23:34.369989+0000","last_fullsized":"2024-08-31T04:23:34.369989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163405+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163405+0000","last_peered":"2024-08-31T04:24:35.163405+0000","last_clean":"2024-08-31T04:24:35.163405+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163405+0000","last_undegraded":"2024-08-31T04:24:35.163405+0000","last_fullsized":"2024-08-31T04:24:35.163405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902696+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902696+0000","last_peered":"2024-08-31T04:24:34.902696+0000","last_clean":"2024-08-31T04:24:34.902696+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902696+0000","last_undegraded":"2024-08-31T04:24:34.902696+0000","last_fullsized":"2024-08-31T04:24:34.902696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.905097+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:24:34.905097+0000","last_peered":"2024-08-31T04:24:34.905097+0000","last_clean":"2024-08-31T04:24:34.905097+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:24:34.905097+0000","last_undegraded":"2024-08-31T04:24:34.905097+0000","last_fullsized":"2024-08-31T04:24:34.905097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176117+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:24:35.176117+0000","last_peered":"2024-08-31T04:24:35.176117+0000","last_clean":"2024-08-31T04:24:35.176117+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:24:35.176117+0000","last_undegraded":"2024-08-31T04:24:35.176117+0000","last_fullsized":"2024-08-31T04:24:35.176117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904605+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:33.904605+0000","last_peered":"2024-08-31T04:24:33.904605+0000","last_clean":"2024-08-31T04:24:33.904605+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:33.904605+0000","last_undegraded":"2024-08-31T04:24:33.904605+0000","last_fullsized":"2024-08-31T04:24:33.904605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369477+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:23:34.369477+0000","last_peered":"2024-08-31T04:23:34.369477+0000","last_clean":"2024-08-31T04:23:34.369477+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:23:34.369477+0000","last_undegraded":"2024-08-31T04:23:34.369477+0000","last_fullsized":"2024-08-31T04:23:34.369477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902852+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:24:34.902852+0000","last_peered":"2024-08-31T04:24:34.902852+0000","last_clean":"2024-08-31T04:24:34.902852+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:24:34.902852+0000","last_undegraded":"2024-08-31T04:24:34.902852+0000","last_fullsized":"2024-08-31T04:24:34.902852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901010+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901010+0000","last_peered":"2024-08-31T04:24:34.901010+0000","last_clean":"2024-08-31T04:24:34.901010+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901010+0000","last_undegraded":"2024-08-31T04:24:34.901010+0000","last_fullsized":"2024-08-31T04:24:34.901010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367211+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:23:34.367211+0000","last_peered":"2024-08-31T04:23:34.367211+0000","last_clean":"2024-08-31T04:23:34.367211+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:23:34.367211+0000","last_undegraded":"2024-08-31T04:23:34.367211+0000","last_fullsized":"2024-08-31T04:23:34.367211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902892+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:24:33.902892+0000","last_peered":"2024-08-31T04:24:33.902892+0000","last_clean":"2024-08-31T04:24:33.902892+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:24:33.902892+0000","last_undegraded":"2024-08-31T04:24:33.902892+0000","last_fullsized":"2024-08-31T04:24:33.902892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899145+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899145+0000","last_peered":"2024-08-31T04:24:34.899145+0000","last_clean":"2024-08-31T04:24:34.899145+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899145+0000","last_undegraded":"2024-08-31T04:24:34.899145+0000","last_fullsized":"2024-08-31T04:24:34.899145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175580+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175580+0000","last_peered":"2024-08-31T04:24:35.175580+0000","last_clean":"2024-08-31T04:24:35.175580+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175580+0000","last_undegraded":"2024-08-31T04:24:35.175580+0000","last_fullsized":"2024-08-31T04:24:35.175580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.925663+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:24:34.925663+0000","last_peered":"2024-08-31T04:24:34.925663+0000","last_clean":"2024-08-31T04:24:34.925663+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:24:34.925663+0000","last_undegraded":"2024-08-31T04:24:34.925663+0000","last_fullsized":"2024-08-31T04:24:34.925663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515972+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:24:35.515972+0000","last_peered":"2024-08-31T04:24:35.515972+0000","last_clean":"2024-08-31T04:24:35.515972+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:24:35.515972+0000","last_undegraded":"2024-08-31T04:24:35.515972+0000","last_fullsized":"2024-08-31T04:24:35.515972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903288+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:24:33.903288+0000","last_peered":"2024-08-31T04:24:33.903288+0000","last_clean":"2024-08-31T04:24:33.903288+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:24:33.903288+0000","last_undegraded":"2024-08-31T04:24:33.903288+0000","last_fullsized":"2024-08-31T04:24:33.903288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366880+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:23:34.366880+0000","last_peered":"2024-08-31T04:23:34.366880+0000","last_clean":"2024-08-31T04:23:34.366880+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:23:34.366880+0000","last_undegraded":"2024-08-31T04:23:34.366880+0000","last_fullsized":"2024-08-31T04:23:34.366880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.911653+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:24:34.911653+0000","last_peered":"2024-08-31T04:24:34.911653+0000","last_clean":"2024-08-31T04:24:34.911653+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:24:34.911653+0000","last_undegraded":"2024-08-31T04:24:34.911653+0000","last_fullsized":"2024-08-31T04:24:34.911653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903193+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:24:34.903193+0000","last_peered":"2024-08-31T04:24:34.903193+0000","last_clean":"2024-08-31T04:24:34.903193+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:24:34.903193+0000","last_undegraded":"2024-08-31T04:24:34.903193+0000","last_fullsized":"2024-08-31T04:24:34.903193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369671+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:23:34.369671+0000","last_peered":"2024-08-31T04:23:34.369671+0000","last_clean":"2024-08-31T04:23:34.369671+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:23:34.369671+0000","last_undegraded":"2024-08-31T04:23:34.369671+0000","last_fullsized":"2024-08-31T04:23:34.369671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899594+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:24:34.899594+0000","last_peered":"2024-08-31T04:24:34.899594+0000","last_clean":"2024-08-31T04:24:34.899594+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:24:34.899594+0000","last_undegraded":"2024-08-31T04:24:34.899594+0000","last_fullsized":"2024-08-31T04:24:34.899594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367262+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:23:34.367262+0000","last_peered":"2024-08-31T04:23:34.367262+0000","last_clean":"2024-08-31T04:23:34.367262+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:23:34.367262+0000","last_undegraded":"2024-08-31T04:23:34.367262+0000","last_fullsized":"2024-08-31T04:23:34.367262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904210+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:24:34.904210+0000","last_peered":"2024-08-31T04:24:34.904210+0000","last_clean":"2024-08-31T04:24:34.904210+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:24:34.904210+0000","last_undegraded":"2024-08-31T04:24:34.904210+0000","last_fullsized":"2024-08-31T04:24:34.904210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905262+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:24:33.905262+0000","last_peered":"2024-08-31T04:24:33.905262+0000","last_clean":"2024-08-31T04:24:33.905262+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:24:33.905262+0000","last_undegraded":"2024-08-31T04:24:33.905262+0000","last_fullsized":"2024-08-31T04:24:33.905262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900794+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:24:34.900794+0000","last_peered":"2024-08-31T04:24:34.900794+0000","last_clean":"2024-08-31T04:24:34.900794+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:24:34.900794+0000","last_undegraded":"2024-08-31T04:24:34.900794+0000","last_fullsized":"2024-08-31T04:24:34.900794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904791+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:24:33.904791+0000","last_peered":"2024-08-31T04:24:33.904791+0000","last_clean":"2024-08-31T04:24:33.904791+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:24:33.904791+0000","last_undegraded":"2024-08-31T04:24:33.904791+0000","last_fullsized":"2024-08-31T04:24:33.904791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904954+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:24:34.904954+0000","last_peered":"2024-08-31T04:24:34.904954+0000","last_clean":"2024-08-31T04:24:34.904954+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:24:34.904954+0000","last_undegraded":"2024-08-31T04:24:34.904954+0000","last_fullsized":"2024-08-31T04:24:34.904954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899543+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:24:34.899543+0000","last_peered":"2024-08-31T04:24:34.899543+0000","last_clean":"2024-08-31T04:24:34.899543+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:24:34.899543+0000","last_undegraded":"2024-08-31T04:24:34.899543+0000","last_fullsized":"2024-08-31T04:24:34.899543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367007+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:23:34.367007+0000","last_peered":"2024-08-31T04:23:34.367007+0000","last_clean":"2024-08-31T04:23:34.367007+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:23:34.367007+0000","last_undegraded":"2024-08-31T04:23:34.367007+0000","last_fullsized":"2024-08-31T04:23:34.367007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904117+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:24:34.904117+0000","last_peered":"2024-08-31T04:24:34.904117+0000","last_clean":"2024-08-31T04:24:34.904117+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:24:34.904117+0000","last_undegraded":"2024-08-31T04:24:34.904117+0000","last_fullsized":"2024-08-31T04:24:34.904117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903380+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:24:34.903380+0000","last_peered":"2024-08-31T04:24:34.903380+0000","last_clean":"2024-08-31T04:24:34.903380+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:24:34.903380+0000","last_undegraded":"2024-08-31T04:24:34.903380+0000","last_fullsized":"2024-08-31T04:24:34.903380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367508+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:23:34.367508+0000","last_peered":"2024-08-31T04:23:34.367508+0000","last_clean":"2024-08-31T04:23:34.367508+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:23:34.367508+0000","last_undegraded":"2024-08-31T04:23:34.367508+0000","last_fullsized":"2024-08-31T04:23:34.367508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902825+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:24:34.902825+0000","last_peered":"2024-08-31T04:24:34.902825+0000","last_clean":"2024-08-31T04:24:34.902825+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:24:34.902825+0000","last_undegraded":"2024-08-31T04:24:34.902825+0000","last_fullsized":"2024-08-31T04:24:34.902825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.376991+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:23:34.376991+0000","last_peered":"2024-08-31T04:23:34.376991+0000","last_clean":"2024-08-31T04:23:34.376991+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:23:34.376991+0000","last_undegraded":"2024-08-31T04:23:34.376991+0000","last_fullsized":"2024-08-31T04:23:34.376991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370111+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:23:34.370111+0000","last_peered":"2024-08-31T04:23:34.370111+0000","last_clean":"2024-08-31T04:23:34.370111+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:23:34.370111+0000","last_undegraded":"2024-08-31T04:23:34.370111+0000","last_fullsized":"2024-08-31T04:23:34.370111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899425+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:24:34.899425+0000","last_peered":"2024-08-31T04:24:34.899425+0000","last_clean":"2024-08-31T04:24:34.899425+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:24:34.899425+0000","last_undegraded":"2024-08-31T04:24:34.899425+0000","last_fullsized":"2024-08-31T04:24:34.899425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902899+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:24:34.902899+0000","last_peered":"2024-08-31T04:24:34.902899+0000","last_clean":"2024-08-31T04:24:34.902899+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:24:34.902899+0000","last_undegraded":"2024-08-31T04:24:34.902899+0000","last_fullsized":"2024-08-31T04:24:34.902899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163355+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:24:35.163355+0000","last_peered":"2024-08-31T04:24:35.163355+0000","last_clean":"2024-08-31T04:24:35.163355+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:24:35.163355+0000","last_undegraded":"2024-08-31T04:24:35.163355+0000","last_fullsized":"2024-08-31T04:24:35.163355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176164+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:24:35.176164+0000","last_peered":"2024-08-31T04:24:35.176164+0000","last_clean":"2024-08-31T04:24:35.176164+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:24:35.176164+0000","last_undegraded":"2024-08-31T04:24:35.176164+0000","last_fullsized":"2024-08-31T04:24:35.176164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.165355+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:24:35.165355+0000","last_peered":"2024-08-31T04:24:35.165355+0000","last_clean":"2024-08-31T04:24:35.165355+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:24:35.165355+0000","last_undegraded":"2024-08-31T04:24:35.165355+0000","last_fullsized":"2024-08-31T04:24:35.165355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902850+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:24:33.902850+0000","last_peered":"2024-08-31T04:24:33.902850+0000","last_clean":"2024-08-31T04:24:33.902850+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:24:33.902850+0000","last_undegraded":"2024-08-31T04:24:33.902850+0000","last_fullsized":"2024-08-31T04:24:33.902850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162846+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:24:35.162846+0000","last_peered":"2024-08-31T04:24:35.162846+0000","last_clean":"2024-08-31T04:24:35.162846+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:24:35.162846+0000","last_undegraded":"2024-08-31T04:24:35.162846+0000","last_fullsized":"2024-08-31T04:24:35.162846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175550+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:24:35.175550+0000","last_peered":"2024-08-31T04:24:35.175550+0000","last_clean":"2024-08-31T04:24:35.175550+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:24:35.175550+0000","last_undegraded":"2024-08-31T04:24:35.175550+0000","last_fullsized":"2024-08-31T04:24:35.175550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902441+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:24:33.902441+0000","last_peered":"2024-08-31T04:24:33.902441+0000","last_clean":"2024-08-31T04:24:33.902441+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:24:33.902441+0000","last_undegraded":"2024-08-31T04:24:33.902441+0000","last_fullsized":"2024-08-31T04:24:33.902441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903035+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:24:34.903035+0000","last_peered":"2024-08-31T04:24:34.903035+0000","last_clean":"2024-08-31T04:24:34.903035+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:24:34.903035+0000","last_undegraded":"2024-08-31T04:24:34.903035+0000","last_fullsized":"2024-08-31T04:24:34.903035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369435+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:23:34.369435+0000","last_peered":"2024-08-31T04:23:34.369435+0000","last_clean":"2024-08-31T04:23:34.369435+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:23:34.369435+0000","last_undegraded":"2024-08-31T04:23:34.369435+0000","last_fullsized":"2024-08-31T04:23:34.369435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369592+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:23:34.369592+0000","last_peered":"2024-08-31T04:23:34.369592+0000","last_clean":"2024-08-31T04:23:34.369592+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:23:34.369592+0000","last_undegraded":"2024-08-31T04:23:34.369592+0000","last_fullsized":"2024-08-31T04:23:34.369592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367487+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:23:34.367487+0000","last_peered":"2024-08-31T04:23:34.367487+0000","last_clean":"2024-08-31T04:23:34.367487+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:23:34.367487+0000","last_undegraded":"2024-08-31T04:23:34.367487+0000","last_fullsized":"2024-08-31T04:23:34.367487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":368,"num_read_kb":256,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":481736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1667072,"data_stored":1152872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103210,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":495129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299439,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":490371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1568768,"data_stored":1086274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1092282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":502677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":486403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":560715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":561151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:24:38.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:24:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:38.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:37 smithi064 ceph-mon[22007]: pgmap v315: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:38.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:37 smithi064 ceph-mon[22007]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:37 smithi132 ceph-mon[22335]: pgmap v315: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:38.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:37 smithi132 ceph-mon[22335]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:38.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:37 smithi002 ceph-mon[18656]: pgmap v315: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:38.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:37 smithi002 ceph-mon[18656]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- 172.21.15.2:0/3551898489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac041047d0 msgr2=0x7fac04104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3551898489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac041047d0 0x7fac04104be0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fac00009900 tx=0x7fac0002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- 172.21.15.2:0/3551898489 shutdown_connections 2024-08-31T04:24:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3551898489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac0410dc30 0x7fac04110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3551898489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac04105120 0x7fac0410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3551898489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac041047d0 0x7fac04104be0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- 172.21.15.2:0/3551898489 >> 172.21.15.2:0/3551898489 conn(0x7fac04079510 msgr2=0x7fac04079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- 172.21.15.2:0/3551898489 shutdown_connections 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- 172.21.15.2:0/3551898489 wait complete. 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 Processor -- start 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.809+0000 7fac0c42d640 1 -- start start 2024-08-31T04:24:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 0x7fac04102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac0410dc30 0x7fac04102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac04113890 con 0x7fac04105120 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac04113710 con 0x7fac041047d0 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0c42d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac04113a10 con 0x7fac0410dc30 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55184/0 (socket says 172.21.15.2:55184) 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 -- 172.21.15.2:0/3497914703 learned_addr learned my addr 172.21.15.2:0/3497914703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0a1c9640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 0x7fac04102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0a9ca640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac0410dc30 0x7fac04102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 -- 172.21.15.2:0/3497914703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac0410dc30 msgr2=0x7fac04102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac0410dc30 0x7fac04102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 -- 172.21.15.2:0/3497914703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 msgr2=0x7fac04102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 0x7fac04102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 -- 172.21.15.2:0/3497914703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac041a84b0 con 0x7fac04105120 2024-08-31T04:24:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac0a1c9640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 0x7fac04102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.810+0000 7fac099c8640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c8c0 tx=0x7fabf400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.811+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4007bb0 con 0x7fac04105120 2024-08-31T04:24:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.811+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabf4007d50 con 0x7fac04105120 2024-08-31T04:24:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.811+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac041a87a0 con 0x7fac04105120 2024-08-31T04:24:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.811+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40187c0 con 0x7fac04105120 2024-08-31T04:24:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.811+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac041a8ce0 con 0x7fac04105120 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.812+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0406c000 con 0x7fac04105120 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.814+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fabf400fa20 con 0x7fac04105120 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.815+0000 7fabfb7fe640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 0x7fabf00b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.815+0000 7fac0a1c9640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 0x7fabf00b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.815+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fabf40e5b80 con 0x7fac04105120 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.816+0000 7fac0a1c9640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 0x7fabf00b7270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac00000c00 tx=0x7fac00009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:38.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.818+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fabf4014030 con 0x7fac04105120 2024-08-31T04:24:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:38.999+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac040635a0 con 0x7fabf00b4d60 2024-08-31T04:24:39.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.005+0000 7fabfb7fe640 1 -- 172.21.15.2:0/3497914703 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340248 (secure 0 0 0) 0x7fac040635a0 con 0x7fabf00b4d60 2024-08-31T04:24:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 msgr2=0x7fabf00b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 0x7fabf00b7270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac00000c00 tx=0x7fac00009680 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 msgr2=0x7fac04102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c8c0 tx=0x7fabf400cd80 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 shutdown_connections 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabf00b4d60 0x7fabf00b7270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac04105120 0x7fac04102a50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac0410dc30 0x7fac04102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 --2- 172.21.15.2:0/3497914703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac041047d0 0x7fac04102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 >> 172.21.15.2:0/3497914703 conn(0x7fac04079510 msgr2=0x7fac041005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 shutdown_connections 2024-08-31T04:24:39.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:39.008+0000 7fac0c42d640 1 -- 172.21.15.2:0/3497914703 wait complete. 2024-08-31T04:24:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-08-31T04:24:37.090630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":449,"num_read_kb":325,"num_write":296,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404344,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537480,"statfs":{"total":1151940427776,"available":1151526379520,"internally_reserved":0,"allocated":13762560,"data_stored":7883174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002694"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903727+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903727+0000","last_peered":"2024-08-31T04:24:34.903727+0000","last_clean":"2024-08-31T04:24:34.903727+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903727+0000","last_undegraded":"2024-08-31T04:24:34.903727+0000","last_fullsized":"2024-08-31T04:24:34.903727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903553+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:24:33.903553+0000","last_peered":"2024-08-31T04:24:33.903553+0000","last_clean":"2024-08-31T04:24:33.903553+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:24:33.903553+0000","last_undegraded":"2024-08-31T04:24:33.903553+0000","last_fullsized":"2024-08-31T04:24:33.903553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905768+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:33.905768+0000","last_peered":"2024-08-31T04:24:33.905768+0000","last_clean":"2024-08-31T04:24:33.905768+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:33.905768+0000","last_undegraded":"2024-08-31T04:24:33.905768+0000","last_fullsized":"2024-08-31T04:24:33.905768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369945+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:23:34.369945+0000","last_peered":"2024-08-31T04:23:34.369945+0000","last_clean":"2024-08-31T04:23:34.369945+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:23:34.369945+0000","last_undegraded":"2024-08-31T04:23:34.369945+0000","last_fullsized":"2024-08-31T04:23:34.369945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902996+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:33.902996+0000","last_peered":"2024-08-31T04:24:33.902996+0000","last_clean":"2024-08-31T04:24:33.902996+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:33.902996+0000","last_undegraded":"2024-08-31T04:24:33.902996+0000","last_fullsized":"2024-08-31T04:24:33.902996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903985+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:24:34.903985+0000","last_peered":"2024-08-31T04:24:34.903985+0000","last_clean":"2024-08-31T04:24:34.903985+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:24:34.903985+0000","last_undegraded":"2024-08-31T04:24:34.903985+0000","last_fullsized":"2024-08-31T04:24:34.903985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903147+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:33.903147+0000","last_peered":"2024-08-31T04:24:33.903147+0000","last_clean":"2024-08-31T04:24:33.903147+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:33.903147+0000","last_undegraded":"2024-08-31T04:24:33.903147+0000","last_fullsized":"2024-08-31T04:24:33.903147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902128+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:24:34.902128+0000","last_peered":"2024-08-31T04:24:34.902128+0000","last_clean":"2024-08-31T04:24:34.902128+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:24:34.902128+0000","last_undegraded":"2024-08-31T04:24:34.902128+0000","last_fullsized":"2024-08-31T04:24:34.902128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162940+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:24:35.162940+0000","last_peered":"2024-08-31T04:24:35.162940+0000","last_clean":"2024-08-31T04:24:35.162940+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:24:35.162940+0000","last_undegraded":"2024-08-31T04:24:35.162940+0000","last_fullsized":"2024-08-31T04:24:35.162940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902549+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:33.902549+0000","last_peered":"2024-08-31T04:24:33.902549+0000","last_clean":"2024-08-31T04:24:33.902549+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:33.902549+0000","last_undegraded":"2024-08-31T04:24:33.902549+0000","last_fullsized":"2024-08-31T04:24:33.902549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902903+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902903+0000","last_peered":"2024-08-31T04:24:34.902903+0000","last_clean":"2024-08-31T04:24:34.902903+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902903+0000","last_undegraded":"2024-08-31T04:24:34.902903+0000","last_fullsized":"2024-08-31T04:24:34.902903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902849+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:24:33.902849+0000","last_peered":"2024-08-31T04:24:33.902849+0000","last_clean":"2024-08-31T04:24:33.902849+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:24:33.902849+0000","last_undegraded":"2024-08-31T04:24:33.902849+0000","last_fullsized":"2024-08-31T04:24:33.902849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903339+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903339+0000","last_peered":"2024-08-31T04:24:34.903339+0000","last_clean":"2024-08-31T04:24:34.903339+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903339+0000","last_undegraded":"2024-08-31T04:24:34.903339+0000","last_fullsized":"2024-08-31T04:24:34.903339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902737+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902737+0000","last_peered":"2024-08-31T04:24:34.902737+0000","last_clean":"2024-08-31T04:24:34.902737+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902737+0000","last_undegraded":"2024-08-31T04:24:34.902737+0000","last_fullsized":"2024-08-31T04:24:34.902737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366977+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:23:34.366977+0000","last_peered":"2024-08-31T04:23:34.366977+0000","last_clean":"2024-08-31T04:23:34.366977+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:23:34.366977+0000","last_undegraded":"2024-08-31T04:23:34.366977+0000","last_fullsized":"2024-08-31T04:23:34.366977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904990+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:33.904990+0000","last_peered":"2024-08-31T04:24:33.904990+0000","last_clean":"2024-08-31T04:24:33.904990+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:33.904990+0000","last_undegraded":"2024-08-31T04:24:33.904990+0000","last_fullsized":"2024-08-31T04:24:33.904990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903317+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903317+0000","last_peered":"2024-08-31T04:24:34.903317+0000","last_clean":"2024-08-31T04:24:34.903317+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903317+0000","last_undegraded":"2024-08-31T04:24:34.903317+0000","last_fullsized":"2024-08-31T04:24:34.903317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903081+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:24:33.903081+0000","last_peered":"2024-08-31T04:24:33.903081+0000","last_clean":"2024-08-31T04:24:33.903081+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:24:33.903081+0000","last_undegraded":"2024-08-31T04:24:33.903081+0000","last_fullsized":"2024-08-31T04:24:33.903081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903872+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903872+0000","last_peered":"2024-08-31T04:24:34.903872+0000","last_clean":"2024-08-31T04:24:34.903872+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903872+0000","last_undegraded":"2024-08-31T04:24:34.903872+0000","last_fullsized":"2024-08-31T04:24:34.903872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902455+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902455+0000","last_peered":"2024-08-31T04:24:34.902455+0000","last_clean":"2024-08-31T04:24:34.902455+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902455+0000","last_undegraded":"2024-08-31T04:24:34.902455+0000","last_fullsized":"2024-08-31T04:24:34.902455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369702+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:23:34.369702+0000","last_peered":"2024-08-31T04:23:34.369702+0000","last_clean":"2024-08-31T04:23:34.369702+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:23:34.369702+0000","last_undegraded":"2024-08-31T04:23:34.369702+0000","last_fullsized":"2024-08-31T04:23:34.369702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903158+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903158+0000","last_peered":"2024-08-31T04:24:34.903158+0000","last_clean":"2024-08-31T04:24:34.903158+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903158+0000","last_undegraded":"2024-08-31T04:24:34.903158+0000","last_fullsized":"2024-08-31T04:24:34.903158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903836+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903836+0000","last_peered":"2024-08-31T04:24:34.903836+0000","last_clean":"2024-08-31T04:24:34.903836+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903836+0000","last_undegraded":"2024-08-31T04:24:34.903836+0000","last_fullsized":"2024-08-31T04:24:34.903836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":5,"reported_epoch":85,"state":"activating","last_fresh":"2024-08-31T04:24:35.066409+0000","last_change":"2024-08-31T04:24:34.903494+0000","last_active":"2024-08-31T04:24:34.903280+0000","last_peered":"2024-08-31T04:23:34.495302+0000","last_clean":"2024-08-31T04:23:34.495302+0000","last_became_active":"2024-08-31T04:22:57.250958+0000","last_became_peered":"2024-08-31T04:22:57.250958+0000","last_unstale":"2024-08-31T04:24:35.066409+0000","last_undegraded":"2024-08-31T04:24:35.066409+0000","last_fullsized":"2024-08-31T04:24:35.066409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":["9","3","7","11"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903383+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:24:34.903383+0000","last_peered":"2024-08-31T04:24:34.903383+0000","last_clean":"2024-08-31T04:24:34.903383+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:24:34.903383+0000","last_undegraded":"2024-08-31T04:24:34.903383+0000","last_fullsized":"2024-08-31T04:24:34.903383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902747+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:33.902747+0000","last_peered":"2024-08-31T04:24:33.902747+0000","last_clean":"2024-08-31T04:24:33.902747+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:33.902747+0000","last_undegraded":"2024-08-31T04:24:33.902747+0000","last_fullsized":"2024-08-31T04:24:33.902747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899720+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:24:34.899720+0000","last_peered":"2024-08-31T04:24:34.899720+0000","last_clean":"2024-08-31T04:24:34.899720+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:24:34.899720+0000","last_undegraded":"2024-08-31T04:24:34.899720+0000","last_fullsized":"2024-08-31T04:24:34.899720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903133+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:33.903133+0000","last_peered":"2024-08-31T04:24:33.903133+0000","last_clean":"2024-08-31T04:24:33.903133+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:33.903133+0000","last_undegraded":"2024-08-31T04:24:33.903133+0000","last_fullsized":"2024-08-31T04:24:33.903133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367104+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:23:34.367104+0000","last_peered":"2024-08-31T04:23:34.367104+0000","last_clean":"2024-08-31T04:23:34.367104+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:23:34.367104+0000","last_undegraded":"2024-08-31T04:23:34.367104+0000","last_fullsized":"2024-08-31T04:23:34.367104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175761+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:24:35.175761+0000","last_peered":"2024-08-31T04:24:35.175761+0000","last_clean":"2024-08-31T04:24:35.175761+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:24:35.175761+0000","last_undegraded":"2024-08-31T04:24:35.175761+0000","last_fullsized":"2024-08-31T04:24:35.175761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903204+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903204+0000","last_peered":"2024-08-31T04:24:34.903204+0000","last_clean":"2024-08-31T04:24:34.903204+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903204+0000","last_undegraded":"2024-08-31T04:24:34.903204+0000","last_fullsized":"2024-08-31T04:24:34.903204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902897+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:33.902897+0000","last_peered":"2024-08-31T04:24:33.902897+0000","last_clean":"2024-08-31T04:24:33.902897+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:33.902897+0000","last_undegraded":"2024-08-31T04:24:33.902897+0000","last_fullsized":"2024-08-31T04:24:33.902897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175688+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:24:35.175688+0000","last_peered":"2024-08-31T04:24:35.175688+0000","last_clean":"2024-08-31T04:24:35.175688+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:24:35.175688+0000","last_undegraded":"2024-08-31T04:24:35.175688+0000","last_fullsized":"2024-08-31T04:24:35.175688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163308+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163308+0000","last_peered":"2024-08-31T04:24:35.163308+0000","last_clean":"2024-08-31T04:24:35.163308+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163308+0000","last_undegraded":"2024-08-31T04:24:35.163308+0000","last_fullsized":"2024-08-31T04:24:35.163308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899462+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899462+0000","last_peered":"2024-08-31T04:24:34.899462+0000","last_clean":"2024-08-31T04:24:34.899462+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899462+0000","last_undegraded":"2024-08-31T04:24:34.899462+0000","last_fullsized":"2024-08-31T04:24:34.899462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.909200+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:24:34.909200+0000","last_peered":"2024-08-31T04:24:34.909200+0000","last_clean":"2024-08-31T04:24:34.909200+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:24:34.909200+0000","last_undegraded":"2024-08-31T04:24:34.909200+0000","last_fullsized":"2024-08-31T04:24:34.909200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899274+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:24:34.899274+0000","last_peered":"2024-08-31T04:24:34.899274+0000","last_clean":"2024-08-31T04:24:34.899274+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:24:34.899274+0000","last_undegraded":"2024-08-31T04:24:34.899274+0000","last_fullsized":"2024-08-31T04:24:34.899274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899665+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899665+0000","last_peered":"2024-08-31T04:24:34.899665+0000","last_clean":"2024-08-31T04:24:34.899665+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899665+0000","last_undegraded":"2024-08-31T04:24:34.899665+0000","last_fullsized":"2024-08-31T04:24:34.899665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899079+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:24:34.899079+0000","last_peered":"2024-08-31T04:24:34.899079+0000","last_clean":"2024-08-31T04:24:34.899079+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:24:34.899079+0000","last_undegraded":"2024-08-31T04:24:34.899079+0000","last_fullsized":"2024-08-31T04:24:34.899079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162741+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.162741+0000","last_peered":"2024-08-31T04:24:35.162741+0000","last_clean":"2024-08-31T04:24:35.162741+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.162741+0000","last_undegraded":"2024-08-31T04:24:35.162741+0000","last_fullsized":"2024-08-31T04:24:35.162741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902421+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902421+0000","last_peered":"2024-08-31T04:24:34.902421+0000","last_clean":"2024-08-31T04:24:34.902421+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902421+0000","last_undegraded":"2024-08-31T04:24:34.902421+0000","last_fullsized":"2024-08-31T04:24:34.902421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903751+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:24:33.903751+0000","last_peered":"2024-08-31T04:24:33.903751+0000","last_clean":"2024-08-31T04:24:33.903751+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:24:33.903751+0000","last_undegraded":"2024-08-31T04:24:33.903751+0000","last_fullsized":"2024-08-31T04:24:33.903751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902599+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902599+0000","last_peered":"2024-08-31T04:24:34.902599+0000","last_clean":"2024-08-31T04:24:34.902599+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902599+0000","last_undegraded":"2024-08-31T04:24:34.902599+0000","last_fullsized":"2024-08-31T04:24:34.902599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162974+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.162974+0000","last_peered":"2024-08-31T04:24:35.162974+0000","last_clean":"2024-08-31T04:24:35.162974+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.162974+0000","last_undegraded":"2024-08-31T04:24:35.162974+0000","last_fullsized":"2024-08-31T04:24:35.162974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163451+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:24:35.163451+0000","last_peered":"2024-08-31T04:24:35.163451+0000","last_clean":"2024-08-31T04:24:35.163451+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:24:35.163451+0000","last_undegraded":"2024-08-31T04:24:35.163451+0000","last_fullsized":"2024-08-31T04:24:35.163451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904175+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904175+0000","last_peered":"2024-08-31T04:24:34.904175+0000","last_clean":"2024-08-31T04:24:34.904175+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904175+0000","last_undegraded":"2024-08-31T04:24:34.904175+0000","last_fullsized":"2024-08-31T04:24:34.904175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163017+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:24:35.163017+0000","last_peered":"2024-08-31T04:24:35.163017+0000","last_clean":"2024-08-31T04:24:35.163017+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:24:35.163017+0000","last_undegraded":"2024-08-31T04:24:35.163017+0000","last_fullsized":"2024-08-31T04:24:35.163017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902460+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902460+0000","last_peered":"2024-08-31T04:24:34.902460+0000","last_clean":"2024-08-31T04:24:34.902460+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902460+0000","last_undegraded":"2024-08-31T04:24:34.902460+0000","last_fullsized":"2024-08-31T04:24:34.902460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369551+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:23:34.369551+0000","last_peered":"2024-08-31T04:23:34.369551+0000","last_clean":"2024-08-31T04:23:34.369551+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:23:34.369551+0000","last_undegraded":"2024-08-31T04:23:34.369551+0000","last_fullsized":"2024-08-31T04:23:34.369551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163666+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:24:35.163666+0000","last_peered":"2024-08-31T04:24:35.163666+0000","last_clean":"2024-08-31T04:24:35.163666+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:24:35.163666+0000","last_undegraded":"2024-08-31T04:24:35.163666+0000","last_fullsized":"2024-08-31T04:24:35.163666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899735+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899735+0000","last_peered":"2024-08-31T04:24:34.899735+0000","last_clean":"2024-08-31T04:24:34.899735+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899735+0000","last_undegraded":"2024-08-31T04:24:34.899735+0000","last_fullsized":"2024-08-31T04:24:34.899735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900596+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900596+0000","last_peered":"2024-08-31T04:24:34.900596+0000","last_clean":"2024-08-31T04:24:34.900596+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900596+0000","last_undegraded":"2024-08-31T04:24:34.900596+0000","last_fullsized":"2024-08-31T04:24:34.900596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367139+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:23:34.367139+0000","last_peered":"2024-08-31T04:23:34.367139+0000","last_clean":"2024-08-31T04:23:34.367139+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:23:34.367139+0000","last_undegraded":"2024-08-31T04:23:34.367139+0000","last_fullsized":"2024-08-31T04:23:34.367139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904048+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:24:33.904048+0000","last_peered":"2024-08-31T04:24:33.904048+0000","last_clean":"2024-08-31T04:24:33.904048+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:24:33.904048+0000","last_undegraded":"2024-08-31T04:24:33.904048+0000","last_fullsized":"2024-08-31T04:24:33.904048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900723+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900723+0000","last_peered":"2024-08-31T04:24:34.900723+0000","last_clean":"2024-08-31T04:24:34.900723+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900723+0000","last_undegraded":"2024-08-31T04:24:34.900723+0000","last_fullsized":"2024-08-31T04:24:34.900723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901214+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:24:34.901214+0000","last_peered":"2024-08-31T04:24:34.901214+0000","last_clean":"2024-08-31T04:24:34.901214+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:24:34.901214+0000","last_undegraded":"2024-08-31T04:24:34.901214+0000","last_fullsized":"2024-08-31T04:24:34.901214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902567+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:33.902567+0000","last_peered":"2024-08-31T04:24:33.902567+0000","last_clean":"2024-08-31T04:24:33.902567+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:33.902567+0000","last_undegraded":"2024-08-31T04:24:33.902567+0000","last_fullsized":"2024-08-31T04:24:33.902567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162525+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:24:35.162525+0000","last_peered":"2024-08-31T04:24:35.162525+0000","last_clean":"2024-08-31T04:24:35.162525+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:24:35.162525+0000","last_undegraded":"2024-08-31T04:24:35.162525+0000","last_fullsized":"2024-08-31T04:24:35.162525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.516303+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:24:35.516303+0000","last_peered":"2024-08-31T04:24:35.516303+0000","last_clean":"2024-08-31T04:24:35.516303+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:24:35.516303+0000","last_undegraded":"2024-08-31T04:24:35.516303+0000","last_fullsized":"2024-08-31T04:24:35.516303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":2,"reported_epoch":84,"state":"peering","last_fresh":"2024-08-31T04:23:04.268077+0000","last_change":"2024-08-31T04:24:34.098165+0000","last_active":"2024-08-31T04:23:03.258282+0000","last_peered":"2024-08-31T04:23:03.258282+0000","last_clean":"2024-08-31T04:23:03.258282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-31T04:23:04.268077+0000","last_undegraded":"2024-08-31T04:23:04.268077+0000","last_fullsized":"2024-08-31T04:23:04.268077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163003+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:24:35.163003+0000","last_peered":"2024-08-31T04:24:35.163003+0000","last_clean":"2024-08-31T04:24:35.163003+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:24:35.163003+0000","last_undegraded":"2024-08-31T04:24:35.163003+0000","last_fullsized":"2024-08-31T04:24:35.163003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901294+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901294+0000","last_peered":"2024-08-31T04:24:34.901294+0000","last_clean":"2024-08-31T04:24:34.901294+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901294+0000","last_undegraded":"2024-08-31T04:24:34.901294+0000","last_fullsized":"2024-08-31T04:24:34.901294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367016+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:23:34.367016+0000","last_peered":"2024-08-31T04:23:34.367016+0000","last_clean":"2024-08-31T04:23:34.367016+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:23:34.367016+0000","last_undegraded":"2024-08-31T04:23:34.367016+0000","last_fullsized":"2024-08-31T04:23:34.367016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164616+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:24:35.164616+0000","last_peered":"2024-08-31T04:24:35.164616+0000","last_clean":"2024-08-31T04:24:35.164616+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:24:35.164616+0000","last_undegraded":"2024-08-31T04:24:35.164616+0000","last_fullsized":"2024-08-31T04:24:35.164616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903598+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903598+0000","last_peered":"2024-08-31T04:24:34.903598+0000","last_clean":"2024-08-31T04:24:34.903598+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903598+0000","last_undegraded":"2024-08-31T04:24:34.903598+0000","last_fullsized":"2024-08-31T04:24:34.903598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902763+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:24:33.902763+0000","last_peered":"2024-08-31T04:24:33.902763+0000","last_clean":"2024-08-31T04:24:33.902763+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:24:33.902763+0000","last_undegraded":"2024-08-31T04:24:33.902763+0000","last_fullsized":"2024-08-31T04:24:33.902763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":195,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515228+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:24:35.515228+0000","last_peered":"2024-08-31T04:24:35.515228+0000","last_clean":"2024-08-31T04:24:35.515228+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:24:35.515228+0000","last_undegraded":"2024-08-31T04:24:35.515228+0000","last_fullsized":"2024-08-31T04:24:35.515228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":124,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902970+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.902970+0000","last_peered":"2024-08-31T04:24:34.902970+0000","last_clean":"2024-08-31T04:24:34.902970+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.902970+0000","last_undegraded":"2024-08-31T04:24:34.902970+0000","last_fullsized":"2024-08-31T04:24:34.902970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904119+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:24:34.904119+0000","last_peered":"2024-08-31T04:24:34.904119+0000","last_clean":"2024-08-31T04:24:34.904119+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:24:34.904119+0000","last_undegraded":"2024-08-31T04:24:34.904119+0000","last_fullsized":"2024-08-31T04:24:34.904119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902335+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902335+0000","last_peered":"2024-08-31T04:24:34.902335+0000","last_clean":"2024-08-31T04:24:34.902335+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902335+0000","last_undegraded":"2024-08-31T04:24:34.902335+0000","last_fullsized":"2024-08-31T04:24:34.902335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177602+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.177602+0000","last_peered":"2024-08-31T04:24:35.177602+0000","last_clean":"2024-08-31T04:24:35.177602+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.177602+0000","last_undegraded":"2024-08-31T04:24:35.177602+0000","last_fullsized":"2024-08-31T04:24:35.177602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369989+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:23:34.369989+0000","last_peered":"2024-08-31T04:23:34.369989+0000","last_clean":"2024-08-31T04:23:34.369989+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:23:34.369989+0000","last_undegraded":"2024-08-31T04:23:34.369989+0000","last_fullsized":"2024-08-31T04:23:34.369989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163405+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163405+0000","last_peered":"2024-08-31T04:24:35.163405+0000","last_clean":"2024-08-31T04:24:35.163405+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163405+0000","last_undegraded":"2024-08-31T04:24:35.163405+0000","last_fullsized":"2024-08-31T04:24:35.163405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902696+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902696+0000","last_peered":"2024-08-31T04:24:34.902696+0000","last_clean":"2024-08-31T04:24:34.902696+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902696+0000","last_undegraded":"2024-08-31T04:24:34.902696+0000","last_fullsized":"2024-08-31T04:24:34.902696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.905097+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:24:34.905097+0000","last_peered":"2024-08-31T04:24:34.905097+0000","last_clean":"2024-08-31T04:24:34.905097+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:24:34.905097+0000","last_undegraded":"2024-08-31T04:24:34.905097+0000","last_fullsized":"2024-08-31T04:24:34.905097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176117+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:24:35.176117+0000","last_peered":"2024-08-31T04:24:35.176117+0000","last_clean":"2024-08-31T04:24:35.176117+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:24:35.176117+0000","last_undegraded":"2024-08-31T04:24:35.176117+0000","last_fullsized":"2024-08-31T04:24:35.176117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904605+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:33.904605+0000","last_peered":"2024-08-31T04:24:33.904605+0000","last_clean":"2024-08-31T04:24:33.904605+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:33.904605+0000","last_undegraded":"2024-08-31T04:24:33.904605+0000","last_fullsized":"2024-08-31T04:24:33.904605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369477+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:23:34.369477+0000","last_peered":"2024-08-31T04:23:34.369477+0000","last_clean":"2024-08-31T04:23:34.369477+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:23:34.369477+0000","last_undegraded":"2024-08-31T04:23:34.369477+0000","last_fullsized":"2024-08-31T04:23:34.369477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902852+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:24:34.902852+0000","last_peered":"2024-08-31T04:24:34.902852+0000","last_clean":"2024-08-31T04:24:34.902852+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:24:34.902852+0000","last_undegraded":"2024-08-31T04:24:34.902852+0000","last_fullsized":"2024-08-31T04:24:34.902852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901010+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901010+0000","last_peered":"2024-08-31T04:24:34.901010+0000","last_clean":"2024-08-31T04:24:34.901010+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901010+0000","last_undegraded":"2024-08-31T04:24:34.901010+0000","last_fullsized":"2024-08-31T04:24:34.901010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367211+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:23:34.367211+0000","last_peered":"2024-08-31T04:23:34.367211+0000","last_clean":"2024-08-31T04:23:34.367211+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:23:34.367211+0000","last_undegraded":"2024-08-31T04:23:34.367211+0000","last_fullsized":"2024-08-31T04:23:34.367211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902892+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:24:33.902892+0000","last_peered":"2024-08-31T04:24:33.902892+0000","last_clean":"2024-08-31T04:24:33.902892+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:24:33.902892+0000","last_undegraded":"2024-08-31T04:24:33.902892+0000","last_fullsized":"2024-08-31T04:24:33.902892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899145+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899145+0000","last_peered":"2024-08-31T04:24:34.899145+0000","last_clean":"2024-08-31T04:24:34.899145+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899145+0000","last_undegraded":"2024-08-31T04:24:34.899145+0000","last_fullsized":"2024-08-31T04:24:34.899145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175580+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175580+0000","last_peered":"2024-08-31T04:24:35.175580+0000","last_clean":"2024-08-31T04:24:35.175580+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175580+0000","last_undegraded":"2024-08-31T04:24:35.175580+0000","last_fullsized":"2024-08-31T04:24:35.175580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.925663+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:24:34.925663+0000","last_peered":"2024-08-31T04:24:34.925663+0000","last_clean":"2024-08-31T04:24:34.925663+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:24:34.925663+0000","last_undegraded":"2024-08-31T04:24:34.925663+0000","last_fullsized":"2024-08-31T04:24:34.925663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515972+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:24:35.515972+0000","last_peered":"2024-08-31T04:24:35.515972+0000","last_clean":"2024-08-31T04:24:35.515972+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:24:35.515972+0000","last_undegraded":"2024-08-31T04:24:35.515972+0000","last_fullsized":"2024-08-31T04:24:35.515972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903288+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:24:33.903288+0000","last_peered":"2024-08-31T04:24:33.903288+0000","last_clean":"2024-08-31T04:24:33.903288+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:24:33.903288+0000","last_undegraded":"2024-08-31T04:24:33.903288+0000","last_fullsized":"2024-08-31T04:24:33.903288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.366880+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:23:34.366880+0000","last_peered":"2024-08-31T04:23:34.366880+0000","last_clean":"2024-08-31T04:23:34.366880+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:23:34.366880+0000","last_undegraded":"2024-08-31T04:23:34.366880+0000","last_fullsized":"2024-08-31T04:23:34.366880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.911653+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:24:34.911653+0000","last_peered":"2024-08-31T04:24:34.911653+0000","last_clean":"2024-08-31T04:24:34.911653+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:24:34.911653+0000","last_undegraded":"2024-08-31T04:24:34.911653+0000","last_fullsized":"2024-08-31T04:24:34.911653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903193+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:24:34.903193+0000","last_peered":"2024-08-31T04:24:34.903193+0000","last_clean":"2024-08-31T04:24:34.903193+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:24:34.903193+0000","last_undegraded":"2024-08-31T04:24:34.903193+0000","last_fullsized":"2024-08-31T04:24:34.903193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369671+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:23:34.369671+0000","last_peered":"2024-08-31T04:23:34.369671+0000","last_clean":"2024-08-31T04:23:34.369671+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:23:34.369671+0000","last_undegraded":"2024-08-31T04:23:34.369671+0000","last_fullsized":"2024-08-31T04:23:34.369671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899594+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:24:34.899594+0000","last_peered":"2024-08-31T04:24:34.899594+0000","last_clean":"2024-08-31T04:24:34.899594+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:24:34.899594+0000","last_undegraded":"2024-08-31T04:24:34.899594+0000","last_fullsized":"2024-08-31T04:24:34.899594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367262+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:23:34.367262+0000","last_peered":"2024-08-31T04:23:34.367262+0000","last_clean":"2024-08-31T04:23:34.367262+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:23:34.367262+0000","last_undegraded":"2024-08-31T04:23:34.367262+0000","last_fullsized":"2024-08-31T04:23:34.367262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904210+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:24:34.904210+0000","last_peered":"2024-08-31T04:24:34.904210+0000","last_clean":"2024-08-31T04:24:34.904210+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:24:34.904210+0000","last_undegraded":"2024-08-31T04:24:34.904210+0000","last_fullsized":"2024-08-31T04:24:34.904210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905262+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:24:33.905262+0000","last_peered":"2024-08-31T04:24:33.905262+0000","last_clean":"2024-08-31T04:24:33.905262+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:24:33.905262+0000","last_undegraded":"2024-08-31T04:24:33.905262+0000","last_fullsized":"2024-08-31T04:24:33.905262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900794+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:24:34.900794+0000","last_peered":"2024-08-31T04:24:34.900794+0000","last_clean":"2024-08-31T04:24:34.900794+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:24:34.900794+0000","last_undegraded":"2024-08-31T04:24:34.900794+0000","last_fullsized":"2024-08-31T04:24:34.900794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904791+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:24:33.904791+0000","last_peered":"2024-08-31T04:24:33.904791+0000","last_clean":"2024-08-31T04:24:33.904791+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:24:33.904791+0000","last_undegraded":"2024-08-31T04:24:33.904791+0000","last_fullsized":"2024-08-31T04:24:33.904791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904954+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:24:34.904954+0000","last_peered":"2024-08-31T04:24:34.904954+0000","last_clean":"2024-08-31T04:24:34.904954+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:24:34.904954+0000","last_undegraded":"2024-08-31T04:24:34.904954+0000","last_fullsized":"2024-08-31T04:24:34.904954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899543+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:24:34.899543+0000","last_peered":"2024-08-31T04:24:34.899543+0000","last_clean":"2024-08-31T04:24:34.899543+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:24:34.899543+0000","last_undegraded":"2024-08-31T04:24:34.899543+0000","last_fullsized":"2024-08-31T04:24:34.899543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367007+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:23:34.367007+0000","last_peered":"2024-08-31T04:23:34.367007+0000","last_clean":"2024-08-31T04:23:34.367007+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:23:34.367007+0000","last_undegraded":"2024-08-31T04:23:34.367007+0000","last_fullsized":"2024-08-31T04:23:34.367007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904117+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:24:34.904117+0000","last_peered":"2024-08-31T04:24:34.904117+0000","last_clean":"2024-08-31T04:24:34.904117+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:24:34.904117+0000","last_undegraded":"2024-08-31T04:24:34.904117+0000","last_fullsized":"2024-08-31T04:24:34.904117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903380+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:24:34.903380+0000","last_peered":"2024-08-31T04:24:34.903380+0000","last_clean":"2024-08-31T04:24:34.903380+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:24:34.903380+0000","last_undegraded":"2024-08-31T04:24:34.903380+0000","last_fullsized":"2024-08-31T04:24:34.903380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367508+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:23:34.367508+0000","last_peered":"2024-08-31T04:23:34.367508+0000","last_clean":"2024-08-31T04:23:34.367508+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:23:34.367508+0000","last_undegraded":"2024-08-31T04:23:34.367508+0000","last_fullsized":"2024-08-31T04:23:34.367508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902825+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:24:34.902825+0000","last_peered":"2024-08-31T04:24:34.902825+0000","last_clean":"2024-08-31T04:24:34.902825+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:24:34.902825+0000","last_undegraded":"2024-08-31T04:24:34.902825+0000","last_fullsized":"2024-08-31T04:24:34.902825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.376991+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:23:34.376991+0000","last_peered":"2024-08-31T04:23:34.376991+0000","last_clean":"2024-08-31T04:23:34.376991+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:23:34.376991+0000","last_undegraded":"2024-08-31T04:23:34.376991+0000","last_fullsized":"2024-08-31T04:23:34.376991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.370111+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:23:34.370111+0000","last_peered":"2024-08-31T04:23:34.370111+0000","last_clean":"2024-08-31T04:23:34.370111+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:23:34.370111+0000","last_undegraded":"2024-08-31T04:23:34.370111+0000","last_fullsized":"2024-08-31T04:23:34.370111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899425+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:24:34.899425+0000","last_peered":"2024-08-31T04:24:34.899425+0000","last_clean":"2024-08-31T04:24:34.899425+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:24:34.899425+0000","last_undegraded":"2024-08-31T04:24:34.899425+0000","last_fullsized":"2024-08-31T04:24:34.899425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902899+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:24:34.902899+0000","last_peered":"2024-08-31T04:24:34.902899+0000","last_clean":"2024-08-31T04:24:34.902899+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:24:34.902899+0000","last_undegraded":"2024-08-31T04:24:34.902899+0000","last_fullsized":"2024-08-31T04:24:34.902899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163355+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:24:35.163355+0000","last_peered":"2024-08-31T04:24:35.163355+0000","last_clean":"2024-08-31T04:24:35.163355+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:24:35.163355+0000","last_undegraded":"2024-08-31T04:24:35.163355+0000","last_fullsized":"2024-08-31T04:24:35.163355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176164+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:24:35.176164+0000","last_peered":"2024-08-31T04:24:35.176164+0000","last_clean":"2024-08-31T04:24:35.176164+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:24:35.176164+0000","last_undegraded":"2024-08-31T04:24:35.176164+0000","last_fullsized":"2024-08-31T04:24:35.176164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.165355+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:24:35.165355+0000","last_peered":"2024-08-31T04:24:35.165355+0000","last_clean":"2024-08-31T04:24:35.165355+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:24:35.165355+0000","last_undegraded":"2024-08-31T04:24:35.165355+0000","last_fullsized":"2024-08-31T04:24:35.165355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902850+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:24:33.902850+0000","last_peered":"2024-08-31T04:24:33.902850+0000","last_clean":"2024-08-31T04:24:33.902850+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:24:33.902850+0000","last_undegraded":"2024-08-31T04:24:33.902850+0000","last_fullsized":"2024-08-31T04:24:33.902850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162846+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:24:35.162846+0000","last_peered":"2024-08-31T04:24:35.162846+0000","last_clean":"2024-08-31T04:24:35.162846+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:24:35.162846+0000","last_undegraded":"2024-08-31T04:24:35.162846+0000","last_fullsized":"2024-08-31T04:24:35.162846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175550+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:24:35.175550+0000","last_peered":"2024-08-31T04:24:35.175550+0000","last_clean":"2024-08-31T04:24:35.175550+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:24:35.175550+0000","last_undegraded":"2024-08-31T04:24:35.175550+0000","last_fullsized":"2024-08-31T04:24:35.175550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902441+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:24:33.902441+0000","last_peered":"2024-08-31T04:24:33.902441+0000","last_clean":"2024-08-31T04:24:33.902441+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:24:33.902441+0000","last_undegraded":"2024-08-31T04:24:33.902441+0000","last_fullsized":"2024-08-31T04:24:33.902441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903035+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:24:34.903035+0000","last_peered":"2024-08-31T04:24:34.903035+0000","last_clean":"2024-08-31T04:24:34.903035+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:24:34.903035+0000","last_undegraded":"2024-08-31T04:24:34.903035+0000","last_fullsized":"2024-08-31T04:24:34.903035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369435+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:23:34.369435+0000","last_peered":"2024-08-31T04:23:34.369435+0000","last_clean":"2024-08-31T04:23:34.369435+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:23:34.369435+0000","last_undegraded":"2024-08-31T04:23:34.369435+0000","last_fullsized":"2024-08-31T04:23:34.369435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.369592+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:23:34.369592+0000","last_peered":"2024-08-31T04:23:34.369592+0000","last_clean":"2024-08-31T04:23:34.369592+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:23:34.369592+0000","last_undegraded":"2024-08-31T04:23:34.369592+0000","last_fullsized":"2024-08-31T04:23:34.369592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-08-31T04:23:34.367487+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:23:34.367487+0000","last_peered":"2024-08-31T04:23:34.367487+0000","last_clean":"2024-08-31T04:23:34.367487+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:23:34.367487+0000","last_undegraded":"2024-08-31T04:23:34.367487+0000","last_fullsized":"2024-08-31T04:23:34.367487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":368,"num_read_kb":256,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":481736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1667072,"data_stored":1152872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103210,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":495129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299439,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":490371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1568768,"data_stored":1086274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1092282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":502677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":486403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":560715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":561151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:24:39.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:24:39.994 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:40 smithi002 ceph-mon[18656]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:40 smithi002 ceph-mon[18656]: pgmap v316: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T04:24:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3941070097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 msgr2=0x7fe4f810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3941070097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f810f2c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009ca0 tx=0x7fe4f002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3941070097 shutdown_connections 2024-08-31T04:24:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3941070097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f810f2c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3941070097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8108140 0x7fe4f8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3941070097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8102800 0x7fe4f8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3941070097 >> 172.21.15.2:0/3941070097 conn(0x7fe4f80794d0 msgr2=0x7fe4f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3941070097 shutdown_connections 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.471+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3941070097 wait complete. 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 Processor -- start 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 -- start start 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8102800 0x7fe4f8104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8108140 0x7fe4f81053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8112710 con 0x7fe4f8108a90 2024-08-31T04:24:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8112590 con 0x7fe4f8108140 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fed7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8112890 con 0x7fe4f8102800 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55206/0 (socket says 172.21.15.2:55206) 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 -- 172.21.15.2:0/3788723547 learned_addr learned my addr 172.21.15.2:0/3788723547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4f7fff640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8108140 0x7fe4f81053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fcb1a640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8102800 0x7fe4f8104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 -- 172.21.15.2:0/3788723547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8102800 msgr2=0x7fe4f8104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8102800 0x7fe4f8104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.472+0000 7fe4fd31b640 1 -- 172.21.15.2:0/3788723547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8108140 msgr2=0x7fe4f81053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4fd31b640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8108140 0x7fe4f81053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4fd31b640 1 -- 172.21.15.2:0/3788723547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f81a8480 con 0x7fe4f8108a90 2024-08-31T04:24:40.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4fd31b640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0005cc0 tx=0x7fe4f002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003bf0 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f81a8710 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4f0003d90 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002fbc0 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.473+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f81a8c50 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.474+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8102c10 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.476+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fe4f002fd60 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.476+0000 7fe4f5ffb640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 0x7fe4e80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.477+0000 7fe4fcb1a640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 0x7fe4e80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.477+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe4f0106df0 con 0x7fe4f8108a90 2024-08-31T04:24:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.477+0000 7fe4fcb1a640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 0x7fe4e80b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec005fd0 tx=0x7fe4ec005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.481+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe4f00cd880 con 0x7fe4f8108a90 2024-08-31T04:24:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:40 smithi064 ceph-mon[22007]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:40 smithi064 ceph-mon[22007]: pgmap v316: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T04:24:40.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:40 smithi132 ceph-mon[22335]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:40.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:40 smithi132 ceph-mon[22335]: pgmap v316: 129 pgs: 1 activating, 1 peering, 127 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T04:24:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.661+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4f80635a0 con 0x7fe4e80b4c10 2024-08-31T04:24:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.666+0000 7fe4f5ffb640 1 -- 172.21.15.2:0/3788723547 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340248 (secure 0 0 0) 0x7fe4f80635a0 con 0x7fe4e80b4c10 2024-08-31T04:24:40.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 msgr2=0x7fe4e80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 0x7fe4e80b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec005fd0 tx=0x7fe4ec005c70 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 msgr2=0x7fe4f8105900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0005cc0 tx=0x7fe4f002f380 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 shutdown_connections 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4e80b4c10 0x7fe4e80b7120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4f8108a90 0x7fe4f8105900 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4f8108140 0x7fe4f81053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 --2- 172.21.15.2:0/3788723547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4f8102800 0x7fe4f8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 >> 172.21.15.2:0/3788723547 conn(0x7fe4f80794d0 msgr2=0x7fe4f806af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 shutdown_connections 2024-08-31T04:24:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:40.670+0000 7fe4fed7e640 1 -- 172.21.15.2:0/3788723547 wait complete. 2024-08-31T04:24:41.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:41 smithi002 ceph-mon[18656]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-31T04:24:39.091246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":449,"num_read_kb":325,"num_write":296,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404424,"kb_used_data":13504,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537400,"statfs":{"total":1151940427776,"available":1151526297600,"internally_reserved":0,"allocated":13828096,"data_stored":7922986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002723"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903727+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903727+0000","last_peered":"2024-08-31T04:24:34.903727+0000","last_clean":"2024-08-31T04:24:34.903727+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903727+0000","last_undegraded":"2024-08-31T04:24:34.903727+0000","last_fullsized":"2024-08-31T04:24:34.903727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903553+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:24:33.903553+0000","last_peered":"2024-08-31T04:24:33.903553+0000","last_clean":"2024-08-31T04:24:33.903553+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:24:33.903553+0000","last_undegraded":"2024-08-31T04:24:33.903553+0000","last_fullsized":"2024-08-31T04:24:33.903553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905768+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:33.905768+0000","last_peered":"2024-08-31T04:24:33.905768+0000","last_clean":"2024-08-31T04:24:33.905768+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:33.905768+0000","last_undegraded":"2024-08-31T04:24:33.905768+0000","last_fullsized":"2024-08-31T04:24:33.905768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175450+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:24:35.175450+0000","last_peered":"2024-08-31T04:24:35.175450+0000","last_clean":"2024-08-31T04:24:35.175450+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:24:35.175450+0000","last_undegraded":"2024-08-31T04:24:35.175450+0000","last_fullsized":"2024-08-31T04:24:35.175450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902996+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:33.902996+0000","last_peered":"2024-08-31T04:24:33.902996+0000","last_clean":"2024-08-31T04:24:33.902996+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:33.902996+0000","last_undegraded":"2024-08-31T04:24:33.902996+0000","last_fullsized":"2024-08-31T04:24:33.902996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903985+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:24:34.903985+0000","last_peered":"2024-08-31T04:24:34.903985+0000","last_clean":"2024-08-31T04:24:34.903985+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:24:34.903985+0000","last_undegraded":"2024-08-31T04:24:34.903985+0000","last_fullsized":"2024-08-31T04:24:34.903985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903147+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:33.903147+0000","last_peered":"2024-08-31T04:24:33.903147+0000","last_clean":"2024-08-31T04:24:33.903147+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:33.903147+0000","last_undegraded":"2024-08-31T04:24:33.903147+0000","last_fullsized":"2024-08-31T04:24:33.903147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902128+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:24:34.902128+0000","last_peered":"2024-08-31T04:24:34.902128+0000","last_clean":"2024-08-31T04:24:34.902128+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:24:34.902128+0000","last_undegraded":"2024-08-31T04:24:34.902128+0000","last_fullsized":"2024-08-31T04:24:34.902128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162940+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:24:35.162940+0000","last_peered":"2024-08-31T04:24:35.162940+0000","last_clean":"2024-08-31T04:24:35.162940+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:24:35.162940+0000","last_undegraded":"2024-08-31T04:24:35.162940+0000","last_fullsized":"2024-08-31T04:24:35.162940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902549+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:33.902549+0000","last_peered":"2024-08-31T04:24:33.902549+0000","last_clean":"2024-08-31T04:24:33.902549+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:33.902549+0000","last_undegraded":"2024-08-31T04:24:33.902549+0000","last_fullsized":"2024-08-31T04:24:33.902549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902903+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902903+0000","last_peered":"2024-08-31T04:24:34.902903+0000","last_clean":"2024-08-31T04:24:34.902903+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902903+0000","last_undegraded":"2024-08-31T04:24:34.902903+0000","last_fullsized":"2024-08-31T04:24:34.902903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902849+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:24:33.902849+0000","last_peered":"2024-08-31T04:24:33.902849+0000","last_clean":"2024-08-31T04:24:33.902849+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:24:33.902849+0000","last_undegraded":"2024-08-31T04:24:33.902849+0000","last_fullsized":"2024-08-31T04:24:33.902849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903339+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903339+0000","last_peered":"2024-08-31T04:24:34.903339+0000","last_clean":"2024-08-31T04:24:34.903339+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903339+0000","last_undegraded":"2024-08-31T04:24:34.903339+0000","last_fullsized":"2024-08-31T04:24:34.903339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902737+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902737+0000","last_peered":"2024-08-31T04:24:34.902737+0000","last_clean":"2024-08-31T04:24:34.902737+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902737+0000","last_undegraded":"2024-08-31T04:24:34.902737+0000","last_fullsized":"2024-08-31T04:24:34.902737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065328+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:24:35.065328+0000","last_peered":"2024-08-31T04:24:35.065328+0000","last_clean":"2024-08-31T04:24:35.065328+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:24:35.065328+0000","last_undegraded":"2024-08-31T04:24:35.065328+0000","last_fullsized":"2024-08-31T04:24:35.065328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904990+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:33.904990+0000","last_peered":"2024-08-31T04:24:33.904990+0000","last_clean":"2024-08-31T04:24:33.904990+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:33.904990+0000","last_undegraded":"2024-08-31T04:24:33.904990+0000","last_fullsized":"2024-08-31T04:24:33.904990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903317+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903317+0000","last_peered":"2024-08-31T04:24:34.903317+0000","last_clean":"2024-08-31T04:24:34.903317+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903317+0000","last_undegraded":"2024-08-31T04:24:34.903317+0000","last_fullsized":"2024-08-31T04:24:34.903317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903081+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:24:33.903081+0000","last_peered":"2024-08-31T04:24:33.903081+0000","last_clean":"2024-08-31T04:24:33.903081+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:24:33.903081+0000","last_undegraded":"2024-08-31T04:24:33.903081+0000","last_fullsized":"2024-08-31T04:24:33.903081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903872+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903872+0000","last_peered":"2024-08-31T04:24:34.903872+0000","last_clean":"2024-08-31T04:24:34.903872+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903872+0000","last_undegraded":"2024-08-31T04:24:34.903872+0000","last_fullsized":"2024-08-31T04:24:34.903872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902455+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902455+0000","last_peered":"2024-08-31T04:24:34.902455+0000","last_clean":"2024-08-31T04:24:34.902455+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902455+0000","last_undegraded":"2024-08-31T04:24:34.902455+0000","last_fullsized":"2024-08-31T04:24:34.902455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175253+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:24:35.175253+0000","last_peered":"2024-08-31T04:24:35.175253+0000","last_clean":"2024-08-31T04:24:35.175253+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:24:35.175253+0000","last_undegraded":"2024-08-31T04:24:35.175253+0000","last_fullsized":"2024-08-31T04:24:35.175253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903158+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903158+0000","last_peered":"2024-08-31T04:24:34.903158+0000","last_clean":"2024-08-31T04:24:34.903158+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903158+0000","last_undegraded":"2024-08-31T04:24:34.903158+0000","last_fullsized":"2024-08-31T04:24:34.903158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903836+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903836+0000","last_peered":"2024-08-31T04:24:34.903836+0000","last_clean":"2024-08-31T04:24:34.903836+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903836+0000","last_undegraded":"2024-08-31T04:24:34.903836+0000","last_fullsized":"2024-08-31T04:24:34.903836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":5,"reported_epoch":85,"state":"activating","last_fresh":"2024-08-31T04:24:35.066409+0000","last_change":"2024-08-31T04:24:34.903494+0000","last_active":"2024-08-31T04:24:34.903280+0000","last_peered":"2024-08-31T04:23:34.495302+0000","last_clean":"2024-08-31T04:23:34.495302+0000","last_became_active":"2024-08-31T04:22:57.250958+0000","last_became_peered":"2024-08-31T04:22:57.250958+0000","last_unstale":"2024-08-31T04:24:35.066409+0000","last_undegraded":"2024-08-31T04:24:35.066409+0000","last_fullsized":"2024-08-31T04:24:35.066409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":["9","3","7","11"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903383+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:24:34.903383+0000","last_peered":"2024-08-31T04:24:34.903383+0000","last_clean":"2024-08-31T04:24:34.903383+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:24:34.903383+0000","last_undegraded":"2024-08-31T04:24:34.903383+0000","last_fullsized":"2024-08-31T04:24:34.903383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902747+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:33.902747+0000","last_peered":"2024-08-31T04:24:33.902747+0000","last_clean":"2024-08-31T04:24:33.902747+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:33.902747+0000","last_undegraded":"2024-08-31T04:24:33.902747+0000","last_fullsized":"2024-08-31T04:24:33.902747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899720+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:24:34.899720+0000","last_peered":"2024-08-31T04:24:34.899720+0000","last_clean":"2024-08-31T04:24:34.899720+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:24:34.899720+0000","last_undegraded":"2024-08-31T04:24:34.899720+0000","last_fullsized":"2024-08-31T04:24:34.899720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903133+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:33.903133+0000","last_peered":"2024-08-31T04:24:33.903133+0000","last_clean":"2024-08-31T04:24:33.903133+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:33.903133+0000","last_undegraded":"2024-08-31T04:24:33.903133+0000","last_fullsized":"2024-08-31T04:24:33.903133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065341+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065341+0000","last_peered":"2024-08-31T04:24:35.065341+0000","last_clean":"2024-08-31T04:24:35.065341+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065341+0000","last_undegraded":"2024-08-31T04:24:35.065341+0000","last_fullsized":"2024-08-31T04:24:35.065341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175761+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:24:35.175761+0000","last_peered":"2024-08-31T04:24:35.175761+0000","last_clean":"2024-08-31T04:24:35.175761+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:24:35.175761+0000","last_undegraded":"2024-08-31T04:24:35.175761+0000","last_fullsized":"2024-08-31T04:24:35.175761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903204+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903204+0000","last_peered":"2024-08-31T04:24:34.903204+0000","last_clean":"2024-08-31T04:24:34.903204+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903204+0000","last_undegraded":"2024-08-31T04:24:34.903204+0000","last_fullsized":"2024-08-31T04:24:34.903204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902897+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:33.902897+0000","last_peered":"2024-08-31T04:24:33.902897+0000","last_clean":"2024-08-31T04:24:33.902897+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:33.902897+0000","last_undegraded":"2024-08-31T04:24:33.902897+0000","last_fullsized":"2024-08-31T04:24:33.902897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175688+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:24:35.175688+0000","last_peered":"2024-08-31T04:24:35.175688+0000","last_clean":"2024-08-31T04:24:35.175688+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:24:35.175688+0000","last_undegraded":"2024-08-31T04:24:35.175688+0000","last_fullsized":"2024-08-31T04:24:35.175688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163308+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163308+0000","last_peered":"2024-08-31T04:24:35.163308+0000","last_clean":"2024-08-31T04:24:35.163308+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163308+0000","last_undegraded":"2024-08-31T04:24:35.163308+0000","last_fullsized":"2024-08-31T04:24:35.163308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899462+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899462+0000","last_peered":"2024-08-31T04:24:34.899462+0000","last_clean":"2024-08-31T04:24:34.899462+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899462+0000","last_undegraded":"2024-08-31T04:24:34.899462+0000","last_fullsized":"2024-08-31T04:24:34.899462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.909200+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:24:34.909200+0000","last_peered":"2024-08-31T04:24:34.909200+0000","last_clean":"2024-08-31T04:24:34.909200+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:24:34.909200+0000","last_undegraded":"2024-08-31T04:24:34.909200+0000","last_fullsized":"2024-08-31T04:24:34.909200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899274+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:24:34.899274+0000","last_peered":"2024-08-31T04:24:34.899274+0000","last_clean":"2024-08-31T04:24:34.899274+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:24:34.899274+0000","last_undegraded":"2024-08-31T04:24:34.899274+0000","last_fullsized":"2024-08-31T04:24:34.899274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899665+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899665+0000","last_peered":"2024-08-31T04:24:34.899665+0000","last_clean":"2024-08-31T04:24:34.899665+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899665+0000","last_undegraded":"2024-08-31T04:24:34.899665+0000","last_fullsized":"2024-08-31T04:24:34.899665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899079+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:24:34.899079+0000","last_peered":"2024-08-31T04:24:34.899079+0000","last_clean":"2024-08-31T04:24:34.899079+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:24:34.899079+0000","last_undegraded":"2024-08-31T04:24:34.899079+0000","last_fullsized":"2024-08-31T04:24:34.899079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162741+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.162741+0000","last_peered":"2024-08-31T04:24:35.162741+0000","last_clean":"2024-08-31T04:24:35.162741+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.162741+0000","last_undegraded":"2024-08-31T04:24:35.162741+0000","last_fullsized":"2024-08-31T04:24:35.162741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902421+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902421+0000","last_peered":"2024-08-31T04:24:34.902421+0000","last_clean":"2024-08-31T04:24:34.902421+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902421+0000","last_undegraded":"2024-08-31T04:24:34.902421+0000","last_fullsized":"2024-08-31T04:24:34.902421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903751+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:24:33.903751+0000","last_peered":"2024-08-31T04:24:33.903751+0000","last_clean":"2024-08-31T04:24:33.903751+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:24:33.903751+0000","last_undegraded":"2024-08-31T04:24:33.903751+0000","last_fullsized":"2024-08-31T04:24:33.903751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902599+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902599+0000","last_peered":"2024-08-31T04:24:34.902599+0000","last_clean":"2024-08-31T04:24:34.902599+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902599+0000","last_undegraded":"2024-08-31T04:24:34.902599+0000","last_fullsized":"2024-08-31T04:24:34.902599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162974+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.162974+0000","last_peered":"2024-08-31T04:24:35.162974+0000","last_clean":"2024-08-31T04:24:35.162974+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.162974+0000","last_undegraded":"2024-08-31T04:24:35.162974+0000","last_fullsized":"2024-08-31T04:24:35.162974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163451+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:24:35.163451+0000","last_peered":"2024-08-31T04:24:35.163451+0000","last_clean":"2024-08-31T04:24:35.163451+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:24:35.163451+0000","last_undegraded":"2024-08-31T04:24:35.163451+0000","last_fullsized":"2024-08-31T04:24:35.163451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904175+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904175+0000","last_peered":"2024-08-31T04:24:34.904175+0000","last_clean":"2024-08-31T04:24:34.904175+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904175+0000","last_undegraded":"2024-08-31T04:24:34.904175+0000","last_fullsized":"2024-08-31T04:24:34.904175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163017+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:24:35.163017+0000","last_peered":"2024-08-31T04:24:35.163017+0000","last_clean":"2024-08-31T04:24:35.163017+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:24:35.163017+0000","last_undegraded":"2024-08-31T04:24:35.163017+0000","last_fullsized":"2024-08-31T04:24:35.163017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902460+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902460+0000","last_peered":"2024-08-31T04:24:34.902460+0000","last_clean":"2024-08-31T04:24:34.902460+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902460+0000","last_undegraded":"2024-08-31T04:24:34.902460+0000","last_fullsized":"2024-08-31T04:24:34.902460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175079+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175079+0000","last_peered":"2024-08-31T04:24:35.175079+0000","last_clean":"2024-08-31T04:24:35.175079+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175079+0000","last_undegraded":"2024-08-31T04:24:35.175079+0000","last_fullsized":"2024-08-31T04:24:35.175079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163666+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:24:35.163666+0000","last_peered":"2024-08-31T04:24:35.163666+0000","last_clean":"2024-08-31T04:24:35.163666+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:24:35.163666+0000","last_undegraded":"2024-08-31T04:24:35.163666+0000","last_fullsized":"2024-08-31T04:24:35.163666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899735+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899735+0000","last_peered":"2024-08-31T04:24:34.899735+0000","last_clean":"2024-08-31T04:24:34.899735+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899735+0000","last_undegraded":"2024-08-31T04:24:34.899735+0000","last_fullsized":"2024-08-31T04:24:34.899735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900596+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900596+0000","last_peered":"2024-08-31T04:24:34.900596+0000","last_clean":"2024-08-31T04:24:34.900596+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900596+0000","last_undegraded":"2024-08-31T04:24:34.900596+0000","last_fullsized":"2024-08-31T04:24:34.900596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065886+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:24:35.065886+0000","last_peered":"2024-08-31T04:24:35.065886+0000","last_clean":"2024-08-31T04:24:35.065886+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:24:35.065886+0000","last_undegraded":"2024-08-31T04:24:35.065886+0000","last_fullsized":"2024-08-31T04:24:35.065886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904048+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:24:33.904048+0000","last_peered":"2024-08-31T04:24:33.904048+0000","last_clean":"2024-08-31T04:24:33.904048+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:24:33.904048+0000","last_undegraded":"2024-08-31T04:24:33.904048+0000","last_fullsized":"2024-08-31T04:24:33.904048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900723+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900723+0000","last_peered":"2024-08-31T04:24:34.900723+0000","last_clean":"2024-08-31T04:24:34.900723+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900723+0000","last_undegraded":"2024-08-31T04:24:34.900723+0000","last_fullsized":"2024-08-31T04:24:34.900723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901214+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:24:34.901214+0000","last_peered":"2024-08-31T04:24:34.901214+0000","last_clean":"2024-08-31T04:24:34.901214+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:24:34.901214+0000","last_undegraded":"2024-08-31T04:24:34.901214+0000","last_fullsized":"2024-08-31T04:24:34.901214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902567+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:33.902567+0000","last_peered":"2024-08-31T04:24:33.902567+0000","last_clean":"2024-08-31T04:24:33.902567+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:33.902567+0000","last_undegraded":"2024-08-31T04:24:33.902567+0000","last_fullsized":"2024-08-31T04:24:33.902567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162525+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:24:35.162525+0000","last_peered":"2024-08-31T04:24:35.162525+0000","last_clean":"2024-08-31T04:24:35.162525+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:24:35.162525+0000","last_undegraded":"2024-08-31T04:24:35.162525+0000","last_fullsized":"2024-08-31T04:24:35.162525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.516303+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:24:35.516303+0000","last_peered":"2024-08-31T04:24:35.516303+0000","last_clean":"2024-08-31T04:24:35.516303+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:24:35.516303+0000","last_undegraded":"2024-08-31T04:24:35.516303+0000","last_fullsized":"2024-08-31T04:24:35.516303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":2,"reported_epoch":84,"state":"peering","last_fresh":"2024-08-31T04:23:04.268077+0000","last_change":"2024-08-31T04:24:34.098165+0000","last_active":"2024-08-31T04:23:03.258282+0000","last_peered":"2024-08-31T04:23:03.258282+0000","last_clean":"2024-08-31T04:23:03.258282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-31T04:23:04.268077+0000","last_undegraded":"2024-08-31T04:23:04.268077+0000","last_fullsized":"2024-08-31T04:23:04.268077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163003+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:24:35.163003+0000","last_peered":"2024-08-31T04:24:35.163003+0000","last_clean":"2024-08-31T04:24:35.163003+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:24:35.163003+0000","last_undegraded":"2024-08-31T04:24:35.163003+0000","last_fullsized":"2024-08-31T04:24:35.163003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901294+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901294+0000","last_peered":"2024-08-31T04:24:34.901294+0000","last_clean":"2024-08-31T04:24:34.901294+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901294+0000","last_undegraded":"2024-08-31T04:24:34.901294+0000","last_fullsized":"2024-08-31T04:24:34.901294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065345+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065345+0000","last_peered":"2024-08-31T04:24:35.065345+0000","last_clean":"2024-08-31T04:24:35.065345+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065345+0000","last_undegraded":"2024-08-31T04:24:35.065345+0000","last_fullsized":"2024-08-31T04:24:35.065345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164616+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:24:35.164616+0000","last_peered":"2024-08-31T04:24:35.164616+0000","last_clean":"2024-08-31T04:24:35.164616+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:24:35.164616+0000","last_undegraded":"2024-08-31T04:24:35.164616+0000","last_fullsized":"2024-08-31T04:24:35.164616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903598+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903598+0000","last_peered":"2024-08-31T04:24:34.903598+0000","last_clean":"2024-08-31T04:24:34.903598+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903598+0000","last_undegraded":"2024-08-31T04:24:34.903598+0000","last_fullsized":"2024-08-31T04:24:34.903598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902763+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:24:33.902763+0000","last_peered":"2024-08-31T04:24:33.902763+0000","last_clean":"2024-08-31T04:24:33.902763+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:24:33.902763+0000","last_undegraded":"2024-08-31T04:24:33.902763+0000","last_fullsized":"2024-08-31T04:24:33.902763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":195,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515228+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:24:35.515228+0000","last_peered":"2024-08-31T04:24:35.515228+0000","last_clean":"2024-08-31T04:24:35.515228+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:24:35.515228+0000","last_undegraded":"2024-08-31T04:24:35.515228+0000","last_fullsized":"2024-08-31T04:24:35.515228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":124,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902970+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.902970+0000","last_peered":"2024-08-31T04:24:34.902970+0000","last_clean":"2024-08-31T04:24:34.902970+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.902970+0000","last_undegraded":"2024-08-31T04:24:34.902970+0000","last_fullsized":"2024-08-31T04:24:34.902970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904119+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:24:34.904119+0000","last_peered":"2024-08-31T04:24:34.904119+0000","last_clean":"2024-08-31T04:24:34.904119+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:24:34.904119+0000","last_undegraded":"2024-08-31T04:24:34.904119+0000","last_fullsized":"2024-08-31T04:24:34.904119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902335+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902335+0000","last_peered":"2024-08-31T04:24:34.902335+0000","last_clean":"2024-08-31T04:24:34.902335+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902335+0000","last_undegraded":"2024-08-31T04:24:34.902335+0000","last_fullsized":"2024-08-31T04:24:34.902335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177602+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.177602+0000","last_peered":"2024-08-31T04:24:35.177602+0000","last_clean":"2024-08-31T04:24:35.177602+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.177602+0000","last_undegraded":"2024-08-31T04:24:35.177602+0000","last_fullsized":"2024-08-31T04:24:35.177602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175519+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:24:35.175519+0000","last_peered":"2024-08-31T04:24:35.175519+0000","last_clean":"2024-08-31T04:24:35.175519+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:24:35.175519+0000","last_undegraded":"2024-08-31T04:24:35.175519+0000","last_fullsized":"2024-08-31T04:24:35.175519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163405+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163405+0000","last_peered":"2024-08-31T04:24:35.163405+0000","last_clean":"2024-08-31T04:24:35.163405+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163405+0000","last_undegraded":"2024-08-31T04:24:35.163405+0000","last_fullsized":"2024-08-31T04:24:35.163405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902696+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902696+0000","last_peered":"2024-08-31T04:24:34.902696+0000","last_clean":"2024-08-31T04:24:34.902696+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902696+0000","last_undegraded":"2024-08-31T04:24:34.902696+0000","last_fullsized":"2024-08-31T04:24:34.902696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.905097+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:24:34.905097+0000","last_peered":"2024-08-31T04:24:34.905097+0000","last_clean":"2024-08-31T04:24:34.905097+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:24:34.905097+0000","last_undegraded":"2024-08-31T04:24:34.905097+0000","last_fullsized":"2024-08-31T04:24:34.905097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176117+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:24:35.176117+0000","last_peered":"2024-08-31T04:24:35.176117+0000","last_clean":"2024-08-31T04:24:35.176117+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:24:35.176117+0000","last_undegraded":"2024-08-31T04:24:35.176117+0000","last_fullsized":"2024-08-31T04:24:35.176117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904605+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:33.904605+0000","last_peered":"2024-08-31T04:24:33.904605+0000","last_clean":"2024-08-31T04:24:33.904605+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:33.904605+0000","last_undegraded":"2024-08-31T04:24:33.904605+0000","last_fullsized":"2024-08-31T04:24:33.904605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175070+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175070+0000","last_peered":"2024-08-31T04:24:35.175070+0000","last_clean":"2024-08-31T04:24:35.175070+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175070+0000","last_undegraded":"2024-08-31T04:24:35.175070+0000","last_fullsized":"2024-08-31T04:24:35.175070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902852+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:24:34.902852+0000","last_peered":"2024-08-31T04:24:34.902852+0000","last_clean":"2024-08-31T04:24:34.902852+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:24:34.902852+0000","last_undegraded":"2024-08-31T04:24:34.902852+0000","last_fullsized":"2024-08-31T04:24:34.902852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901010+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901010+0000","last_peered":"2024-08-31T04:24:34.901010+0000","last_clean":"2024-08-31T04:24:34.901010+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901010+0000","last_undegraded":"2024-08-31T04:24:34.901010+0000","last_fullsized":"2024-08-31T04:24:34.901010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065811+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065811+0000","last_peered":"2024-08-31T04:24:35.065811+0000","last_clean":"2024-08-31T04:24:35.065811+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065811+0000","last_undegraded":"2024-08-31T04:24:35.065811+0000","last_fullsized":"2024-08-31T04:24:35.065811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902892+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:24:33.902892+0000","last_peered":"2024-08-31T04:24:33.902892+0000","last_clean":"2024-08-31T04:24:33.902892+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:24:33.902892+0000","last_undegraded":"2024-08-31T04:24:33.902892+0000","last_fullsized":"2024-08-31T04:24:33.902892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899145+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899145+0000","last_peered":"2024-08-31T04:24:34.899145+0000","last_clean":"2024-08-31T04:24:34.899145+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899145+0000","last_undegraded":"2024-08-31T04:24:34.899145+0000","last_fullsized":"2024-08-31T04:24:34.899145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175580+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175580+0000","last_peered":"2024-08-31T04:24:35.175580+0000","last_clean":"2024-08-31T04:24:35.175580+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175580+0000","last_undegraded":"2024-08-31T04:24:35.175580+0000","last_fullsized":"2024-08-31T04:24:35.175580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.925663+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:24:34.925663+0000","last_peered":"2024-08-31T04:24:34.925663+0000","last_clean":"2024-08-31T04:24:34.925663+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:24:34.925663+0000","last_undegraded":"2024-08-31T04:24:34.925663+0000","last_fullsized":"2024-08-31T04:24:34.925663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.515972+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:24:35.515972+0000","last_peered":"2024-08-31T04:24:35.515972+0000","last_clean":"2024-08-31T04:24:35.515972+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:24:35.515972+0000","last_undegraded":"2024-08-31T04:24:35.515972+0000","last_fullsized":"2024-08-31T04:24:35.515972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.903288+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:24:33.903288+0000","last_peered":"2024-08-31T04:24:33.903288+0000","last_clean":"2024-08-31T04:24:33.903288+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:24:33.903288+0000","last_undegraded":"2024-08-31T04:24:33.903288+0000","last_fullsized":"2024-08-31T04:24:33.903288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065181+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:24:35.065181+0000","last_peered":"2024-08-31T04:24:35.065181+0000","last_clean":"2024-08-31T04:24:35.065181+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:24:35.065181+0000","last_undegraded":"2024-08-31T04:24:35.065181+0000","last_fullsized":"2024-08-31T04:24:35.065181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.911653+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:24:34.911653+0000","last_peered":"2024-08-31T04:24:34.911653+0000","last_clean":"2024-08-31T04:24:34.911653+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:24:34.911653+0000","last_undegraded":"2024-08-31T04:24:34.911653+0000","last_fullsized":"2024-08-31T04:24:34.911653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903193+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:24:34.903193+0000","last_peered":"2024-08-31T04:24:34.903193+0000","last_clean":"2024-08-31T04:24:34.903193+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:24:34.903193+0000","last_undegraded":"2024-08-31T04:24:34.903193+0000","last_fullsized":"2024-08-31T04:24:34.903193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175197+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:24:35.175197+0000","last_peered":"2024-08-31T04:24:35.175197+0000","last_clean":"2024-08-31T04:24:35.175197+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:24:35.175197+0000","last_undegraded":"2024-08-31T04:24:35.175197+0000","last_fullsized":"2024-08-31T04:24:35.175197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899594+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:24:34.899594+0000","last_peered":"2024-08-31T04:24:34.899594+0000","last_clean":"2024-08-31T04:24:34.899594+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:24:34.899594+0000","last_undegraded":"2024-08-31T04:24:34.899594+0000","last_fullsized":"2024-08-31T04:24:34.899594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065801+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:24:35.065801+0000","last_peered":"2024-08-31T04:24:35.065801+0000","last_clean":"2024-08-31T04:24:35.065801+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:24:35.065801+0000","last_undegraded":"2024-08-31T04:24:35.065801+0000","last_fullsized":"2024-08-31T04:24:35.065801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904210+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:24:34.904210+0000","last_peered":"2024-08-31T04:24:34.904210+0000","last_clean":"2024-08-31T04:24:34.904210+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:24:34.904210+0000","last_undegraded":"2024-08-31T04:24:34.904210+0000","last_fullsized":"2024-08-31T04:24:34.904210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.905262+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:24:33.905262+0000","last_peered":"2024-08-31T04:24:33.905262+0000","last_clean":"2024-08-31T04:24:33.905262+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:24:33.905262+0000","last_undegraded":"2024-08-31T04:24:33.905262+0000","last_fullsized":"2024-08-31T04:24:33.905262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900794+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:24:34.900794+0000","last_peered":"2024-08-31T04:24:34.900794+0000","last_clean":"2024-08-31T04:24:34.900794+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:24:34.900794+0000","last_undegraded":"2024-08-31T04:24:34.900794+0000","last_fullsized":"2024-08-31T04:24:34.900794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.904791+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:24:33.904791+0000","last_peered":"2024-08-31T04:24:33.904791+0000","last_clean":"2024-08-31T04:24:33.904791+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:24:33.904791+0000","last_undegraded":"2024-08-31T04:24:33.904791+0000","last_fullsized":"2024-08-31T04:24:33.904791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904954+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:24:34.904954+0000","last_peered":"2024-08-31T04:24:34.904954+0000","last_clean":"2024-08-31T04:24:34.904954+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:24:34.904954+0000","last_undegraded":"2024-08-31T04:24:34.904954+0000","last_fullsized":"2024-08-31T04:24:34.904954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899543+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:24:34.899543+0000","last_peered":"2024-08-31T04:24:34.899543+0000","last_clean":"2024-08-31T04:24:34.899543+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:24:34.899543+0000","last_undegraded":"2024-08-31T04:24:34.899543+0000","last_fullsized":"2024-08-31T04:24:34.899543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065440+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:24:35.065440+0000","last_peered":"2024-08-31T04:24:35.065440+0000","last_clean":"2024-08-31T04:24:35.065440+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:24:35.065440+0000","last_undegraded":"2024-08-31T04:24:35.065440+0000","last_fullsized":"2024-08-31T04:24:35.065440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904117+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:24:34.904117+0000","last_peered":"2024-08-31T04:24:34.904117+0000","last_clean":"2024-08-31T04:24:34.904117+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:24:34.904117+0000","last_undegraded":"2024-08-31T04:24:34.904117+0000","last_fullsized":"2024-08-31T04:24:34.904117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903380+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:24:34.903380+0000","last_peered":"2024-08-31T04:24:34.903380+0000","last_clean":"2024-08-31T04:24:34.903380+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:24:34.903380+0000","last_undegraded":"2024-08-31T04:24:34.903380+0000","last_fullsized":"2024-08-31T04:24:34.903380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065997+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:24:35.065997+0000","last_peered":"2024-08-31T04:24:35.065997+0000","last_clean":"2024-08-31T04:24:35.065997+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:24:35.065997+0000","last_undegraded":"2024-08-31T04:24:35.065997+0000","last_fullsized":"2024-08-31T04:24:35.065997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902825+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:24:34.902825+0000","last_peered":"2024-08-31T04:24:34.902825+0000","last_clean":"2024-08-31T04:24:34.902825+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:24:34.902825+0000","last_undegraded":"2024-08-31T04:24:34.902825+0000","last_fullsized":"2024-08-31T04:24:34.902825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175085+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:24:35.175085+0000","last_peered":"2024-08-31T04:24:35.175085+0000","last_clean":"2024-08-31T04:24:35.175085+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:24:35.175085+0000","last_undegraded":"2024-08-31T04:24:35.175085+0000","last_fullsized":"2024-08-31T04:24:35.175085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174791+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:24:35.174791+0000","last_peered":"2024-08-31T04:24:35.174791+0000","last_clean":"2024-08-31T04:24:35.174791+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:24:35.174791+0000","last_undegraded":"2024-08-31T04:24:35.174791+0000","last_fullsized":"2024-08-31T04:24:35.174791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899425+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:24:34.899425+0000","last_peered":"2024-08-31T04:24:34.899425+0000","last_clean":"2024-08-31T04:24:34.899425+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:24:34.899425+0000","last_undegraded":"2024-08-31T04:24:34.899425+0000","last_fullsized":"2024-08-31T04:24:34.899425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902899+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:24:34.902899+0000","last_peered":"2024-08-31T04:24:34.902899+0000","last_clean":"2024-08-31T04:24:34.902899+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:24:34.902899+0000","last_undegraded":"2024-08-31T04:24:34.902899+0000","last_fullsized":"2024-08-31T04:24:34.902899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163355+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:24:35.163355+0000","last_peered":"2024-08-31T04:24:35.163355+0000","last_clean":"2024-08-31T04:24:35.163355+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:24:35.163355+0000","last_undegraded":"2024-08-31T04:24:35.163355+0000","last_fullsized":"2024-08-31T04:24:35.163355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176164+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:24:35.176164+0000","last_peered":"2024-08-31T04:24:35.176164+0000","last_clean":"2024-08-31T04:24:35.176164+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:24:35.176164+0000","last_undegraded":"2024-08-31T04:24:35.176164+0000","last_fullsized":"2024-08-31T04:24:35.176164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.165355+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:24:35.165355+0000","last_peered":"2024-08-31T04:24:35.165355+0000","last_clean":"2024-08-31T04:24:35.165355+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:24:35.165355+0000","last_undegraded":"2024-08-31T04:24:35.165355+0000","last_fullsized":"2024-08-31T04:24:35.165355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902850+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:24:33.902850+0000","last_peered":"2024-08-31T04:24:33.902850+0000","last_clean":"2024-08-31T04:24:33.902850+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:24:33.902850+0000","last_undegraded":"2024-08-31T04:24:33.902850+0000","last_fullsized":"2024-08-31T04:24:33.902850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162846+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:24:35.162846+0000","last_peered":"2024-08-31T04:24:35.162846+0000","last_clean":"2024-08-31T04:24:35.162846+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:24:35.162846+0000","last_undegraded":"2024-08-31T04:24:35.162846+0000","last_fullsized":"2024-08-31T04:24:35.162846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175550+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:24:35.175550+0000","last_peered":"2024-08-31T04:24:35.175550+0000","last_clean":"2024-08-31T04:24:35.175550+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:24:35.175550+0000","last_undegraded":"2024-08-31T04:24:35.175550+0000","last_fullsized":"2024-08-31T04:24:35.175550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-31T04:24:33.902441+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:24:33.902441+0000","last_peered":"2024-08-31T04:24:33.902441+0000","last_clean":"2024-08-31T04:24:33.902441+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:24:33.902441+0000","last_undegraded":"2024-08-31T04:24:33.902441+0000","last_fullsized":"2024-08-31T04:24:33.902441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903035+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:24:34.903035+0000","last_peered":"2024-08-31T04:24:34.903035+0000","last_clean":"2024-08-31T04:24:34.903035+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:24:34.903035+0000","last_undegraded":"2024-08-31T04:24:34.903035+0000","last_fullsized":"2024-08-31T04:24:34.903035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174870+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:24:35.174870+0000","last_peered":"2024-08-31T04:24:35.174870+0000","last_clean":"2024-08-31T04:24:35.174870+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:24:35.174870+0000","last_undegraded":"2024-08-31T04:24:35.174870+0000","last_fullsized":"2024-08-31T04:24:35.174870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175219+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:24:35.175219+0000","last_peered":"2024-08-31T04:24:35.175219+0000","last_clean":"2024-08-31T04:24:35.175219+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:24:35.175219+0000","last_undegraded":"2024-08-31T04:24:35.175219+0000","last_fullsized":"2024-08-31T04:24:35.175219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065991+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:24:35.065991+0000","last_peered":"2024-08-31T04:24:35.065991+0000","last_clean":"2024-08-31T04:24:35.065991+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:24:35.065991+0000","last_undegraded":"2024-08-31T04:24:35.065991+0000","last_fullsized":"2024-08-31T04:24:35.065991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":368,"num_read_kb":256,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":987136,"data_stored":501642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1667072,"data_stored":1152872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103210,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":495129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299439,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":490371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1568768,"data_stored":1086274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1092282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":502677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":486403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":560715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":561151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:24:41.355 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.7 is not active+clean 2024-08-31T04:24:41.355 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 85, 'state': 'activating', 'last_fresh': '2024-08-31T04:24:35.066409+0000', 'last_change': '2024-08-31T04:24:34.903494+0000', 'last_active': '2024-08-31T04:24:34.903280+0000', 'last_peered': '2024-08-31T04:23:34.495302+0000', 'last_clean': '2024-08-31T04:23:34.495302+0000', 'last_became_active': '2024-08-31T04:22:57.250958+0000', 'last_became_peered': '2024-08-31T04:22:57.250958+0000', 'last_unstale': '2024-08-31T04:24:35.066409+0000', 'last_undegraded': '2024-08-31T04:24:35.066409+0000', 'last_fullsized': '2024-08-31T04:24:35.066409+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-31T04:22:56.213782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-31T04:22:56.213782+0000', 'last_clean_scrub_stamp': '2024-08-31T04:22:56.213782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 11, 7], 'acting': [9, 11, 7], 'avail_no_missing': ['9', '3', '7', '11'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-08-31T04:24:41.355 INFO:tasks.cephadm.ceph_manager.ceph:PG 4.17 is not active+clean 2024-08-31T04:24:41.355 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 84, 'state': 'peering', 'last_fresh': '2024-08-31T04:23:04.268077+0000', 'last_change': '2024-08-31T04:24:34.098165+0000', 'last_active': '2024-08-31T04:23:03.258282+0000', 'last_peered': '2024-08-31T04:23:03.258282+0000', 'last_clean': '2024-08-31T04:23:03.258282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-31T04:23:04.268077+0000', 'last_undegraded': '2024-08-31T04:23:04.268077+0000', 'last_fullsized': '2024-08-31T04:23:04.268077+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 79, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-31T04:23:03.258282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-31T04:23:03.258282+0000', 'last_clean_scrub_stamp': '2024-08-31T04:23:03.258282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [8, 7, 0, 3], 'acting': [8, 7, 0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 8, 'acting_primary': 8, 'purged_snaps': []} 2024-08-31T04:24:41.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph status --format=json 2024-08-31T04:24:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:41 smithi064 ceph-mon[22007]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:41.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:41 smithi132 ceph-mon[22335]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:41.608 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 -- 172.21.15.2:0/3130429109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604110010 msgr2=0x7f0604112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3130429109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604110010 0x7f0604112430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009ca0 tx=0x7f05fc02a9e0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 -- 172.21.15.2:0/3130429109 shutdown_connections 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3130429109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604110010 0x7f0604112430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3130429109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604102db0 0x7f060410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.132+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3130429109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102460 0x7f0604102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.133+0000 7f060b6e0640 1 -- 172.21.15.2:0/3130429109 >> 172.21.15.2:0/3130429109 conn(0x7f0604079560 msgr2=0x7f0604079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.133+0000 7f060b6e0640 1 -- 172.21.15.2:0/3130429109 shutdown_connections 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.133+0000 7f060b6e0640 1 -- 172.21.15.2:0/3130429109 wait complete. 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.133+0000 7f060b6e0640 1 Processor -- start 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.133+0000 7f060b6e0640 1 -- start start 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 0x7f060419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604110010 0x7f06041a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0604115a80 con 0x7f0604102460 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0604115900 con 0x7f0604110010 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0604115c00 con 0x7f0604102db0 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55220/0 (socket says 172.21.15.2:55220) 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 -- 172.21.15.2:0/3689949533 learned_addr learned my addr 172.21.15.2:0/3689949533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f0608c7b640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 0x7f060419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f0609c7d640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604110010 0x7f06041a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 -- 172.21.15.2:0/3689949533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 msgr2=0x7f060419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 0x7f060419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 -- 172.21.15.2:0/3689949533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604110010 msgr2=0x7f06041a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604110010 0x7f06041a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 -- 172.21.15.2:0/3689949533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06041a23c0 con 0x7f0604102460 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f0608c7b640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 0x7f060419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060947c640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f060000d770 tx=0x7f060000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600017070 con 0x7f0604102460 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06041a26b0 con 0x7f0604102460 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06000054d0 con 0x7f0604102460 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600004c30 con 0x7f0604102460 2024-08-31T04:24:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.134+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06041a8e10 con 0x7f0604102460 2024-08-31T04:24:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.135+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060406bf60 con 0x7f0604102460 2024-08-31T04:24:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.138+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f0600004dd0 con 0x7f0604102460 2024-08-31T04:24:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.138+0000 7f05fa7fc640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 0x7f05f00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.138+0000 7f0608c7b640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 0x7f05f00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.138+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f06000e57c0 con 0x7f0604102460 2024-08-31T04:24:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.139+0000 7f0608c7b640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 0x7f05f00b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0604079ab0 tx=0x7f05f4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.141+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06000ac250 con 0x7f0604102460 2024-08-31T04:24:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:42 smithi002 ceph-mon[18656]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-08-31T04:24:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:42 smithi002 ceph-mon[18656]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-08-31T04:24:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:42 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:24:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.398+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0604102870 con 0x7f0604102460 2024-08-31T04:24:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.399+0000 7f05fa7fc640 1 -- 172.21.15.2:0/3689949533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2207 (secure 0 0 0) 0x7f06000abb50 con 0x7f0604102460 2024-08-31T04:24:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":499,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":85,"num_osds":12,"num_up_osds":12,"osd_up_since":1725078126,"num_in_osds":12,"osd_in_since":1725078102,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":659612,"bytes_used":414199808,"bytes_avail":1151526227968,"bytes_total":1151940427776,"read_bytes_sec":3199,"read_op_per_sec":5,"write_op_per_sec":0},"fsmap":{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"c","status":"up:standby-replay","gid":24622},{"filesystem_id":1,"rank":1,"name":"k","status":"up:standby-replay","gid":24623},{"filesystem_id":1,"rank":0,"name":"e","status":"up:standby-replay","gid":24641},{"filesystem_id":1,"rank":2,"name":"i","status":"up:active","gid":24646},{"filesystem_id":1,"rank":1,"name":"h","status":"up:active","gid":24671},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24704}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"services":{"dashboard":"https://172.21.15.2:8443/"}},"servicemap":{"epoch":28,"modified":"2024-08-31T04:24:03.079681+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-31T04:24:42.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 msgr2=0x7f05f00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 0x7f05f00b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0604079ab0 tx=0x7f05f4005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:42.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 msgr2=0x7f060419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f060000d770 tx=0x7f060000dc30 comp rx=0 tx=0).stop 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 shutdown_connections 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0604110010 0x7f06041a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0604102db0 0x7f060419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f05f00b4c10 0x7f05f00b7120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 --2- 172.21.15.2:0/3689949533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0604102460 0x7f060419c450 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 >> 172.21.15.2:0/3689949533 conn(0x7f0604079560 msgr2=0x7f0604111410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 shutdown_connections 2024-08-31T04:24:42.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:42.402+0000 7f060b6e0640 1 -- 172.21.15.2:0/3689949533 wait complete. 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:42 smithi064 ceph-mon[22007]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:42 smithi064 ceph-mon[22007]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:42 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:42 smithi132 ceph-mon[22335]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:42 smithi132 ceph-mon[22335]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-08-31T04:24:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:42 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:24:43.217 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-31T04:24:43.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:24:43.475 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:43.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:43 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3689949533' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-08-31T04:24:43.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:43 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3689949533' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-08-31T04:24:43.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:43 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3689949533' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 -- 172.21.15.2:0/840292609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 msgr2=0x7f593010d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 --2- 172.21.15.2:0/840292609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f593010d6b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5924009900 tx=0x7f592402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 -- 172.21.15.2:0/840292609 shutdown_connections 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 --2- 172.21.15.2:0/840292609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f593010d6b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 --2- 172.21.15.2:0/840292609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 --2- 172.21.15.2:0/840292609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 0x7f5930104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 -- 172.21.15.2:0/840292609 >> 172.21.15.2:0/840292609 conn(0x7f59300794d0 msgr2=0x7f59300798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 -- 172.21.15.2:0/840292609 shutdown_connections 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.986+0000 7f5935097640 1 -- 172.21.15.2:0/840292609 wait complete. 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.987+0000 7f5935097640 1 Processor -- start 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.987+0000 7f5935097640 1 -- start start 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.987+0000 7f5935097640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 0x7f5930102550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.987+0000 7f5935097640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.987+0000 7f5935097640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5935097640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59301137c0 con 0x7f5930105070 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5935097640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5930113640 con 0x7f5930104640 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5935097640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5930113940 con 0x7f593010dbf0 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55244/0 (socket says 172.21.15.2:55244) 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 -- 172.21.15.2:0/11804412 learned_addr learned my addr 172.21.15.2:0/11804412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592f59e640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592ed9d640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 0x7f5930102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 -- 172.21.15.2:0/11804412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 msgr2=0x7f5930102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930102fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 -- 172.21.15.2:0/11804412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 msgr2=0x7f5930102550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 0x7f5930102550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 -- 172.21.15.2:0/11804412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59301a8590 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592f59e640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f592e59c640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5924032fd0 tx=0x7f5924004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592403f030 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59301a8820 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5924004490 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924035070 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.988+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59301a8d00 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.989+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5930104a50 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.991+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f5924042030 con 0x7f5930105070 2024-08-31T04:24:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.992+0000 7f5917fff640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 0x7f59180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:44.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.992+0000 7f592ed9d640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 0x7f59180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:44.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.992+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f5924106290 con 0x7f5930105070 2024-08-31T04:24:44.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.992+0000 7f592ed9d640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 0x7f59180b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5930103fa0 tx=0x7f592000b5d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:44.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:43.995+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f59240cccc0 con 0x7f5930105070 2024-08-31T04:24:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.176+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59300635a0 con 0x7f59180b4c10 2024-08-31T04:24:44.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.182+0000 7f5917fff640 1 -- 172.21.15.2:0/11804412 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340351 (secure 0 0 0) 0x7f59300635a0 con 0x7f59180b4c10 2024-08-31T04:24:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 msgr2=0x7f59180b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 0x7f59180b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5930103fa0 tx=0x7f592000b5d0 comp rx=0 tx=0).stop 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 msgr2=0x7f5930102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5924032fd0 tx=0x7f5924004270 comp rx=0 tx=0).stop 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 shutdown_connections 2024-08-31T04:24:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f59180b4c10 0x7f59180b7120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5930105070 0x7f5930102a90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f593010dbf0 0x7f5930102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 --2- 172.21.15.2:0/11804412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5930104640 0x7f5930102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 >> 172.21.15.2:0/11804412 conn(0x7f59300794d0 msgr2=0x7f59300ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 shutdown_connections 2024-08-31T04:24:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:44.186+0000 7f5935097640 1 -- 172.21.15.2:0/11804412 wait complete. 2024-08-31T04:24:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:44 smithi064 ceph-mon[22007]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:44.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:44 smithi132 ceph-mon[22335]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:44 smithi002 ceph-mon[18656]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-08-31T04:24:43.092453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":340,"num_write":296,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404492,"kb_used_data":13568,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537332,"statfs":{"total":1151940427776,"available":1151526227968,"internally_reserved":0,"allocated":13893632,"data_stored":7962314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.195462"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903727+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903727+0000","last_peered":"2024-08-31T04:24:34.903727+0000","last_clean":"2024-08-31T04:24:34.903727+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903727+0000","last_undegraded":"2024-08-31T04:24:34.903727+0000","last_fullsized":"2024-08-31T04:24:34.903727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923817+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:24:34.923817+0000","last_peered":"2024-08-31T04:24:34.923817+0000","last_clean":"2024-08-31T04:24:34.923817+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:24:34.923817+0000","last_undegraded":"2024-08-31T04:24:34.923817+0000","last_fullsized":"2024-08-31T04:24:34.923817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924279+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:34.924279+0000","last_peered":"2024-08-31T04:24:34.924279+0000","last_clean":"2024-08-31T04:24:34.924279+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:34.924279+0000","last_undegraded":"2024-08-31T04:24:34.924279+0000","last_fullsized":"2024-08-31T04:24:34.924279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175450+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:24:35.175450+0000","last_peered":"2024-08-31T04:24:35.175450+0000","last_clean":"2024-08-31T04:24:35.175450+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:24:35.175450+0000","last_undegraded":"2024-08-31T04:24:35.175450+0000","last_fullsized":"2024-08-31T04:24:35.175450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907951+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:34.907951+0000","last_peered":"2024-08-31T04:24:34.907951+0000","last_clean":"2024-08-31T04:24:34.907951+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:34.907951+0000","last_undegraded":"2024-08-31T04:24:34.907951+0000","last_fullsized":"2024-08-31T04:24:34.907951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903985+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:24:34.903985+0000","last_peered":"2024-08-31T04:24:34.903985+0000","last_clean":"2024-08-31T04:24:34.903985+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:24:34.903985+0000","last_undegraded":"2024-08-31T04:24:34.903985+0000","last_fullsized":"2024-08-31T04:24:34.903985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907828+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:34.907828+0000","last_peered":"2024-08-31T04:24:34.907828+0000","last_clean":"2024-08-31T04:24:34.907828+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:34.907828+0000","last_undegraded":"2024-08-31T04:24:34.907828+0000","last_fullsized":"2024-08-31T04:24:34.907828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902128+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:24:34.902128+0000","last_peered":"2024-08-31T04:24:34.902128+0000","last_clean":"2024-08-31T04:24:34.902128+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:24:34.902128+0000","last_undegraded":"2024-08-31T04:24:34.902128+0000","last_fullsized":"2024-08-31T04:24:34.902128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162940+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:24:35.162940+0000","last_peered":"2024-08-31T04:24:35.162940+0000","last_clean":"2024-08-31T04:24:35.162940+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:24:35.162940+0000","last_undegraded":"2024-08-31T04:24:35.162940+0000","last_fullsized":"2024-08-31T04:24:35.162940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907481+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:34.907481+0000","last_peered":"2024-08-31T04:24:34.907481+0000","last_clean":"2024-08-31T04:24:34.907481+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:34.907481+0000","last_undegraded":"2024-08-31T04:24:34.907481+0000","last_fullsized":"2024-08-31T04:24:34.907481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902903+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902903+0000","last_peered":"2024-08-31T04:24:34.902903+0000","last_clean":"2024-08-31T04:24:34.902903+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902903+0000","last_undegraded":"2024-08-31T04:24:34.902903+0000","last_fullsized":"2024-08-31T04:24:34.902903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923858+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:24:34.923858+0000","last_peered":"2024-08-31T04:24:34.923858+0000","last_clean":"2024-08-31T04:24:34.923858+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:24:34.923858+0000","last_undegraded":"2024-08-31T04:24:34.923858+0000","last_fullsized":"2024-08-31T04:24:34.923858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903339+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903339+0000","last_peered":"2024-08-31T04:24:34.903339+0000","last_clean":"2024-08-31T04:24:34.903339+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903339+0000","last_undegraded":"2024-08-31T04:24:34.903339+0000","last_fullsized":"2024-08-31T04:24:34.903339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902737+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902737+0000","last_peered":"2024-08-31T04:24:34.902737+0000","last_clean":"2024-08-31T04:24:34.902737+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902737+0000","last_undegraded":"2024-08-31T04:24:34.902737+0000","last_fullsized":"2024-08-31T04:24:34.902737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065328+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:24:35.065328+0000","last_peered":"2024-08-31T04:24:35.065328+0000","last_clean":"2024-08-31T04:24:35.065328+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:24:35.065328+0000","last_undegraded":"2024-08-31T04:24:35.065328+0000","last_fullsized":"2024-08-31T04:24:35.065328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924505+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:34.924505+0000","last_peered":"2024-08-31T04:24:34.924505+0000","last_clean":"2024-08-31T04:24:34.924505+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:34.924505+0000","last_undegraded":"2024-08-31T04:24:34.924505+0000","last_fullsized":"2024-08-31T04:24:34.924505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903317+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903317+0000","last_peered":"2024-08-31T04:24:34.903317+0000","last_clean":"2024-08-31T04:24:34.903317+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903317+0000","last_undegraded":"2024-08-31T04:24:34.903317+0000","last_fullsized":"2024-08-31T04:24:34.903317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907411+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:24:34.907411+0000","last_peered":"2024-08-31T04:24:34.907411+0000","last_clean":"2024-08-31T04:24:34.907411+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:24:34.907411+0000","last_undegraded":"2024-08-31T04:24:34.907411+0000","last_fullsized":"2024-08-31T04:24:34.907411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903872+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903872+0000","last_peered":"2024-08-31T04:24:34.903872+0000","last_clean":"2024-08-31T04:24:34.903872+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903872+0000","last_undegraded":"2024-08-31T04:24:34.903872+0000","last_fullsized":"2024-08-31T04:24:34.903872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902455+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902455+0000","last_peered":"2024-08-31T04:24:34.902455+0000","last_clean":"2024-08-31T04:24:34.902455+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902455+0000","last_undegraded":"2024-08-31T04:24:34.902455+0000","last_fullsized":"2024-08-31T04:24:34.902455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175253+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:24:35.175253+0000","last_peered":"2024-08-31T04:24:35.175253+0000","last_clean":"2024-08-31T04:24:35.175253+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:24:35.175253+0000","last_undegraded":"2024-08-31T04:24:35.175253+0000","last_fullsized":"2024-08-31T04:24:35.175253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903158+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903158+0000","last_peered":"2024-08-31T04:24:34.903158+0000","last_clean":"2024-08-31T04:24:34.903158+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903158+0000","last_undegraded":"2024-08-31T04:24:34.903158+0000","last_fullsized":"2024-08-31T04:24:34.903158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903836+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903836+0000","last_peered":"2024-08-31T04:24:34.903836+0000","last_clean":"2024-08-31T04:24:34.903836+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903836+0000","last_undegraded":"2024-08-31T04:24:34.903836+0000","last_fullsized":"2024-08-31T04:24:34.903836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164784+0000","last_change":"2024-08-31T04:24:35.164680+0000","last_active":"2024-08-31T04:24:35.164784+0000","last_peered":"2024-08-31T04:24:35.164784+0000","last_clean":"2024-08-31T04:24:35.164784+0000","last_became_active":"2024-08-31T04:24:35.164257+0000","last_became_peered":"2024-08-31T04:24:35.164257+0000","last_unstale":"2024-08-31T04:24:35.164784+0000","last_undegraded":"2024-08-31T04:24:35.164784+0000","last_fullsized":"2024-08-31T04:24:35.164784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:26.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903383+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:24:34.903383+0000","last_peered":"2024-08-31T04:24:34.903383+0000","last_clean":"2024-08-31T04:24:34.903383+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:24:34.903383+0000","last_undegraded":"2024-08-31T04:24:34.903383+0000","last_fullsized":"2024-08-31T04:24:34.903383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923566+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:34.923566+0000","last_peered":"2024-08-31T04:24:34.923566+0000","last_clean":"2024-08-31T04:24:34.923566+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:34.923566+0000","last_undegraded":"2024-08-31T04:24:34.923566+0000","last_fullsized":"2024-08-31T04:24:34.923566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899720+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:24:34.899720+0000","last_peered":"2024-08-31T04:24:34.899720+0000","last_clean":"2024-08-31T04:24:34.899720+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:24:34.899720+0000","last_undegraded":"2024-08-31T04:24:34.899720+0000","last_fullsized":"2024-08-31T04:24:34.899720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908105+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:34.908105+0000","last_peered":"2024-08-31T04:24:34.908105+0000","last_clean":"2024-08-31T04:24:34.908105+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:34.908105+0000","last_undegraded":"2024-08-31T04:24:34.908105+0000","last_fullsized":"2024-08-31T04:24:34.908105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065341+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065341+0000","last_peered":"2024-08-31T04:24:35.065341+0000","last_clean":"2024-08-31T04:24:35.065341+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065341+0000","last_undegraded":"2024-08-31T04:24:35.065341+0000","last_fullsized":"2024-08-31T04:24:35.065341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175761+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:24:35.175761+0000","last_peered":"2024-08-31T04:24:35.175761+0000","last_clean":"2024-08-31T04:24:35.175761+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:24:35.175761+0000","last_undegraded":"2024-08-31T04:24:35.175761+0000","last_fullsized":"2024-08-31T04:24:35.175761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903204+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903204+0000","last_peered":"2024-08-31T04:24:34.903204+0000","last_clean":"2024-08-31T04:24:34.903204+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903204+0000","last_undegraded":"2024-08-31T04:24:34.903204+0000","last_fullsized":"2024-08-31T04:24:34.903204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907286+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:34.907286+0000","last_peered":"2024-08-31T04:24:34.907286+0000","last_clean":"2024-08-31T04:24:34.907286+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:34.907286+0000","last_undegraded":"2024-08-31T04:24:34.907286+0000","last_fullsized":"2024-08-31T04:24:34.907286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175688+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:24:35.175688+0000","last_peered":"2024-08-31T04:24:35.175688+0000","last_clean":"2024-08-31T04:24:35.175688+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:24:35.175688+0000","last_undegraded":"2024-08-31T04:24:35.175688+0000","last_fullsized":"2024-08-31T04:24:35.175688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163308+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163308+0000","last_peered":"2024-08-31T04:24:35.163308+0000","last_clean":"2024-08-31T04:24:35.163308+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163308+0000","last_undegraded":"2024-08-31T04:24:35.163308+0000","last_fullsized":"2024-08-31T04:24:35.163308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899462+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899462+0000","last_peered":"2024-08-31T04:24:34.899462+0000","last_clean":"2024-08-31T04:24:34.899462+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899462+0000","last_undegraded":"2024-08-31T04:24:34.899462+0000","last_fullsized":"2024-08-31T04:24:34.899462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.909200+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:24:34.909200+0000","last_peered":"2024-08-31T04:24:34.909200+0000","last_clean":"2024-08-31T04:24:34.909200+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:24:34.909200+0000","last_undegraded":"2024-08-31T04:24:34.909200+0000","last_fullsized":"2024-08-31T04:24:34.909200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:39.521805+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:24:39.521805+0000","last_peered":"2024-08-31T04:24:39.521805+0000","last_clean":"2024-08-31T04:24:39.521805+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:24:39.521805+0000","last_undegraded":"2024-08-31T04:24:39.521805+0000","last_fullsized":"2024-08-31T04:24:39.521805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899665+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899665+0000","last_peered":"2024-08-31T04:24:34.899665+0000","last_clean":"2024-08-31T04:24:34.899665+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899665+0000","last_undegraded":"2024-08-31T04:24:34.899665+0000","last_fullsized":"2024-08-31T04:24:34.899665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899079+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:24:34.899079+0000","last_peered":"2024-08-31T04:24:34.899079+0000","last_clean":"2024-08-31T04:24:34.899079+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:24:34.899079+0000","last_undegraded":"2024-08-31T04:24:34.899079+0000","last_fullsized":"2024-08-31T04:24:34.899079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162741+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.162741+0000","last_peered":"2024-08-31T04:24:35.162741+0000","last_clean":"2024-08-31T04:24:35.162741+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.162741+0000","last_undegraded":"2024-08-31T04:24:35.162741+0000","last_fullsized":"2024-08-31T04:24:35.162741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902421+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902421+0000","last_peered":"2024-08-31T04:24:34.902421+0000","last_clean":"2024-08-31T04:24:34.902421+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902421+0000","last_undegraded":"2024-08-31T04:24:34.902421+0000","last_fullsized":"2024-08-31T04:24:34.902421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924595+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:24:34.924595+0000","last_peered":"2024-08-31T04:24:34.924595+0000","last_clean":"2024-08-31T04:24:34.924595+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:24:34.924595+0000","last_undegraded":"2024-08-31T04:24:34.924595+0000","last_fullsized":"2024-08-31T04:24:34.924595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902599+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902599+0000","last_peered":"2024-08-31T04:24:34.902599+0000","last_clean":"2024-08-31T04:24:34.902599+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902599+0000","last_undegraded":"2024-08-31T04:24:34.902599+0000","last_fullsized":"2024-08-31T04:24:34.902599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162974+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.162974+0000","last_peered":"2024-08-31T04:24:35.162974+0000","last_clean":"2024-08-31T04:24:35.162974+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.162974+0000","last_undegraded":"2024-08-31T04:24:35.162974+0000","last_fullsized":"2024-08-31T04:24:35.162974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163451+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:24:35.163451+0000","last_peered":"2024-08-31T04:24:35.163451+0000","last_clean":"2024-08-31T04:24:35.163451+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:24:35.163451+0000","last_undegraded":"2024-08-31T04:24:35.163451+0000","last_fullsized":"2024-08-31T04:24:35.163451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904175+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904175+0000","last_peered":"2024-08-31T04:24:34.904175+0000","last_clean":"2024-08-31T04:24:34.904175+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904175+0000","last_undegraded":"2024-08-31T04:24:34.904175+0000","last_fullsized":"2024-08-31T04:24:34.904175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163017+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:24:35.163017+0000","last_peered":"2024-08-31T04:24:35.163017+0000","last_clean":"2024-08-31T04:24:35.163017+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:24:35.163017+0000","last_undegraded":"2024-08-31T04:24:35.163017+0000","last_fullsized":"2024-08-31T04:24:35.163017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902460+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902460+0000","last_peered":"2024-08-31T04:24:34.902460+0000","last_clean":"2024-08-31T04:24:34.902460+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902460+0000","last_undegraded":"2024-08-31T04:24:34.902460+0000","last_fullsized":"2024-08-31T04:24:34.902460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175079+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175079+0000","last_peered":"2024-08-31T04:24:35.175079+0000","last_clean":"2024-08-31T04:24:35.175079+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175079+0000","last_undegraded":"2024-08-31T04:24:35.175079+0000","last_fullsized":"2024-08-31T04:24:35.175079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163666+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:24:35.163666+0000","last_peered":"2024-08-31T04:24:35.163666+0000","last_clean":"2024-08-31T04:24:35.163666+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:24:35.163666+0000","last_undegraded":"2024-08-31T04:24:35.163666+0000","last_fullsized":"2024-08-31T04:24:35.163666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899735+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899735+0000","last_peered":"2024-08-31T04:24:34.899735+0000","last_clean":"2024-08-31T04:24:34.899735+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899735+0000","last_undegraded":"2024-08-31T04:24:34.899735+0000","last_fullsized":"2024-08-31T04:24:34.899735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900596+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900596+0000","last_peered":"2024-08-31T04:24:34.900596+0000","last_clean":"2024-08-31T04:24:34.900596+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900596+0000","last_undegraded":"2024-08-31T04:24:34.900596+0000","last_fullsized":"2024-08-31T04:24:34.900596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065886+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:24:35.065886+0000","last_peered":"2024-08-31T04:24:35.065886+0000","last_clean":"2024-08-31T04:24:35.065886+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:24:35.065886+0000","last_undegraded":"2024-08-31T04:24:35.065886+0000","last_fullsized":"2024-08-31T04:24:35.065886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907623+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:24:34.907623+0000","last_peered":"2024-08-31T04:24:34.907623+0000","last_clean":"2024-08-31T04:24:34.907623+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:24:34.907623+0000","last_undegraded":"2024-08-31T04:24:34.907623+0000","last_fullsized":"2024-08-31T04:24:34.907623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900723+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900723+0000","last_peered":"2024-08-31T04:24:34.900723+0000","last_clean":"2024-08-31T04:24:34.900723+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900723+0000","last_undegraded":"2024-08-31T04:24:34.900723+0000","last_fullsized":"2024-08-31T04:24:34.900723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901214+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:24:34.901214+0000","last_peered":"2024-08-31T04:24:34.901214+0000","last_clean":"2024-08-31T04:24:34.901214+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:24:34.901214+0000","last_undegraded":"2024-08-31T04:24:34.901214+0000","last_fullsized":"2024-08-31T04:24:34.901214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907069+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:34.907069+0000","last_peered":"2024-08-31T04:24:34.907069+0000","last_clean":"2024-08-31T04:24:34.907069+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:34.907069+0000","last_undegraded":"2024-08-31T04:24:34.907069+0000","last_fullsized":"2024-08-31T04:24:34.907069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162525+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:24:35.162525+0000","last_peered":"2024-08-31T04:24:35.162525+0000","last_clean":"2024-08-31T04:24:35.162525+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:24:35.162525+0000","last_undegraded":"2024-08-31T04:24:35.162525+0000","last_fullsized":"2024-08-31T04:24:35.162525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:40.524329+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:24:40.524329+0000","last_peered":"2024-08-31T04:24:40.524329+0000","last_clean":"2024-08-31T04:24:40.524329+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:24:40.524329+0000","last_undegraded":"2024-08-31T04:24:40.524329+0000","last_fullsized":"2024-08-31T04:24:40.524329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176861+0000","last_change":"2024-08-31T04:24:35.176740+0000","last_active":"2024-08-31T04:24:35.176861+0000","last_peered":"2024-08-31T04:24:35.176861+0000","last_clean":"2024-08-31T04:24:35.176861+0000","last_became_active":"2024-08-31T04:24:35.176138+0000","last_became_peered":"2024-08-31T04:24:35.176138+0000","last_unstale":"2024-08-31T04:24:35.176861+0000","last_undegraded":"2024-08-31T04:24:35.176861+0000","last_fullsized":"2024-08-31T04:24:35.176861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:42:51.558180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163003+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:24:35.163003+0000","last_peered":"2024-08-31T04:24:35.163003+0000","last_clean":"2024-08-31T04:24:35.163003+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:24:35.163003+0000","last_undegraded":"2024-08-31T04:24:35.163003+0000","last_fullsized":"2024-08-31T04:24:35.163003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901294+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901294+0000","last_peered":"2024-08-31T04:24:34.901294+0000","last_clean":"2024-08-31T04:24:34.901294+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901294+0000","last_undegraded":"2024-08-31T04:24:34.901294+0000","last_fullsized":"2024-08-31T04:24:34.901294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065345+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065345+0000","last_peered":"2024-08-31T04:24:35.065345+0000","last_clean":"2024-08-31T04:24:35.065345+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065345+0000","last_undegraded":"2024-08-31T04:24:35.065345+0000","last_fullsized":"2024-08-31T04:24:35.065345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164616+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:24:35.164616+0000","last_peered":"2024-08-31T04:24:35.164616+0000","last_clean":"2024-08-31T04:24:35.164616+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:24:35.164616+0000","last_undegraded":"2024-08-31T04:24:35.164616+0000","last_fullsized":"2024-08-31T04:24:35.164616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903598+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903598+0000","last_peered":"2024-08-31T04:24:34.903598+0000","last_clean":"2024-08-31T04:24:34.903598+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903598+0000","last_undegraded":"2024-08-31T04:24:34.903598+0000","last_fullsized":"2024-08-31T04:24:34.903598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907989+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:24:34.907989+0000","last_peered":"2024-08-31T04:24:34.907989+0000","last_clean":"2024-08-31T04:24:34.907989+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:24:34.907989+0000","last_undegraded":"2024-08-31T04:24:34.907989+0000","last_fullsized":"2024-08-31T04:24:34.907989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:40.523385+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:24:40.523385+0000","last_peered":"2024-08-31T04:24:40.523385+0000","last_clean":"2024-08-31T04:24:40.523385+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:24:40.523385+0000","last_undegraded":"2024-08-31T04:24:40.523385+0000","last_fullsized":"2024-08-31T04:24:40.523385+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":129,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902970+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.902970+0000","last_peered":"2024-08-31T04:24:34.902970+0000","last_clean":"2024-08-31T04:24:34.902970+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.902970+0000","last_undegraded":"2024-08-31T04:24:34.902970+0000","last_fullsized":"2024-08-31T04:24:34.902970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904119+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:24:34.904119+0000","last_peered":"2024-08-31T04:24:34.904119+0000","last_clean":"2024-08-31T04:24:34.904119+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:24:34.904119+0000","last_undegraded":"2024-08-31T04:24:34.904119+0000","last_fullsized":"2024-08-31T04:24:34.904119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902335+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902335+0000","last_peered":"2024-08-31T04:24:34.902335+0000","last_clean":"2024-08-31T04:24:34.902335+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902335+0000","last_undegraded":"2024-08-31T04:24:34.902335+0000","last_fullsized":"2024-08-31T04:24:34.902335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177602+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.177602+0000","last_peered":"2024-08-31T04:24:35.177602+0000","last_clean":"2024-08-31T04:24:35.177602+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.177602+0000","last_undegraded":"2024-08-31T04:24:35.177602+0000","last_fullsized":"2024-08-31T04:24:35.177602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175519+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:24:35.175519+0000","last_peered":"2024-08-31T04:24:35.175519+0000","last_clean":"2024-08-31T04:24:35.175519+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:24:35.175519+0000","last_undegraded":"2024-08-31T04:24:35.175519+0000","last_fullsized":"2024-08-31T04:24:35.175519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163405+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163405+0000","last_peered":"2024-08-31T04:24:35.163405+0000","last_clean":"2024-08-31T04:24:35.163405+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163405+0000","last_undegraded":"2024-08-31T04:24:35.163405+0000","last_fullsized":"2024-08-31T04:24:35.163405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902696+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902696+0000","last_peered":"2024-08-31T04:24:34.902696+0000","last_clean":"2024-08-31T04:24:34.902696+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902696+0000","last_undegraded":"2024-08-31T04:24:34.902696+0000","last_fullsized":"2024-08-31T04:24:34.902696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.905097+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:24:34.905097+0000","last_peered":"2024-08-31T04:24:34.905097+0000","last_clean":"2024-08-31T04:24:34.905097+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:24:34.905097+0000","last_undegraded":"2024-08-31T04:24:34.905097+0000","last_fullsized":"2024-08-31T04:24:34.905097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:39.521744+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:24:39.521744+0000","last_peered":"2024-08-31T04:24:39.521744+0000","last_clean":"2024-08-31T04:24:39.521744+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:24:39.521744+0000","last_undegraded":"2024-08-31T04:24:39.521744+0000","last_fullsized":"2024-08-31T04:24:39.521744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924270+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:34.924270+0000","last_peered":"2024-08-31T04:24:34.924270+0000","last_clean":"2024-08-31T04:24:34.924270+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:34.924270+0000","last_undegraded":"2024-08-31T04:24:34.924270+0000","last_fullsized":"2024-08-31T04:24:34.924270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175070+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175070+0000","last_peered":"2024-08-31T04:24:35.175070+0000","last_clean":"2024-08-31T04:24:35.175070+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175070+0000","last_undegraded":"2024-08-31T04:24:35.175070+0000","last_fullsized":"2024-08-31T04:24:35.175070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902852+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:24:34.902852+0000","last_peered":"2024-08-31T04:24:34.902852+0000","last_clean":"2024-08-31T04:24:34.902852+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:24:34.902852+0000","last_undegraded":"2024-08-31T04:24:34.902852+0000","last_fullsized":"2024-08-31T04:24:34.902852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901010+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901010+0000","last_peered":"2024-08-31T04:24:34.901010+0000","last_clean":"2024-08-31T04:24:34.901010+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901010+0000","last_undegraded":"2024-08-31T04:24:34.901010+0000","last_fullsized":"2024-08-31T04:24:34.901010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065811+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065811+0000","last_peered":"2024-08-31T04:24:35.065811+0000","last_clean":"2024-08-31T04:24:35.065811+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065811+0000","last_undegraded":"2024-08-31T04:24:35.065811+0000","last_fullsized":"2024-08-31T04:24:35.065811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923740+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:24:34.923740+0000","last_peered":"2024-08-31T04:24:34.923740+0000","last_clean":"2024-08-31T04:24:34.923740+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:24:34.923740+0000","last_undegraded":"2024-08-31T04:24:34.923740+0000","last_fullsized":"2024-08-31T04:24:34.923740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899145+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899145+0000","last_peered":"2024-08-31T04:24:34.899145+0000","last_clean":"2024-08-31T04:24:34.899145+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899145+0000","last_undegraded":"2024-08-31T04:24:34.899145+0000","last_fullsized":"2024-08-31T04:24:34.899145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175580+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175580+0000","last_peered":"2024-08-31T04:24:35.175580+0000","last_clean":"2024-08-31T04:24:35.175580+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175580+0000","last_undegraded":"2024-08-31T04:24:35.175580+0000","last_fullsized":"2024-08-31T04:24:35.175580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.925663+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:24:34.925663+0000","last_peered":"2024-08-31T04:24:34.925663+0000","last_clean":"2024-08-31T04:24:34.925663+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:24:34.925663+0000","last_undegraded":"2024-08-31T04:24:34.925663+0000","last_fullsized":"2024-08-31T04:24:34.925663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:40.524066+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:24:40.524066+0000","last_peered":"2024-08-31T04:24:40.524066+0000","last_clean":"2024-08-31T04:24:40.524066+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:24:40.524066+0000","last_undegraded":"2024-08-31T04:24:40.524066+0000","last_fullsized":"2024-08-31T04:24:40.524066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907446+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:24:34.907446+0000","last_peered":"2024-08-31T04:24:34.907446+0000","last_clean":"2024-08-31T04:24:34.907446+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:24:34.907446+0000","last_undegraded":"2024-08-31T04:24:34.907446+0000","last_fullsized":"2024-08-31T04:24:34.907446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065181+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:24:35.065181+0000","last_peered":"2024-08-31T04:24:35.065181+0000","last_clean":"2024-08-31T04:24:35.065181+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:24:35.065181+0000","last_undegraded":"2024-08-31T04:24:35.065181+0000","last_fullsized":"2024-08-31T04:24:35.065181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.911653+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:24:34.911653+0000","last_peered":"2024-08-31T04:24:34.911653+0000","last_clean":"2024-08-31T04:24:34.911653+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:24:34.911653+0000","last_undegraded":"2024-08-31T04:24:34.911653+0000","last_fullsized":"2024-08-31T04:24:34.911653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903193+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:24:34.903193+0000","last_peered":"2024-08-31T04:24:34.903193+0000","last_clean":"2024-08-31T04:24:34.903193+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:24:34.903193+0000","last_undegraded":"2024-08-31T04:24:34.903193+0000","last_fullsized":"2024-08-31T04:24:34.903193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175197+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:24:35.175197+0000","last_peered":"2024-08-31T04:24:35.175197+0000","last_clean":"2024-08-31T04:24:35.175197+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:24:35.175197+0000","last_undegraded":"2024-08-31T04:24:35.175197+0000","last_fullsized":"2024-08-31T04:24:35.175197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899594+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:24:34.899594+0000","last_peered":"2024-08-31T04:24:34.899594+0000","last_clean":"2024-08-31T04:24:34.899594+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:24:34.899594+0000","last_undegraded":"2024-08-31T04:24:34.899594+0000","last_fullsized":"2024-08-31T04:24:34.899594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065801+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:24:35.065801+0000","last_peered":"2024-08-31T04:24:35.065801+0000","last_clean":"2024-08-31T04:24:35.065801+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:24:35.065801+0000","last_undegraded":"2024-08-31T04:24:35.065801+0000","last_fullsized":"2024-08-31T04:24:35.065801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904210+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:24:34.904210+0000","last_peered":"2024-08-31T04:24:34.904210+0000","last_clean":"2024-08-31T04:24:34.904210+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:24:34.904210+0000","last_undegraded":"2024-08-31T04:24:34.904210+0000","last_fullsized":"2024-08-31T04:24:34.904210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924032+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:24:34.924032+0000","last_peered":"2024-08-31T04:24:34.924032+0000","last_clean":"2024-08-31T04:24:34.924032+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:24:34.924032+0000","last_undegraded":"2024-08-31T04:24:34.924032+0000","last_fullsized":"2024-08-31T04:24:34.924032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900794+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:24:34.900794+0000","last_peered":"2024-08-31T04:24:34.900794+0000","last_clean":"2024-08-31T04:24:34.900794+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:24:34.900794+0000","last_undegraded":"2024-08-31T04:24:34.900794+0000","last_fullsized":"2024-08-31T04:24:34.900794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924387+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:24:34.924387+0000","last_peered":"2024-08-31T04:24:34.924387+0000","last_clean":"2024-08-31T04:24:34.924387+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:24:34.924387+0000","last_undegraded":"2024-08-31T04:24:34.924387+0000","last_fullsized":"2024-08-31T04:24:34.924387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904954+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:24:34.904954+0000","last_peered":"2024-08-31T04:24:34.904954+0000","last_clean":"2024-08-31T04:24:34.904954+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:24:34.904954+0000","last_undegraded":"2024-08-31T04:24:34.904954+0000","last_fullsized":"2024-08-31T04:24:34.904954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899543+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:24:34.899543+0000","last_peered":"2024-08-31T04:24:34.899543+0000","last_clean":"2024-08-31T04:24:34.899543+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:24:34.899543+0000","last_undegraded":"2024-08-31T04:24:34.899543+0000","last_fullsized":"2024-08-31T04:24:34.899543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065440+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:24:35.065440+0000","last_peered":"2024-08-31T04:24:35.065440+0000","last_clean":"2024-08-31T04:24:35.065440+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:24:35.065440+0000","last_undegraded":"2024-08-31T04:24:35.065440+0000","last_fullsized":"2024-08-31T04:24:35.065440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904117+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:24:34.904117+0000","last_peered":"2024-08-31T04:24:34.904117+0000","last_clean":"2024-08-31T04:24:34.904117+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:24:34.904117+0000","last_undegraded":"2024-08-31T04:24:34.904117+0000","last_fullsized":"2024-08-31T04:24:34.904117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903380+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:24:34.903380+0000","last_peered":"2024-08-31T04:24:34.903380+0000","last_clean":"2024-08-31T04:24:34.903380+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:24:34.903380+0000","last_undegraded":"2024-08-31T04:24:34.903380+0000","last_fullsized":"2024-08-31T04:24:34.903380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065997+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:24:35.065997+0000","last_peered":"2024-08-31T04:24:35.065997+0000","last_clean":"2024-08-31T04:24:35.065997+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:24:35.065997+0000","last_undegraded":"2024-08-31T04:24:35.065997+0000","last_fullsized":"2024-08-31T04:24:35.065997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902825+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:24:34.902825+0000","last_peered":"2024-08-31T04:24:34.902825+0000","last_clean":"2024-08-31T04:24:34.902825+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:24:34.902825+0000","last_undegraded":"2024-08-31T04:24:34.902825+0000","last_fullsized":"2024-08-31T04:24:34.902825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175085+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:24:35.175085+0000","last_peered":"2024-08-31T04:24:35.175085+0000","last_clean":"2024-08-31T04:24:35.175085+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:24:35.175085+0000","last_undegraded":"2024-08-31T04:24:35.175085+0000","last_fullsized":"2024-08-31T04:24:35.175085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174791+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:24:35.174791+0000","last_peered":"2024-08-31T04:24:35.174791+0000","last_clean":"2024-08-31T04:24:35.174791+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:24:35.174791+0000","last_undegraded":"2024-08-31T04:24:35.174791+0000","last_fullsized":"2024-08-31T04:24:35.174791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899425+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:24:34.899425+0000","last_peered":"2024-08-31T04:24:34.899425+0000","last_clean":"2024-08-31T04:24:34.899425+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:24:34.899425+0000","last_undegraded":"2024-08-31T04:24:34.899425+0000","last_fullsized":"2024-08-31T04:24:34.899425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902899+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:24:34.902899+0000","last_peered":"2024-08-31T04:24:34.902899+0000","last_clean":"2024-08-31T04:24:34.902899+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:24:34.902899+0000","last_undegraded":"2024-08-31T04:24:34.902899+0000","last_fullsized":"2024-08-31T04:24:34.902899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163355+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:24:35.163355+0000","last_peered":"2024-08-31T04:24:35.163355+0000","last_clean":"2024-08-31T04:24:35.163355+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:24:35.163355+0000","last_undegraded":"2024-08-31T04:24:35.163355+0000","last_fullsized":"2024-08-31T04:24:35.163355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176164+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:24:35.176164+0000","last_peered":"2024-08-31T04:24:35.176164+0000","last_clean":"2024-08-31T04:24:35.176164+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:24:35.176164+0000","last_undegraded":"2024-08-31T04:24:35.176164+0000","last_fullsized":"2024-08-31T04:24:35.176164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.165355+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:24:35.165355+0000","last_peered":"2024-08-31T04:24:35.165355+0000","last_clean":"2024-08-31T04:24:35.165355+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:24:35.165355+0000","last_undegraded":"2024-08-31T04:24:35.165355+0000","last_fullsized":"2024-08-31T04:24:35.165355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923711+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:24:34.923711+0000","last_peered":"2024-08-31T04:24:34.923711+0000","last_clean":"2024-08-31T04:24:34.923711+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:24:34.923711+0000","last_undegraded":"2024-08-31T04:24:34.923711+0000","last_fullsized":"2024-08-31T04:24:34.923711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162846+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:24:35.162846+0000","last_peered":"2024-08-31T04:24:35.162846+0000","last_clean":"2024-08-31T04:24:35.162846+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:24:35.162846+0000","last_undegraded":"2024-08-31T04:24:35.162846+0000","last_fullsized":"2024-08-31T04:24:35.162846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175550+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:24:35.175550+0000","last_peered":"2024-08-31T04:24:35.175550+0000","last_clean":"2024-08-31T04:24:35.175550+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:24:35.175550+0000","last_undegraded":"2024-08-31T04:24:35.175550+0000","last_fullsized":"2024-08-31T04:24:35.175550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907836+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:24:34.907836+0000","last_peered":"2024-08-31T04:24:34.907836+0000","last_clean":"2024-08-31T04:24:34.907836+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:24:34.907836+0000","last_undegraded":"2024-08-31T04:24:34.907836+0000","last_fullsized":"2024-08-31T04:24:34.907836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903035+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:24:34.903035+0000","last_peered":"2024-08-31T04:24:34.903035+0000","last_clean":"2024-08-31T04:24:34.903035+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:24:34.903035+0000","last_undegraded":"2024-08-31T04:24:34.903035+0000","last_fullsized":"2024-08-31T04:24:34.903035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174870+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:24:35.174870+0000","last_peered":"2024-08-31T04:24:35.174870+0000","last_clean":"2024-08-31T04:24:35.174870+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:24:35.174870+0000","last_undegraded":"2024-08-31T04:24:35.174870+0000","last_fullsized":"2024-08-31T04:24:35.174870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175219+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:24:35.175219+0000","last_peered":"2024-08-31T04:24:35.175219+0000","last_clean":"2024-08-31T04:24:35.175219+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:24:35.175219+0000","last_undegraded":"2024-08-31T04:24:35.175219+0000","last_fullsized":"2024-08-31T04:24:35.175219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065991+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:24:35.065991+0000","last_peered":"2024-08-31T04:24:35.065991+0000","last_clean":"2024-08-31T04:24:35.065991+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:24:35.065991+0000","last_undegraded":"2024-08-31T04:24:35.065991+0000","last_fullsized":"2024-08-31T04:24:35.065991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":398,"num_read_kb":271,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":987136,"data_stored":501642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1667072,"data_stored":1152872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1585152,"data_stored":1096106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1092282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":502677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":987136,"data_stored":496235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":560715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":561151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:24:45.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:45 smithi002 ceph-mon[18656]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:45.468 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:45 smithi132 ceph-mon[22335]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:45.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:45 smithi064 ceph-mon[22007]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:46.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:46 smithi064 ceph-mon[22007]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T04:24:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:46 smithi132 ceph-mon[22335]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T04:24:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:46 smithi002 ceph-mon[18656]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T04:24:48.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:24:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:48.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:48 smithi002 ceph-mon[18656]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:48 smithi064 ceph-mon[22007]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:48 smithi132 ceph-mon[22335]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2546108054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e4102f30 msgr2=0x7fa0e4103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2546108054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e4102f30 0x7fa0e4103340 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009900 tx=0x7fa0e002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2546108054 shutdown_connections 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2546108054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4108af0 0x7fa0e410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2546108054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e41081a0 0x7fa0e41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2546108054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e4102f30 0x7fa0e4103340 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2546108054 >> 172.21.15.2:0/2546108054 conn(0x7fa0e4079d30 msgr2=0x7fa0e407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2546108054 shutdown_connections 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2546108054 wait complete. 2024-08-31T04:24:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 Processor -- start 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.773+0000 7fa0eb4f2640 1 -- start start 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4102f30 0x7fa0e419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e4108af0 0x7fa0e419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41127c0 con 0x7fa0e41081a0 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4112640 con 0x7fa0e4102f30 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0eb4f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4112940 con 0x7fa0e4108af0 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53838/0 (socket says 172.21.15.2:53838) 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 -- 172.21.15.2:0/2093428081 learned_addr learned my addr 172.21.15.2:0/2093428081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e928e640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4102f30 0x7fa0e419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e9a8f640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e4108af0 0x7fa0e419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 -- 172.21.15.2:0/2093428081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e4108af0 msgr2=0x7fa0e419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e4108af0 0x7fa0e419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 -- 172.21.15.2:0/2093428081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4102f30 msgr2=0x7fa0e419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4102f30 0x7fa0e419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 -- 172.21.15.2:0/2093428081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e41a0290 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.774+0000 7fa0e8a8d640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d750 tx=0x7fa0d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.775+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4017070 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.775+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d40054d0 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.775+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e41a0580 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.775+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4004c30 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.775+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41a6ce0 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.776+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e4103340 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.777+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fa0d4004dd0 con 0x7fa0e41081a0 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.778+0000 7fa0da7fc640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 0x7fa0d00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.778+0000 7fa0e928e640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 0x7fa0d00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:48.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.778+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fa0d40e5680 con 0x7fa0e41081a0 2024-08-31T04:24:48.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.779+0000 7fa0e928e640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 0x7fa0d00b7120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0031440 tx=0x7fa0e0009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:48.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.781+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0d40ac110 con 0x7fa0e41081a0 2024-08-31T04:24:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.962+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0e40635a0 con 0x7fa0d00b4c10 2024-08-31T04:24:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.970+0000 7fa0da7fc640 1 -- 172.21.15.2:0/2093428081 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340328 (secure 0 0 0) 0x7fa0e40635a0 con 0x7fa0d00b4c10 2024-08-31T04:24:48.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:24:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 msgr2=0x7fa0d00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 0x7fa0d00b7120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0031440 tx=0x7fa0e0009560 comp rx=0 tx=0).stop 2024-08-31T04:24:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 msgr2=0x7fa0e419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d750 tx=0x7fa0d400dc10 comp rx=0 tx=0).stop 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 shutdown_connections 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa0d00b4c10 0x7fa0d00b7120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0e41081a0 0x7fa0e419a8c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0e4108af0 0x7fa0e419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 --2- 172.21.15.2:0/2093428081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4102f30 0x7fa0e419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 >> 172.21.15.2:0/2093428081 conn(0x7fa0e4079d30 msgr2=0x7fa0e41010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 shutdown_connections 2024-08-31T04:24:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:48.973+0000 7fa0eb4f2640 1 -- 172.21.15.2:0/2093428081 wait complete. 2024-08-31T04:24:49.709 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-08-31T04:24:47.093910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":509,"num_read_kb":355,"num_write":296,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404492,"kb_used_data":13568,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537332,"statfs":{"total":1151940427776,"available":1151526227968,"internally_reserved":0,"allocated":13893632,"data_stored":7962314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003693"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903727+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903727+0000","last_peered":"2024-08-31T04:24:34.903727+0000","last_clean":"2024-08-31T04:24:34.903727+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903727+0000","last_undegraded":"2024-08-31T04:24:34.903727+0000","last_fullsized":"2024-08-31T04:24:34.903727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923817+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:24:34.923817+0000","last_peered":"2024-08-31T04:24:34.923817+0000","last_clean":"2024-08-31T04:24:34.923817+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:24:34.923817+0000","last_undegraded":"2024-08-31T04:24:34.923817+0000","last_fullsized":"2024-08-31T04:24:34.923817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924279+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:34.924279+0000","last_peered":"2024-08-31T04:24:34.924279+0000","last_clean":"2024-08-31T04:24:34.924279+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:34.924279+0000","last_undegraded":"2024-08-31T04:24:34.924279+0000","last_fullsized":"2024-08-31T04:24:34.924279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175450+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:24:35.175450+0000","last_peered":"2024-08-31T04:24:35.175450+0000","last_clean":"2024-08-31T04:24:35.175450+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:24:35.175450+0000","last_undegraded":"2024-08-31T04:24:35.175450+0000","last_fullsized":"2024-08-31T04:24:35.175450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907951+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:34.907951+0000","last_peered":"2024-08-31T04:24:34.907951+0000","last_clean":"2024-08-31T04:24:34.907951+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:34.907951+0000","last_undegraded":"2024-08-31T04:24:34.907951+0000","last_fullsized":"2024-08-31T04:24:34.907951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903985+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:24:34.903985+0000","last_peered":"2024-08-31T04:24:34.903985+0000","last_clean":"2024-08-31T04:24:34.903985+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:24:34.903985+0000","last_undegraded":"2024-08-31T04:24:34.903985+0000","last_fullsized":"2024-08-31T04:24:34.903985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907828+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:34.907828+0000","last_peered":"2024-08-31T04:24:34.907828+0000","last_clean":"2024-08-31T04:24:34.907828+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:34.907828+0000","last_undegraded":"2024-08-31T04:24:34.907828+0000","last_fullsized":"2024-08-31T04:24:34.907828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902128+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:24:34.902128+0000","last_peered":"2024-08-31T04:24:34.902128+0000","last_clean":"2024-08-31T04:24:34.902128+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:24:34.902128+0000","last_undegraded":"2024-08-31T04:24:34.902128+0000","last_fullsized":"2024-08-31T04:24:34.902128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162940+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:24:35.162940+0000","last_peered":"2024-08-31T04:24:35.162940+0000","last_clean":"2024-08-31T04:24:35.162940+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:24:35.162940+0000","last_undegraded":"2024-08-31T04:24:35.162940+0000","last_fullsized":"2024-08-31T04:24:35.162940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907481+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:34.907481+0000","last_peered":"2024-08-31T04:24:34.907481+0000","last_clean":"2024-08-31T04:24:34.907481+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:34.907481+0000","last_undegraded":"2024-08-31T04:24:34.907481+0000","last_fullsized":"2024-08-31T04:24:34.907481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902903+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902903+0000","last_peered":"2024-08-31T04:24:34.902903+0000","last_clean":"2024-08-31T04:24:34.902903+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902903+0000","last_undegraded":"2024-08-31T04:24:34.902903+0000","last_fullsized":"2024-08-31T04:24:34.902903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923858+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:24:34.923858+0000","last_peered":"2024-08-31T04:24:34.923858+0000","last_clean":"2024-08-31T04:24:34.923858+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:24:34.923858+0000","last_undegraded":"2024-08-31T04:24:34.923858+0000","last_fullsized":"2024-08-31T04:24:34.923858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903339+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903339+0000","last_peered":"2024-08-31T04:24:34.903339+0000","last_clean":"2024-08-31T04:24:34.903339+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903339+0000","last_undegraded":"2024-08-31T04:24:34.903339+0000","last_fullsized":"2024-08-31T04:24:34.903339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902737+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902737+0000","last_peered":"2024-08-31T04:24:34.902737+0000","last_clean":"2024-08-31T04:24:34.902737+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902737+0000","last_undegraded":"2024-08-31T04:24:34.902737+0000","last_fullsized":"2024-08-31T04:24:34.902737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065328+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:24:35.065328+0000","last_peered":"2024-08-31T04:24:35.065328+0000","last_clean":"2024-08-31T04:24:35.065328+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:24:35.065328+0000","last_undegraded":"2024-08-31T04:24:35.065328+0000","last_fullsized":"2024-08-31T04:24:35.065328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924505+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:34.924505+0000","last_peered":"2024-08-31T04:24:34.924505+0000","last_clean":"2024-08-31T04:24:34.924505+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:34.924505+0000","last_undegraded":"2024-08-31T04:24:34.924505+0000","last_fullsized":"2024-08-31T04:24:34.924505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903317+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903317+0000","last_peered":"2024-08-31T04:24:34.903317+0000","last_clean":"2024-08-31T04:24:34.903317+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903317+0000","last_undegraded":"2024-08-31T04:24:34.903317+0000","last_fullsized":"2024-08-31T04:24:34.903317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907411+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:24:34.907411+0000","last_peered":"2024-08-31T04:24:34.907411+0000","last_clean":"2024-08-31T04:24:34.907411+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:24:34.907411+0000","last_undegraded":"2024-08-31T04:24:34.907411+0000","last_fullsized":"2024-08-31T04:24:34.907411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903872+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903872+0000","last_peered":"2024-08-31T04:24:34.903872+0000","last_clean":"2024-08-31T04:24:34.903872+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903872+0000","last_undegraded":"2024-08-31T04:24:34.903872+0000","last_fullsized":"2024-08-31T04:24:34.903872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902455+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902455+0000","last_peered":"2024-08-31T04:24:34.902455+0000","last_clean":"2024-08-31T04:24:34.902455+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902455+0000","last_undegraded":"2024-08-31T04:24:34.902455+0000","last_fullsized":"2024-08-31T04:24:34.902455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175253+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:24:35.175253+0000","last_peered":"2024-08-31T04:24:35.175253+0000","last_clean":"2024-08-31T04:24:35.175253+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:24:35.175253+0000","last_undegraded":"2024-08-31T04:24:35.175253+0000","last_fullsized":"2024-08-31T04:24:35.175253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903158+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903158+0000","last_peered":"2024-08-31T04:24:34.903158+0000","last_clean":"2024-08-31T04:24:34.903158+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903158+0000","last_undegraded":"2024-08-31T04:24:34.903158+0000","last_fullsized":"2024-08-31T04:24:34.903158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903836+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903836+0000","last_peered":"2024-08-31T04:24:34.903836+0000","last_clean":"2024-08-31T04:24:34.903836+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903836+0000","last_undegraded":"2024-08-31T04:24:34.903836+0000","last_fullsized":"2024-08-31T04:24:34.903836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164784+0000","last_change":"2024-08-31T04:24:35.164680+0000","last_active":"2024-08-31T04:24:35.164784+0000","last_peered":"2024-08-31T04:24:35.164784+0000","last_clean":"2024-08-31T04:24:35.164784+0000","last_became_active":"2024-08-31T04:24:35.164257+0000","last_became_peered":"2024-08-31T04:24:35.164257+0000","last_unstale":"2024-08-31T04:24:35.164784+0000","last_undegraded":"2024-08-31T04:24:35.164784+0000","last_fullsized":"2024-08-31T04:24:35.164784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:26.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903383+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:24:34.903383+0000","last_peered":"2024-08-31T04:24:34.903383+0000","last_clean":"2024-08-31T04:24:34.903383+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:24:34.903383+0000","last_undegraded":"2024-08-31T04:24:34.903383+0000","last_fullsized":"2024-08-31T04:24:34.903383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923566+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:34.923566+0000","last_peered":"2024-08-31T04:24:34.923566+0000","last_clean":"2024-08-31T04:24:34.923566+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:34.923566+0000","last_undegraded":"2024-08-31T04:24:34.923566+0000","last_fullsized":"2024-08-31T04:24:34.923566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899720+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:24:34.899720+0000","last_peered":"2024-08-31T04:24:34.899720+0000","last_clean":"2024-08-31T04:24:34.899720+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:24:34.899720+0000","last_undegraded":"2024-08-31T04:24:34.899720+0000","last_fullsized":"2024-08-31T04:24:34.899720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908105+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:34.908105+0000","last_peered":"2024-08-31T04:24:34.908105+0000","last_clean":"2024-08-31T04:24:34.908105+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:34.908105+0000","last_undegraded":"2024-08-31T04:24:34.908105+0000","last_fullsized":"2024-08-31T04:24:34.908105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065341+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065341+0000","last_peered":"2024-08-31T04:24:35.065341+0000","last_clean":"2024-08-31T04:24:35.065341+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065341+0000","last_undegraded":"2024-08-31T04:24:35.065341+0000","last_fullsized":"2024-08-31T04:24:35.065341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175761+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:24:35.175761+0000","last_peered":"2024-08-31T04:24:35.175761+0000","last_clean":"2024-08-31T04:24:35.175761+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:24:35.175761+0000","last_undegraded":"2024-08-31T04:24:35.175761+0000","last_fullsized":"2024-08-31T04:24:35.175761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903204+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903204+0000","last_peered":"2024-08-31T04:24:34.903204+0000","last_clean":"2024-08-31T04:24:34.903204+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903204+0000","last_undegraded":"2024-08-31T04:24:34.903204+0000","last_fullsized":"2024-08-31T04:24:34.903204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907286+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:34.907286+0000","last_peered":"2024-08-31T04:24:34.907286+0000","last_clean":"2024-08-31T04:24:34.907286+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:34.907286+0000","last_undegraded":"2024-08-31T04:24:34.907286+0000","last_fullsized":"2024-08-31T04:24:34.907286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175688+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:24:35.175688+0000","last_peered":"2024-08-31T04:24:35.175688+0000","last_clean":"2024-08-31T04:24:35.175688+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:24:35.175688+0000","last_undegraded":"2024-08-31T04:24:35.175688+0000","last_fullsized":"2024-08-31T04:24:35.175688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163308+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163308+0000","last_peered":"2024-08-31T04:24:35.163308+0000","last_clean":"2024-08-31T04:24:35.163308+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163308+0000","last_undegraded":"2024-08-31T04:24:35.163308+0000","last_fullsized":"2024-08-31T04:24:35.163308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899462+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899462+0000","last_peered":"2024-08-31T04:24:34.899462+0000","last_clean":"2024-08-31T04:24:34.899462+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899462+0000","last_undegraded":"2024-08-31T04:24:34.899462+0000","last_fullsized":"2024-08-31T04:24:34.899462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.909200+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:24:34.909200+0000","last_peered":"2024-08-31T04:24:34.909200+0000","last_clean":"2024-08-31T04:24:34.909200+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:24:34.909200+0000","last_undegraded":"2024-08-31T04:24:34.909200+0000","last_fullsized":"2024-08-31T04:24:34.909200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:44.530030+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:24:44.530030+0000","last_peered":"2024-08-31T04:24:44.530030+0000","last_clean":"2024-08-31T04:24:44.530030+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:24:44.530030+0000","last_undegraded":"2024-08-31T04:24:44.530030+0000","last_fullsized":"2024-08-31T04:24:44.530030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899665+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899665+0000","last_peered":"2024-08-31T04:24:34.899665+0000","last_clean":"2024-08-31T04:24:34.899665+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899665+0000","last_undegraded":"2024-08-31T04:24:34.899665+0000","last_fullsized":"2024-08-31T04:24:34.899665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899079+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:24:34.899079+0000","last_peered":"2024-08-31T04:24:34.899079+0000","last_clean":"2024-08-31T04:24:34.899079+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:24:34.899079+0000","last_undegraded":"2024-08-31T04:24:34.899079+0000","last_fullsized":"2024-08-31T04:24:34.899079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162741+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.162741+0000","last_peered":"2024-08-31T04:24:35.162741+0000","last_clean":"2024-08-31T04:24:35.162741+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.162741+0000","last_undegraded":"2024-08-31T04:24:35.162741+0000","last_fullsized":"2024-08-31T04:24:35.162741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902421+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902421+0000","last_peered":"2024-08-31T04:24:34.902421+0000","last_clean":"2024-08-31T04:24:34.902421+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902421+0000","last_undegraded":"2024-08-31T04:24:34.902421+0000","last_fullsized":"2024-08-31T04:24:34.902421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924595+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:24:34.924595+0000","last_peered":"2024-08-31T04:24:34.924595+0000","last_clean":"2024-08-31T04:24:34.924595+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:24:34.924595+0000","last_undegraded":"2024-08-31T04:24:34.924595+0000","last_fullsized":"2024-08-31T04:24:34.924595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902599+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902599+0000","last_peered":"2024-08-31T04:24:34.902599+0000","last_clean":"2024-08-31T04:24:34.902599+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902599+0000","last_undegraded":"2024-08-31T04:24:34.902599+0000","last_fullsized":"2024-08-31T04:24:34.902599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162974+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.162974+0000","last_peered":"2024-08-31T04:24:35.162974+0000","last_clean":"2024-08-31T04:24:35.162974+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.162974+0000","last_undegraded":"2024-08-31T04:24:35.162974+0000","last_fullsized":"2024-08-31T04:24:35.162974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163451+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:24:35.163451+0000","last_peered":"2024-08-31T04:24:35.163451+0000","last_clean":"2024-08-31T04:24:35.163451+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:24:35.163451+0000","last_undegraded":"2024-08-31T04:24:35.163451+0000","last_fullsized":"2024-08-31T04:24:35.163451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904175+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904175+0000","last_peered":"2024-08-31T04:24:34.904175+0000","last_clean":"2024-08-31T04:24:34.904175+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904175+0000","last_undegraded":"2024-08-31T04:24:34.904175+0000","last_fullsized":"2024-08-31T04:24:34.904175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163017+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:24:35.163017+0000","last_peered":"2024-08-31T04:24:35.163017+0000","last_clean":"2024-08-31T04:24:35.163017+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:24:35.163017+0000","last_undegraded":"2024-08-31T04:24:35.163017+0000","last_fullsized":"2024-08-31T04:24:35.163017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902460+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902460+0000","last_peered":"2024-08-31T04:24:34.902460+0000","last_clean":"2024-08-31T04:24:34.902460+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902460+0000","last_undegraded":"2024-08-31T04:24:34.902460+0000","last_fullsized":"2024-08-31T04:24:34.902460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175079+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175079+0000","last_peered":"2024-08-31T04:24:35.175079+0000","last_clean":"2024-08-31T04:24:35.175079+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175079+0000","last_undegraded":"2024-08-31T04:24:35.175079+0000","last_fullsized":"2024-08-31T04:24:35.175079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163666+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:24:35.163666+0000","last_peered":"2024-08-31T04:24:35.163666+0000","last_clean":"2024-08-31T04:24:35.163666+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:24:35.163666+0000","last_undegraded":"2024-08-31T04:24:35.163666+0000","last_fullsized":"2024-08-31T04:24:35.163666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899735+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899735+0000","last_peered":"2024-08-31T04:24:34.899735+0000","last_clean":"2024-08-31T04:24:34.899735+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899735+0000","last_undegraded":"2024-08-31T04:24:34.899735+0000","last_fullsized":"2024-08-31T04:24:34.899735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900596+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900596+0000","last_peered":"2024-08-31T04:24:34.900596+0000","last_clean":"2024-08-31T04:24:34.900596+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900596+0000","last_undegraded":"2024-08-31T04:24:34.900596+0000","last_fullsized":"2024-08-31T04:24:34.900596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065886+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:24:35.065886+0000","last_peered":"2024-08-31T04:24:35.065886+0000","last_clean":"2024-08-31T04:24:35.065886+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:24:35.065886+0000","last_undegraded":"2024-08-31T04:24:35.065886+0000","last_fullsized":"2024-08-31T04:24:35.065886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907623+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:24:34.907623+0000","last_peered":"2024-08-31T04:24:34.907623+0000","last_clean":"2024-08-31T04:24:34.907623+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:24:34.907623+0000","last_undegraded":"2024-08-31T04:24:34.907623+0000","last_fullsized":"2024-08-31T04:24:34.907623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900723+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900723+0000","last_peered":"2024-08-31T04:24:34.900723+0000","last_clean":"2024-08-31T04:24:34.900723+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900723+0000","last_undegraded":"2024-08-31T04:24:34.900723+0000","last_fullsized":"2024-08-31T04:24:34.900723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901214+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:24:34.901214+0000","last_peered":"2024-08-31T04:24:34.901214+0000","last_clean":"2024-08-31T04:24:34.901214+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:24:34.901214+0000","last_undegraded":"2024-08-31T04:24:34.901214+0000","last_fullsized":"2024-08-31T04:24:34.901214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907069+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:34.907069+0000","last_peered":"2024-08-31T04:24:34.907069+0000","last_clean":"2024-08-31T04:24:34.907069+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:34.907069+0000","last_undegraded":"2024-08-31T04:24:34.907069+0000","last_fullsized":"2024-08-31T04:24:34.907069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162525+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:24:35.162525+0000","last_peered":"2024-08-31T04:24:35.162525+0000","last_clean":"2024-08-31T04:24:35.162525+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:24:35.162525+0000","last_undegraded":"2024-08-31T04:24:35.162525+0000","last_fullsized":"2024-08-31T04:24:35.162525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:45.532465+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:24:45.532465+0000","last_peered":"2024-08-31T04:24:45.532465+0000","last_clean":"2024-08-31T04:24:45.532465+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:24:45.532465+0000","last_undegraded":"2024-08-31T04:24:45.532465+0000","last_fullsized":"2024-08-31T04:24:45.532465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176861+0000","last_change":"2024-08-31T04:24:35.176740+0000","last_active":"2024-08-31T04:24:35.176861+0000","last_peered":"2024-08-31T04:24:35.176861+0000","last_clean":"2024-08-31T04:24:35.176861+0000","last_became_active":"2024-08-31T04:24:35.176138+0000","last_became_peered":"2024-08-31T04:24:35.176138+0000","last_unstale":"2024-08-31T04:24:35.176861+0000","last_undegraded":"2024-08-31T04:24:35.176861+0000","last_fullsized":"2024-08-31T04:24:35.176861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:42:51.558180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163003+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:24:35.163003+0000","last_peered":"2024-08-31T04:24:35.163003+0000","last_clean":"2024-08-31T04:24:35.163003+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:24:35.163003+0000","last_undegraded":"2024-08-31T04:24:35.163003+0000","last_fullsized":"2024-08-31T04:24:35.163003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901294+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901294+0000","last_peered":"2024-08-31T04:24:34.901294+0000","last_clean":"2024-08-31T04:24:34.901294+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901294+0000","last_undegraded":"2024-08-31T04:24:34.901294+0000","last_fullsized":"2024-08-31T04:24:34.901294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065345+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065345+0000","last_peered":"2024-08-31T04:24:35.065345+0000","last_clean":"2024-08-31T04:24:35.065345+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065345+0000","last_undegraded":"2024-08-31T04:24:35.065345+0000","last_fullsized":"2024-08-31T04:24:35.065345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.164616+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:24:35.164616+0000","last_peered":"2024-08-31T04:24:35.164616+0000","last_clean":"2024-08-31T04:24:35.164616+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:24:35.164616+0000","last_undegraded":"2024-08-31T04:24:35.164616+0000","last_fullsized":"2024-08-31T04:24:35.164616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903598+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903598+0000","last_peered":"2024-08-31T04:24:34.903598+0000","last_clean":"2024-08-31T04:24:34.903598+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903598+0000","last_undegraded":"2024-08-31T04:24:34.903598+0000","last_fullsized":"2024-08-31T04:24:34.903598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907989+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:24:34.907989+0000","last_peered":"2024-08-31T04:24:34.907989+0000","last_clean":"2024-08-31T04:24:34.907989+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:24:34.907989+0000","last_undegraded":"2024-08-31T04:24:34.907989+0000","last_fullsized":"2024-08-31T04:24:34.907989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:45.531500+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:24:45.531500+0000","last_peered":"2024-08-31T04:24:45.531500+0000","last_clean":"2024-08-31T04:24:45.531500+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:24:45.531500+0000","last_undegraded":"2024-08-31T04:24:45.531500+0000","last_fullsized":"2024-08-31T04:24:45.531500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902970+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.902970+0000","last_peered":"2024-08-31T04:24:34.902970+0000","last_clean":"2024-08-31T04:24:34.902970+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.902970+0000","last_undegraded":"2024-08-31T04:24:34.902970+0000","last_fullsized":"2024-08-31T04:24:34.902970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904119+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:24:34.904119+0000","last_peered":"2024-08-31T04:24:34.904119+0000","last_clean":"2024-08-31T04:24:34.904119+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:24:34.904119+0000","last_undegraded":"2024-08-31T04:24:34.904119+0000","last_fullsized":"2024-08-31T04:24:34.904119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902335+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902335+0000","last_peered":"2024-08-31T04:24:34.902335+0000","last_clean":"2024-08-31T04:24:34.902335+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902335+0000","last_undegraded":"2024-08-31T04:24:34.902335+0000","last_fullsized":"2024-08-31T04:24:34.902335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177602+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.177602+0000","last_peered":"2024-08-31T04:24:35.177602+0000","last_clean":"2024-08-31T04:24:35.177602+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.177602+0000","last_undegraded":"2024-08-31T04:24:35.177602+0000","last_fullsized":"2024-08-31T04:24:35.177602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175519+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:24:35.175519+0000","last_peered":"2024-08-31T04:24:35.175519+0000","last_clean":"2024-08-31T04:24:35.175519+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:24:35.175519+0000","last_undegraded":"2024-08-31T04:24:35.175519+0000","last_fullsized":"2024-08-31T04:24:35.175519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163405+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163405+0000","last_peered":"2024-08-31T04:24:35.163405+0000","last_clean":"2024-08-31T04:24:35.163405+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163405+0000","last_undegraded":"2024-08-31T04:24:35.163405+0000","last_fullsized":"2024-08-31T04:24:35.163405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902696+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902696+0000","last_peered":"2024-08-31T04:24:34.902696+0000","last_clean":"2024-08-31T04:24:34.902696+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902696+0000","last_undegraded":"2024-08-31T04:24:34.902696+0000","last_fullsized":"2024-08-31T04:24:34.902696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.905097+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:24:34.905097+0000","last_peered":"2024-08-31T04:24:34.905097+0000","last_clean":"2024-08-31T04:24:34.905097+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:24:34.905097+0000","last_undegraded":"2024-08-31T04:24:34.905097+0000","last_fullsized":"2024-08-31T04:24:34.905097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:44.529799+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:24:44.529799+0000","last_peered":"2024-08-31T04:24:44.529799+0000","last_clean":"2024-08-31T04:24:44.529799+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:24:44.529799+0000","last_undegraded":"2024-08-31T04:24:44.529799+0000","last_fullsized":"2024-08-31T04:24:44.529799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924270+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:34.924270+0000","last_peered":"2024-08-31T04:24:34.924270+0000","last_clean":"2024-08-31T04:24:34.924270+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:34.924270+0000","last_undegraded":"2024-08-31T04:24:34.924270+0000","last_fullsized":"2024-08-31T04:24:34.924270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175070+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175070+0000","last_peered":"2024-08-31T04:24:35.175070+0000","last_clean":"2024-08-31T04:24:35.175070+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175070+0000","last_undegraded":"2024-08-31T04:24:35.175070+0000","last_fullsized":"2024-08-31T04:24:35.175070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902852+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:24:34.902852+0000","last_peered":"2024-08-31T04:24:34.902852+0000","last_clean":"2024-08-31T04:24:34.902852+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:24:34.902852+0000","last_undegraded":"2024-08-31T04:24:34.902852+0000","last_fullsized":"2024-08-31T04:24:34.902852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901010+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901010+0000","last_peered":"2024-08-31T04:24:34.901010+0000","last_clean":"2024-08-31T04:24:34.901010+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901010+0000","last_undegraded":"2024-08-31T04:24:34.901010+0000","last_fullsized":"2024-08-31T04:24:34.901010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065811+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065811+0000","last_peered":"2024-08-31T04:24:35.065811+0000","last_clean":"2024-08-31T04:24:35.065811+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065811+0000","last_undegraded":"2024-08-31T04:24:35.065811+0000","last_fullsized":"2024-08-31T04:24:35.065811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923740+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:24:34.923740+0000","last_peered":"2024-08-31T04:24:34.923740+0000","last_clean":"2024-08-31T04:24:34.923740+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:24:34.923740+0000","last_undegraded":"2024-08-31T04:24:34.923740+0000","last_fullsized":"2024-08-31T04:24:34.923740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899145+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899145+0000","last_peered":"2024-08-31T04:24:34.899145+0000","last_clean":"2024-08-31T04:24:34.899145+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899145+0000","last_undegraded":"2024-08-31T04:24:34.899145+0000","last_fullsized":"2024-08-31T04:24:34.899145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175580+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175580+0000","last_peered":"2024-08-31T04:24:35.175580+0000","last_clean":"2024-08-31T04:24:35.175580+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175580+0000","last_undegraded":"2024-08-31T04:24:35.175580+0000","last_fullsized":"2024-08-31T04:24:35.175580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.925663+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:24:34.925663+0000","last_peered":"2024-08-31T04:24:34.925663+0000","last_clean":"2024-08-31T04:24:34.925663+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:24:34.925663+0000","last_undegraded":"2024-08-31T04:24:34.925663+0000","last_fullsized":"2024-08-31T04:24:34.925663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":122,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:45.532301+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:24:45.532301+0000","last_peered":"2024-08-31T04:24:45.532301+0000","last_clean":"2024-08-31T04:24:45.532301+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:24:45.532301+0000","last_undegraded":"2024-08-31T04:24:45.532301+0000","last_fullsized":"2024-08-31T04:24:45.532301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907446+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:24:34.907446+0000","last_peered":"2024-08-31T04:24:34.907446+0000","last_clean":"2024-08-31T04:24:34.907446+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:24:34.907446+0000","last_undegraded":"2024-08-31T04:24:34.907446+0000","last_fullsized":"2024-08-31T04:24:34.907446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065181+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:24:35.065181+0000","last_peered":"2024-08-31T04:24:35.065181+0000","last_clean":"2024-08-31T04:24:35.065181+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:24:35.065181+0000","last_undegraded":"2024-08-31T04:24:35.065181+0000","last_fullsized":"2024-08-31T04:24:35.065181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.911653+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:24:34.911653+0000","last_peered":"2024-08-31T04:24:34.911653+0000","last_clean":"2024-08-31T04:24:34.911653+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:24:34.911653+0000","last_undegraded":"2024-08-31T04:24:34.911653+0000","last_fullsized":"2024-08-31T04:24:34.911653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903193+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:24:34.903193+0000","last_peered":"2024-08-31T04:24:34.903193+0000","last_clean":"2024-08-31T04:24:34.903193+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:24:34.903193+0000","last_undegraded":"2024-08-31T04:24:34.903193+0000","last_fullsized":"2024-08-31T04:24:34.903193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175197+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:24:35.175197+0000","last_peered":"2024-08-31T04:24:35.175197+0000","last_clean":"2024-08-31T04:24:35.175197+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:24:35.175197+0000","last_undegraded":"2024-08-31T04:24:35.175197+0000","last_fullsized":"2024-08-31T04:24:35.175197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899594+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:24:34.899594+0000","last_peered":"2024-08-31T04:24:34.899594+0000","last_clean":"2024-08-31T04:24:34.899594+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:24:34.899594+0000","last_undegraded":"2024-08-31T04:24:34.899594+0000","last_fullsized":"2024-08-31T04:24:34.899594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065801+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:24:35.065801+0000","last_peered":"2024-08-31T04:24:35.065801+0000","last_clean":"2024-08-31T04:24:35.065801+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:24:35.065801+0000","last_undegraded":"2024-08-31T04:24:35.065801+0000","last_fullsized":"2024-08-31T04:24:35.065801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904210+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:24:34.904210+0000","last_peered":"2024-08-31T04:24:34.904210+0000","last_clean":"2024-08-31T04:24:34.904210+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:24:34.904210+0000","last_undegraded":"2024-08-31T04:24:34.904210+0000","last_fullsized":"2024-08-31T04:24:34.904210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924032+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:24:34.924032+0000","last_peered":"2024-08-31T04:24:34.924032+0000","last_clean":"2024-08-31T04:24:34.924032+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:24:34.924032+0000","last_undegraded":"2024-08-31T04:24:34.924032+0000","last_fullsized":"2024-08-31T04:24:34.924032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900794+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:24:34.900794+0000","last_peered":"2024-08-31T04:24:34.900794+0000","last_clean":"2024-08-31T04:24:34.900794+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:24:34.900794+0000","last_undegraded":"2024-08-31T04:24:34.900794+0000","last_fullsized":"2024-08-31T04:24:34.900794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924387+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:24:34.924387+0000","last_peered":"2024-08-31T04:24:34.924387+0000","last_clean":"2024-08-31T04:24:34.924387+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:24:34.924387+0000","last_undegraded":"2024-08-31T04:24:34.924387+0000","last_fullsized":"2024-08-31T04:24:34.924387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904954+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:24:34.904954+0000","last_peered":"2024-08-31T04:24:34.904954+0000","last_clean":"2024-08-31T04:24:34.904954+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:24:34.904954+0000","last_undegraded":"2024-08-31T04:24:34.904954+0000","last_fullsized":"2024-08-31T04:24:34.904954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899543+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:24:34.899543+0000","last_peered":"2024-08-31T04:24:34.899543+0000","last_clean":"2024-08-31T04:24:34.899543+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:24:34.899543+0000","last_undegraded":"2024-08-31T04:24:34.899543+0000","last_fullsized":"2024-08-31T04:24:34.899543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065440+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:24:35.065440+0000","last_peered":"2024-08-31T04:24:35.065440+0000","last_clean":"2024-08-31T04:24:35.065440+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:24:35.065440+0000","last_undegraded":"2024-08-31T04:24:35.065440+0000","last_fullsized":"2024-08-31T04:24:35.065440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904117+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:24:34.904117+0000","last_peered":"2024-08-31T04:24:34.904117+0000","last_clean":"2024-08-31T04:24:34.904117+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:24:34.904117+0000","last_undegraded":"2024-08-31T04:24:34.904117+0000","last_fullsized":"2024-08-31T04:24:34.904117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903380+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:24:34.903380+0000","last_peered":"2024-08-31T04:24:34.903380+0000","last_clean":"2024-08-31T04:24:34.903380+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:24:34.903380+0000","last_undegraded":"2024-08-31T04:24:34.903380+0000","last_fullsized":"2024-08-31T04:24:34.903380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065997+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:24:35.065997+0000","last_peered":"2024-08-31T04:24:35.065997+0000","last_clean":"2024-08-31T04:24:35.065997+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:24:35.065997+0000","last_undegraded":"2024-08-31T04:24:35.065997+0000","last_fullsized":"2024-08-31T04:24:35.065997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902825+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:24:34.902825+0000","last_peered":"2024-08-31T04:24:34.902825+0000","last_clean":"2024-08-31T04:24:34.902825+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:24:34.902825+0000","last_undegraded":"2024-08-31T04:24:34.902825+0000","last_fullsized":"2024-08-31T04:24:34.902825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175085+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:24:35.175085+0000","last_peered":"2024-08-31T04:24:35.175085+0000","last_clean":"2024-08-31T04:24:35.175085+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:24:35.175085+0000","last_undegraded":"2024-08-31T04:24:35.175085+0000","last_fullsized":"2024-08-31T04:24:35.175085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174791+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:24:35.174791+0000","last_peered":"2024-08-31T04:24:35.174791+0000","last_clean":"2024-08-31T04:24:35.174791+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:24:35.174791+0000","last_undegraded":"2024-08-31T04:24:35.174791+0000","last_fullsized":"2024-08-31T04:24:35.174791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899425+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:24:34.899425+0000","last_peered":"2024-08-31T04:24:34.899425+0000","last_clean":"2024-08-31T04:24:34.899425+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:24:34.899425+0000","last_undegraded":"2024-08-31T04:24:34.899425+0000","last_fullsized":"2024-08-31T04:24:34.899425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902899+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:24:34.902899+0000","last_peered":"2024-08-31T04:24:34.902899+0000","last_clean":"2024-08-31T04:24:34.902899+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:24:34.902899+0000","last_undegraded":"2024-08-31T04:24:34.902899+0000","last_fullsized":"2024-08-31T04:24:34.902899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163355+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:24:35.163355+0000","last_peered":"2024-08-31T04:24:35.163355+0000","last_clean":"2024-08-31T04:24:35.163355+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:24:35.163355+0000","last_undegraded":"2024-08-31T04:24:35.163355+0000","last_fullsized":"2024-08-31T04:24:35.163355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176164+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:24:35.176164+0000","last_peered":"2024-08-31T04:24:35.176164+0000","last_clean":"2024-08-31T04:24:35.176164+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:24:35.176164+0000","last_undegraded":"2024-08-31T04:24:35.176164+0000","last_fullsized":"2024-08-31T04:24:35.176164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.165355+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:24:35.165355+0000","last_peered":"2024-08-31T04:24:35.165355+0000","last_clean":"2024-08-31T04:24:35.165355+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:24:35.165355+0000","last_undegraded":"2024-08-31T04:24:35.165355+0000","last_fullsized":"2024-08-31T04:24:35.165355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923711+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:24:34.923711+0000","last_peered":"2024-08-31T04:24:34.923711+0000","last_clean":"2024-08-31T04:24:34.923711+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:24:34.923711+0000","last_undegraded":"2024-08-31T04:24:34.923711+0000","last_fullsized":"2024-08-31T04:24:34.923711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.162846+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:24:35.162846+0000","last_peered":"2024-08-31T04:24:35.162846+0000","last_clean":"2024-08-31T04:24:35.162846+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:24:35.162846+0000","last_undegraded":"2024-08-31T04:24:35.162846+0000","last_fullsized":"2024-08-31T04:24:35.162846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175550+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:24:35.175550+0000","last_peered":"2024-08-31T04:24:35.175550+0000","last_clean":"2024-08-31T04:24:35.175550+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:24:35.175550+0000","last_undegraded":"2024-08-31T04:24:35.175550+0000","last_fullsized":"2024-08-31T04:24:35.175550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907836+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:24:34.907836+0000","last_peered":"2024-08-31T04:24:34.907836+0000","last_clean":"2024-08-31T04:24:34.907836+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:24:34.907836+0000","last_undegraded":"2024-08-31T04:24:34.907836+0000","last_fullsized":"2024-08-31T04:24:34.907836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903035+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:24:34.903035+0000","last_peered":"2024-08-31T04:24:34.903035+0000","last_clean":"2024-08-31T04:24:34.903035+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:24:34.903035+0000","last_undegraded":"2024-08-31T04:24:34.903035+0000","last_fullsized":"2024-08-31T04:24:34.903035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.174870+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:24:35.174870+0000","last_peered":"2024-08-31T04:24:35.174870+0000","last_clean":"2024-08-31T04:24:35.174870+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:24:35.174870+0000","last_undegraded":"2024-08-31T04:24:35.174870+0000","last_fullsized":"2024-08-31T04:24:35.174870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175219+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:24:35.175219+0000","last_peered":"2024-08-31T04:24:35.175219+0000","last_clean":"2024-08-31T04:24:35.175219+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:24:35.175219+0000","last_undegraded":"2024-08-31T04:24:35.175219+0000","last_fullsized":"2024-08-31T04:24:35.175219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065991+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:24:35.065991+0000","last_peered":"2024-08-31T04:24:35.065991+0000","last_clean":"2024-08-31T04:24:35.065991+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:24:35.065991+0000","last_undegraded":"2024-08-31T04:24:35.065991+0000","last_fullsized":"2024-08-31T04:24:35.065991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":428,"num_read_kb":286,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":987136,"data_stored":501642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1667072,"data_stored":1152872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1585152,"data_stored":1096106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1092282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":502677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":987136,"data_stored":496235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":560715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":561151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:24:49.713 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T04:24:49.714 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T04:24:49.714 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T04:24:49.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T04:24:49.964 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:50.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:50 smithi002 ceph-mon[18656]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:50.335 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:50 smithi002 ceph-mon[18656]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/1673566628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 msgr2=0x7fc4d4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/1673566628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d4109650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009900 tx=0x7fc4c402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/1673566628 shutdown_connections 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/1673566628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d4109650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/1673566628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 0x7fc4d41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/1673566628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.423+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/1673566628 >> 172.21.15.2:0/1673566628 conn(0x7fc4d407b5f0 msgr2=0x7fc4d407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.424+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/1673566628 shutdown_connections 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.424+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/1673566628 wait complete. 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.424+0000 7fc4dbbd6640 1 Processor -- start 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.424+0000 7fc4dbbd6640 1 -- start start 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.424+0000 7fc4dbbd6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 0x7fc4d419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4113850 con 0x7fc4d4109240 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41136d0 con 0x7fc4d4103900 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41139d0 con 0x7fc4d4109b90 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53862/0 (socket says 172.21.15.2:53862) 2024-08-31T04:24:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 -- 172.21.15.2:0/3979580925 learned_addr learned my addr 172.21.15.2:0/3979580925 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4da173640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 0x7fc4d419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9972640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 -- 172.21.15.2:0/3979580925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 msgr2=0x7fc4d419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 0x7fc4d419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 -- 172.21.15.2:0/3979580925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 msgr2=0x7fc4d419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 -- 172.21.15.2:0/3979580925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d41a0190 con 0x7fc4d4109240 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9972640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4d9171640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc4c402a930 tx=0x7fc4c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c403f030 con 0x7fc4d4109240 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d41a0420 con 0x7fc4d4109240 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4c4003aa0 con 0x7fc4d4109240 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4035070 con 0x7fc4d4109240 2024-08-31T04:24:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.425+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d41a6be0 con 0x7fc4d4109240 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.426+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d4103d10 con 0x7fc4d4109240 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.429+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fc4c4042030 con 0x7fc4d4109240 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.430+0000 7fc4caffd640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 0x7fc4c00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.430+0000 7fc4d9972640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 0x7fc4c00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.430+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc4c41063d0 con 0x7fc4d4109240 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.430+0000 7fc4d9972640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 0x7fc4c00b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00058c0 tx=0x7fc4d0005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.433+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc4c40cce00 con 0x7fc4d4109240 2024-08-31T04:24:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:50 smithi064 ceph-mon[22007]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:50 smithi064 ceph-mon[22007]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:50 smithi132 ceph-mon[22335]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:24:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:50 smithi132 ceph-mon[22335]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:50.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.660+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc4d410b9e0 con 0x7fc4d4109240 2024-08-31T04:24:50.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.661+0000 7fc4caffd640 1 -- 172.21.15.2:0/3979580925 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc4c40c6e20 con 0x7fc4d4109240 2024-08-31T04:24:50.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:50.662 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T04:24:50.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 msgr2=0x7fc4c00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 0x7fc4c00b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00058c0 tx=0x7fc4d0005d30 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 msgr2=0x7fc4d419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc4c402a930 tx=0x7fc4c4004270 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 shutdown_connections 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc4c00b4c10 0x7fc4c00b7120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4109240 0x7fc4d419a7c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d4109b90 0x7fc4d419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 --2- 172.21.15.2:0/3979580925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4d4103900 0x7fc4d419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 >> 172.21.15.2:0/3979580925 conn(0x7fc4d407b5f0 msgr2=0x7fc4d4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 shutdown_connections 2024-08-31T04:24:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:50.663+0000 7fc4dbbd6640 1 -- 172.21.15.2:0/3979580925 wait complete. 2024-08-31T04:24:51.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:51 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3979580925' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:24:51.455 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T04:24:51.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:51.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:51 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3979580925' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:24:51.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:51 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3979580925' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:24:51.710 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 -- 172.21.15.2:0/1848264780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778103900 msgr2=0x7f7778103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 --2- 172.21.15.2:0/1848264780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778103900 0x7f7778103d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7768009900 tx=0x7f776802a410 comp rx=0 tx=0).stop 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 -- 172.21.15.2:0/1848264780 shutdown_connections 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 --2- 172.21.15.2:0/1848264780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f77781103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 --2- 172.21.15.2:0/1848264780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778109240 0x7f7778109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 --2- 172.21.15.2:0/1848264780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778103900 0x7f7778103d10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 -- 172.21.15.2:0/1848264780 >> 172.21.15.2:0/1848264780 conn(0x7f777807b5f0 msgr2=0x7f777807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 -- 172.21.15.2:0/1848264780 shutdown_connections 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.193+0000 7f777f225640 1 -- 172.21.15.2:0/1848264780 wait complete. 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 Processor -- start 2024-08-31T04:24:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 -- start start 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778103900 0x7f77780754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f7778075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7778113850 con 0x7f7778109240 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77781136d0 con 0x7f7778109b90 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777f225640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77781139d0 con 0x7f7778103900 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53882/0 (socket says 172.21.15.2:53882) 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 -- 172.21.15.2:0/1114841097 learned_addr learned my addr 172.21.15.2:0/1114841097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777d7c2640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f7778075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f777cfc1640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778103900 0x7f77780754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 -- 172.21.15.2:0/1114841097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778103900 msgr2=0x7f77780754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778103900 0x7f77780754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.194+0000 7f7777fff640 1 -- 172.21.15.2:0/1114841097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 msgr2=0x7f7778075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7777fff640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f7778075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7777fff640 1 -- 172.21.15.2:0/1114841097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77781a8580 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f777d7c2640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f7778075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7777fff640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d750 tx=0x7f776c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c017070 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f776c0054d0 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77781a8870 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c004c30 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.195+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77781a8d60 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.196+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7778103d10 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.197+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f776c004dd0 con 0x7f7778109240 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.198+0000 7f7775ffb640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 0x7f77600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.199+0000 7f777cfc1640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 0x7f77600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.199+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f776c0e5370 con 0x7f7778109240 2024-08-31T04:24:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.199+0000 7f777cfc1640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 0x7f77600b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c00 tx=0x7f7768031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.203+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f776c0abe00 con 0x7f7778109240 2024-08-31T04:24:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:52 smithi002 ceph-mon[18656]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:52.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.426+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f777810b3d0 con 0x7f7778109240 2024-08-31T04:24:52.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.427+0000 7f7775ffb640 1 -- 172.21.15.2:0/1114841097 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f776c0a5e20 con 0x7f7778109240 2024-08-31T04:24:52.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:52.428 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:24:52.428 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:24:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 msgr2=0x7f77600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 0x7f77600b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c00 tx=0x7f7768031400 comp rx=0 tx=0).stop 2024-08-31T04:24:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 msgr2=0x7f77780759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d750 tx=0x7f776c00dc10 comp rx=0 tx=0).stop 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 shutdown_connections 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77600b4c10 0x7f77600b7120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7778109240 0x7f77780759f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7778109b90 0x7f7778075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 --2- 172.21.15.2:0/1114841097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778103900 0x7f77780754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 >> 172.21.15.2:0/1114841097 conn(0x7f777807b5f0 msgr2=0x7f7778107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 shutdown_connections 2024-08-31T04:24:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:52.429+0000 7f777f225640 1 -- 172.21.15.2:0/1114841097 wait complete. 2024-08-31T04:24:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:52 smithi064 ceph-mon[22007]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:52 smithi132 ceph-mon[22335]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:24:53.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:53.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:53 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1114841097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:53 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1114841097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:53.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:53 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1114841097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:53.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 -- 172.21.15.2:0/1285982380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c109260 msgr2=0x7fce6c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:53.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 --2- 172.21.15.2:0/1285982380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c109260 0x7fce6c109670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009900 tx=0x7fce5c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 -- 172.21.15.2:0/1285982380 shutdown_connections 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 --2- 172.21.15.2:0/1285982380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c109260 0x7fce6c109670 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 --2- 172.21.15.2:0/1285982380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109bb0 0x7fce6c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 --2- 172.21.15.2:0/1285982380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c101d80 0x7fce6c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 -- 172.21.15.2:0/1285982380 >> 172.21.15.2:0/1285982380 conn(0x7fce6c077960 msgr2=0x7fce6c077da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 -- 172.21.15.2:0/1285982380 shutdown_connections 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.912+0000 7fce7459e640 1 -- 172.21.15.2:0/1285982380 wait complete. 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 Processor -- start 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 -- start start 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109260 0x7fce6c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c109bb0 0x7fce6c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1137e0 con 0x7fce6c101d80 2024-08-31T04:24:53.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c113660 con 0x7fce6c109bb0 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7459e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c113960 con 0x7fce6c109260 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53908/0 (socket says 172.21.15.2:53908) 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 -- 172.21.15.2:0/4291877384 learned_addr learned my addr 172.21.15.2:0/4291877384 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce72b3b640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c109bb0 0x7fce6c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce71b39640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109260 0x7fce6c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 -- 172.21.15.2:0/4291877384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109260 msgr2=0x7fce6c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109260 0x7fce6c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 -- 172.21.15.2:0/4291877384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c109bb0 msgr2=0x7fce6c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c109bb0 0x7fce6c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.913+0000 7fce7233a640 1 -- 172.21.15.2:0/4291877384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c1a0180 con 0x7fce6c101d80 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce7233a640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fce6800d950 tx=0x7fce6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68017070 con 0x7fce6c101d80 2024-08-31T04:24:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c1a0470 con 0x7fce6c101d80 2024-08-31T04:24:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce68009c30 con 0x7fce6c101d80 2024-08-31T04:24:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6800f620 con 0x7fce6c101d80 2024-08-31T04:24:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.914+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c1a6c90 con 0x7fce6c101d80 2024-08-31T04:24:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.915+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c102190 con 0x7fce6c101d80 2024-08-31T04:24:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.916+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fce68005030 con 0x7fce6c101d80 2024-08-31T04:24:53.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.917+0000 7fce637fe640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 0x7fce580b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:53.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.917+0000 7fce71b39640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 0x7fce580b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:53.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.917+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fce680e5450 con 0x7fce6c101d80 2024-08-31T04:24:53.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.918+0000 7fce71b39640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 0x7fce580b7150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006010 tx=0x7fce5c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:53.920+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fce680abee0 con 0x7fce6c101d80 2024-08-31T04:24:54.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.142+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6c10ba60 con 0x7fce6c101d80 2024-08-31T04:24:54.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.142+0000 7fce637fe640 1 -- 172.21.15.2:0/4291877384 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fce680ab7e0 con 0x7fce6c101d80 2024-08-31T04:24:54.144 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:54.144 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:24:54.144 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:24:54.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 msgr2=0x7fce580b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:54.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 0x7fce580b7150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006010 tx=0x7fce5c000bc0 comp rx=0 tx=0).stop 2024-08-31T04:24:54.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 msgr2=0x7fce6c19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:54.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fce6800d950 tx=0x7fce6800de10 comp rx=0 tx=0).stop 2024-08-31T04:24:54.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 shutdown_connections 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c109bb0 0x7fce6c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce6c109260 0x7fce6c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fce580b4c40 0x7fce580b7150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 --2- 172.21.15.2:0/4291877384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce6c101d80 0x7fce6c19a2d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 >> 172.21.15.2:0/4291877384 conn(0x7fce6c077960 msgr2=0x7fce6c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 shutdown_connections 2024-08-31T04:24:54.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:54.145+0000 7fce7459e640 1 -- 172.21.15.2:0/4291877384 wait complete. 2024-08-31T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:54 smithi002 ceph-mon[18656]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:54 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4291877384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:54 smithi064 ceph-mon[22007]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:54 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4291877384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:54 smithi132 ceph-mon[22335]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:24:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:54 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4291877384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:54.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:24:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 -- 172.21.15.2:0/1410410482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 msgr2=0x7f804c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 --2- 172.21.15.2:0/1410410482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c102c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f803c009900 tx=0x7f803c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 -- 172.21.15.2:0/1410410482 shutdown_connections 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 --2- 172.21.15.2:0/1410410482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108a90 0x7f804c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 --2- 172.21.15.2:0/1410410482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108140 0x7f804c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 --2- 172.21.15.2:0/1410410482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c102c10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 -- 172.21.15.2:0/1410410482 >> 172.21.15.2:0/1410410482 conn(0x7f804c0794d0 msgr2=0x7f804c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:55.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 -- 172.21.15.2:0/1410410482 shutdown_connections 2024-08-31T04:24:55.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 -- 172.21.15.2:0/1410410482 wait complete. 2024-08-31T04:24:55.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.729+0000 7f8051f61640 1 Processor -- start 2024-08-31T04:24:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 -- start start 2024-08-31T04:24:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108140 0x7f804c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108a90 0x7f804c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f804c113820 con 0x7f804c102800 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f804c1136a0 con 0x7f804c108140 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f8051f61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f804c1139a0 con 0x7f804c108a90 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f804b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.730+0000 7f804b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52904/0 (socket says 172.21.15.2:52904) 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 -- 172.21.15.2:0/540879002 learned_addr learned my addr 172.21.15.2:0/540879002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804bfff640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108a90 0x7f804c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804affd640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108140 0x7f804c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 -- 172.21.15.2:0/540879002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108a90 msgr2=0x7f804c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108a90 0x7f804c19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 -- 172.21.15.2:0/540879002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108140 msgr2=0x7f804c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108140 0x7f804c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 -- 172.21.15.2:0/540879002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804c1a00e0 con 0x7f804c102800 2024-08-31T04:24:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f804b7fe640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f803c005940 tx=0x7f803c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c03f030 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804c1a0370 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f803c003cb0 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c035070 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.731+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804c1a0850 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.732+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804c102c10 con 0x7f804c102800 2024-08-31T04:24:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.734+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f803c042030 con 0x7f804c102800 2024-08-31T04:24:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.735+0000 7f8048ff9640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 0x7f80340bb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.735+0000 7f804affd640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 0x7f80340bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.735+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f803c106360 con 0x7f804c102800 2024-08-31T04:24:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.736+0000 7f804affd640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 0x7f80340bb560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040005fd0 tx=0x7f8040005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.739+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f803c0ccdf0 con 0x7f804c102800 2024-08-31T04:24:55.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.924+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f804c02e430 con 0x7f804c102800 2024-08-31T04:24:55.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.925+0000 7f8048ff9640 1 -- 172.21.15.2:0/540879002 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25348 (secure 0 0 0) 0x7f803c0cc6f0 con 0x7f804c102800 2024-08-31T04:24:55.927 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:55.927 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:24:34.895861+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:24:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 msgr2=0x7f80340bb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 0x7f80340bb560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040005fd0 tx=0x7f8040005850 comp rx=0 tx=0).stop 2024-08-31T04:24:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 msgr2=0x7f804c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f803c005940 tx=0x7f803c0042f0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 shutdown_connections 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f804c108a90 0x7f804c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c108140 0x7f804c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80340b9050 0x7f80340bb560 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 --2- 172.21.15.2:0/540879002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f804c102800 0x7f804c19a230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 >> 172.21.15.2:0/540879002 conn(0x7f804c0794d0 msgr2=0x7f804c101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 shutdown_connections 2024-08-31T04:24:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:55.928+0000 7f8051f61640 1 -- 172.21.15.2:0/540879002 wait complete. 2024-08-31T04:24:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:56 smithi064 ceph-mon[22007]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:56 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/540879002' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:56 smithi132 ceph-mon[22335]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:56 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/540879002' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:56.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:56 smithi002 ceph-mon[18656]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:24:56.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:56 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/540879002' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:24:56.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:57 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:57.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:57 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:57.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:57 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 -- 172.21.15.2:0/236974777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 msgr2=0x7f33a810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 --2- 172.21.15.2:0/236974777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a810d6d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f339c009900 tx=0x7f339c02a410 comp rx=0 tx=0).stop 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 -- 172.21.15.2:0/236974777 shutdown_connections 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 --2- 172.21.15.2:0/236974777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a810d6d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 --2- 172.21.15.2:0/236974777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 0x7f33a81100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 --2- 172.21.15.2:0/236974777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 0x7f33a8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 -- 172.21.15.2:0/236974777 >> 172.21.15.2:0/236974777 conn(0x7f33a8079500 msgr2=0x7f33a8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 -- 172.21.15.2:0/236974777 shutdown_connections 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.069+0000 7f33ac919640 1 -- 172.21.15.2:0/236974777 wait complete. 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 Processor -- start 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 -- start start 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 0x7f33a819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 0x7f33a819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8113850 con 0x7f33a8105040 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f33a81136d0 con 0x7f33a810dc10 2024-08-31T04:24:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33ac919640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f33a81139d0 con 0x7f33a8104660 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33a5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33a5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52926/0 (socket says 172.21.15.2:52926) 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33a5d9b640 1 -- 172.21.15.2:0/1941995163 learned_addr learned my addr 172.21.15.2:0/1941995163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a6d9d640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 0x7f33a819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.070+0000 7f33a659c640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 0x7f33a819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 -- 172.21.15.2:0/1941995163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 msgr2=0x7f33a819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 0x7f33a819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 -- 172.21.15.2:0/1941995163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 msgr2=0x7f33a819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 0x7f33a819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 -- 172.21.15.2:0/1941995163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a81a01d0 con 0x7f33a8105040 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33a5d9b640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a930 tx=0x7f339c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c03f030 con 0x7f33a8105040 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a81a0460 con 0x7f33a8105040 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f339c004490 con 0x7f33a8105040 2024-08-31T04:24:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c035070 con 0x7f33a8105040 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.071+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a81a6c20 con 0x7f33a8105040 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.072+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a806bf30 con 0x7f33a8105040 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.075+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f339c042030 con 0x7f33a8105040 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.076+0000 7f33977fe640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.076+0000 7f33a659c640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.076+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f339c105f30 con 0x7f33a8105040 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.076+0000 7f33a659c640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 0x7f33900b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33a806c630 tx=0x7f3398005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.079+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f339c0cc370 con 0x7f33a8105040 2024-08-31T04:24:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.309+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33a8104a70 con 0x7f33a8105040 2024-08-31T04:24:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.310+0000 7f33977fe640 1 -- 172.21.15.2:0/1941995163 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f339c0d0b30 con 0x7f33a8105040 2024-08-31T04:24:58.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:24:58.311 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:24:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:24:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 msgr2=0x7f33900b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 0x7f33900b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33a806c630 tx=0x7f3398005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 msgr2=0x7f33a819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f339c02a930 tx=0x7f339c031a20 comp rx=0 tx=0).stop 2024-08-31T04:24:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 shutdown_connections 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33a8105040 0x7f33a819a800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a810dc10 0x7f33a819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 --2- 172.21.15.2:0/1941995163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a8104660 0x7f33a819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 >> 172.21.15.2:0/1941995163 conn(0x7f33a8079500 msgr2=0x7f33a8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 shutdown_connections 2024-08-31T04:24:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:58.313+0000 7f33ac919640 1 -- 172.21.15.2:0/1941995163 wait complete. 2024-08-31T04:24:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:58.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:58.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1941995163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:58.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:58.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:58 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T04:22:57.945132+0000', 'modified': '2024-08-31T04:23:42.352718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24704, 'mds_1': 24671, 'mds_2': 24646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24622': {'gid': 24622, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.132:6837/209815036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 209815036}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 209815036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6833/3514773724', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 3514773724}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 3514773724}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/3881208235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3881208235}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3881208235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.132:6839/1468403629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6838', 'nonce': 1468403629}, {'type': 'v1', 'addr': '172.21.15.132:6839', 'nonce': 1468403629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24671': {'gid': 24671, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.64:6837/2463382536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 2463382536}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 2463382536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6839/574572481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 574572481}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 574572481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24646, 24671, 24704]} 2024-08-31T04:24:59.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T04:24:59.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T04:24:59.286 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1941995163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:58 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1941995163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:58 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.756+0000 7f117ce88640 1 -- 172.21.15.2:0/146406696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11780754d0 msgr2=0x7f11780758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 --2- 172.21.15.2:0/146406696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11780754d0 0x7f11780758e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1168009900 tx=0x7f116802a410 comp rx=0 tx=0).stop 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 -- 172.21.15.2:0/146406696 shutdown_connections 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 --2- 172.21.15.2:0/146406696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f1178112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 --2- 172.21.15.2:0/146406696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1178075e20 0x7f117810f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 --2- 172.21.15.2:0/146406696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11780754d0 0x7f11780758e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 -- 172.21.15.2:0/146406696 >> 172.21.15.2:0/146406696 conn(0x7f117807b5f0 msgr2=0x7f117807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 -- 172.21.15.2:0/146406696 shutdown_connections 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.757+0000 7f117ce88640 1 -- 172.21.15.2:0/146406696 wait complete. 2024-08-31T04:24:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 Processor -- start 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 -- start start 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11780754d0 0x7f117819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f11781a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1178115a20 con 0x7f1178075e20 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f11781158a0 con 0x7f117810fee0 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f117ce88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1178115ba0 con 0x7f11780754d0 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52942/0 (socket says 172.21.15.2:52942) 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f1175d9b640 1 -- 172.21.15.2:0/2033634722 learned_addr learned my addr 172.21.15.2:0/2033634722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.758+0000 7f1176d9d640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f11781a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f117659c640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11780754d0 0x7f117819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 -- 172.21.15.2:0/2033634722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11780754d0 msgr2=0x7f117819c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11780754d0 0x7f117819c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 -- 172.21.15.2:0/2033634722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 msgr2=0x7f11781a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f11781a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 -- 172.21.15.2:0/2033634722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11781a2420 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1176d9d640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f11781a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f116c00d740 tx=0x7f116c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f11677fe640 1 -- 172.21.15.2:0/2033634722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c017070 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f11677fe640 1 -- 172.21.15.2:0/2033634722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f116c00de50 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11781a2710 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f11677fe640 1 -- 172.21.15.2:0/2033634722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c00f620 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.759+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11781a8e70 con 0x7f1178075e20 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 Processor -- start 2024-08-31T04:24:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11677fe640 1 -- 172.21.15.2:0/2033634722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f116c01a070 con 0x7f1178075e20 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 -- start start 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34e1f60 0x55b3f38877b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3887cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3f37fe3f0 con 0x55b3f34c1280 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3f37ed980 con 0x55b3f34b90a0 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f11833fd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b3f37f1930 con 0x55b3f34e1f60 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.762+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52958/0 (socket says 172.21.15.2:52958) 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 -- 172.21.15.2:0/1144246949 learned_addr learned my addr 172.21.15.2:0/1144246949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1176d9d640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34e1f60 0x55b3f38877b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f117659c640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3887cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 -- 172.21.15.2:0/1144246949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34e1f60 msgr2=0x55b3f38877b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34e1f60 0x55b3f38877b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 -- 172.21.15.2:0/1144246949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 msgr2=0x55b3f3887cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3887cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 -- 172.21.15.2:0/1144246949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f354d540 con 0x55b3f34c1280 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f117659c640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3887cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f11677fe640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 0x7f11600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1176d9d640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 0x7f11600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1175d9b640 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f116c0e2750 tx=0x7f116c0eda10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c7701fda0a3506 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f11677fe640 1 -- 172.21.15.2:0/2033634722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f116c0e5370 con 0x7f1178075e20 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.763+0000 7f1164ff9640 1 -- 172.21.15.2:0/1144246949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c021070 con 0x55b3f34c1280 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f1164ff9640 1 -- 172.21.15.2:0/1144246949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f116c0ab210 con 0x55b3f34c1280 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f1164ff9640 1 -- 172.21.15.2:0/1144246949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c0ab4d0 con 0x55b3f34c1280 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 -- 172.21.15.2:0/1144246949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 msgr2=0x55b3f3888230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f116c0e2750 tx=0x7f116c0eda10 comp rx=0 tx=0).stop 2024-08-31T04:24:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f1176d9d640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 0x7f11600b7120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1170005fd0 tx=0x7f1170009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 -- 172.21.15.2:0/1144246949 shutdown_connections 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f3888230 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3887cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 --2- 172.21.15.2:0/1144246949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34e1f60 0x55b3f38877b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.764+0000 7f11833fd740 1 -- 172.21.15.2:0/1144246949 >> 172.21.15.2:0/1144246949 conn(0x55b3f34d6350 msgr2=0x55b3f38856a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- 172.21.15.2:0/1144246949 shutdown_connections 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- 172.21.15.2:0/1144246949 wait complete. 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- start start 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 Processor -- start 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3892e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 0x55b3f3893360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3f36505f0 con 0x55b3f34e1f60 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3f3774600 con 0x55b3f34b90a0 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b3f3895f90 con 0x55b3f34c1280 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.765+0000 7f11833fd740 10 client.0 _ll_register_callbacks cb 0x55b3f379aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52960/0 (socket says 172.21.15.2:52960) 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 -- 172.21.15.2:0/29582737 learned_addr learned my addr 172.21.15.2:0/29582737 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f117659c640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3892e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1175d9b640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 0x55b3f3893360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 -- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 msgr2=0x55b3f3893360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 0x55b3f3893360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 -- 172.21.15.2:0/29582737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 msgr2=0x55b3f3892e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3892e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 -- 172.21.15.2:0/29582737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3f37ad7b0 con 0x55b3f34e1f60 2024-08-31T04:24:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1175d9b640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 0x55b3f3893360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f1176d9d640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1170010b00 tx=0x7f1170004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde7aeb73363dba7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f115dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117002c060 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1170017030 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f116c0ab210 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1170033050 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f11833fd740 10 client.15306 fetch_fsmap learned FSMap version 25 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.766+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b3f38a1c90 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f116c0ab210 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f117001c3f0 con 0x55b3f34e1f60 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 10 client.15306 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 10 client.15306 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 20 client.15306 populate_metadata read hostname 'smithi002' 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34a08e0 0x55b3f38a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 4 client.15306 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3f3800340 con 0x55b3f34a08e0 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.767+0000 7f117659c640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34a08e0 0x55b3f38a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.768+0000 7f115dffb640 10 client.15306 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.768+0000 7f117659c640 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34a08e0 0x55b3f38a5700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8d38bf2edc73c24 server_cookie=34b48fcca1c7eff9 in_seq=0 out_seq=0 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f115dffb640 1 -- 172.21.15.2:0/29582737 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3f3800340 con 0x55b3f34a08e0 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f115dffb640 10 client.15306 handle_command_reply: tid=0 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 client.15306 shutdown 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 msgr2=0x55b3f38938e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1170010b00 tx=0x7f1170004ab0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 shutdown_connections 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34a08e0 0x55b3f38a5700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f115dffb640 0 client.15306 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:24:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34e1f60 0x55b3f38938e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34c1280 0x55b3f3893360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 --2- 172.21.15.2:0/29582737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34b90a0 0x55b3f3892e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 >> 172.21.15.2:0/29582737 conn(0x55b3f34d6350 msgr2=0x55b3f388a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 shutdown_connections 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 1 -- 172.21.15.2:0/29582737 wait complete. 2024-08-31T04:24:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.769+0000 7f11833fd740 20 client.15306 trim_cache size 0 max 16384 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.787+0000 7f11833fd740 1 Processor -- start 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.787+0000 7f11833fd740 1 -- start start 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 0x55b3f3890010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34b90a0 0x55b3f3890550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a3a40 con 0x55b3f34c1280 2024-08-31T04:24:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a4110 con 0x55b3f34a08e0 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f11833fd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a47e0 con 0x55b3f34b90a0 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52974/0 (socket says 172.21.15.2:52974) 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 -- 172.21.15.2:0/3697640493 learned_addr learned my addr 172.21.15.2:0/3697640493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1175d9b640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34b90a0 0x55b3f3890550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f117659c640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 0x55b3f3890010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 -- 172.21.15.2:0/3697640493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34b90a0 msgr2=0x55b3f3890550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34b90a0 0x55b3f3890550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 -- 172.21.15.2:0/3697640493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 msgr2=0x55b3f3890010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 0x55b3f3890010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f1176d9d640 1 -- 172.21.15.2:0/3697640493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f388e990 con 0x55b3f34c1280 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.788+0000 7f117659c640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 0x55b3f3890010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f1176d9d640 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1170011e90 tx=0x7f117001c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece98a27fd39750 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f115ffff640 1 -- 172.21.15.2:0/3697640493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117001ca30 con 0x55b3f34c1280 2024-08-31T04:24:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f115ffff640 1 -- 172.21.15.2:0/3697640493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f117001cbd0 con 0x55b3f34c1280 2024-08-31T04:24:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f115ffff640 1 -- 172.21.15.2:0/3697640493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170027650 con 0x55b3f34c1280 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f11833fd740 1 -- 172.21.15.2:0/3697640493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 msgr2=0x55b3f38887e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.789+0000 7f11833fd740 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1170011e90 tx=0x7f117001c600 comp rx=0 tx=0).stop 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- 172.21.15.2:0/3697640493 shutdown_connections 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34c1280 0x55b3f38887e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34b90a0 0x55b3f3890550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- 172.21.15.2:0/3697640493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34a08e0 0x55b3f3890010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- 172.21.15.2:0/3697640493 >> 172.21.15.2:0/3697640493 conn(0x55b3f34d6350 msgr2=0x55b3f38916a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- 172.21.15.2:0/3697640493 shutdown_connections 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- 172.21.15.2:0/3697640493 wait complete. 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- start start 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 Processor -- start 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34a08e0 0x55b3f38a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34c1280 0x55b3f38aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a5580 con 0x55b3f34b90a0 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a4eb0 con 0x55b3f34c1280 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b3f38a5c50 con 0x55b3f34a08e0 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.790+0000 7f11833fd740 10 client.0 _ll_register_callbacks cb 0x7f11700109c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52986/0 (socket says 172.21.15.2:52986) 2024-08-31T04:24:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 -- 172.21.15.2:0/2259679395 learned_addr learned my addr 172.21.15.2:0/2259679395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f117659c640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34a08e0 0x55b3f38a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1176d9d640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34c1280 0x55b3f38aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 -- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34a08e0 msgr2=0x55b3f38a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34a08e0 0x55b3f38a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 -- 172.21.15.2:0/2259679395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34c1280 msgr2=0x55b3f38aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34c1280 0x55b3f38aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 -- 172.21.15.2:0/2259679395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3f38a8c40 con 0x55b3f34b90a0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f1175d9b640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f116c009610 tx=0x7f116c010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3204b90ee0421e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f115dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c092e60 con 0x55b3f34b90a0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f116c0ed130 con 0x55b3f34b90a0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117001cbd0 con 0x55b3f34b90a0 2024-08-31T04:24:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f116c021040 con 0x55b3f34b90a0 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f11833fd740 10 client.15312 fetch_fsmap learned FSMap version 25 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.791+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b3f39110d0 con 0x55b3f34b90a0 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f117001cbd0 con 0x55b3f34b90a0 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f116c0b4070 con 0x55b3f34b90a0 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 10 client.15312 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 10 client.15312 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 20 client.15312 populate_metadata read hostname 'smithi002' 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34e1f60 0x55b3f3914470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 4 client.15312 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "status"}) -- 0x55b3f37fbde0 con 0x55b3f34e1f60 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.792+0000 7f117659c640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34e1f60 0x55b3f3914470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f115dffb640 10 client.15312 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:24:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f117659c640 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34e1f60 0x55b3f3914470 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df7a116a1035fe02 server_cookie=816584595a141cff in_seq=0 out_seq=0 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f115dffb640 1 -- 172.21.15.2:0/2259679395 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b3f37fbde0 con 0x55b3f34e1f60 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f115dffb640 10 client.15312 handle_command_reply: tid=0 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 client.15312 shutdown 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 msgr2=0x55b3f38a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f116c009610 tx=0x7f116c010f70 comp rx=0 tx=0).stop 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 shutdown_connections 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b3f34e1f60 0x55b3f3914470 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3f34b90a0 0x55b3f38a8420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3f34c1280 0x55b3f38aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f115dffb640 0 client.15312 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 --2- 172.21.15.2:0/2259679395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b3f34a08e0 0x55b3f38a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 >> 172.21.15.2:0/2259679395 conn(0x55b3f34d6350 msgr2=0x55b3f38887e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 shutdown_connections 2024-08-31T04:24:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 1 -- 172.21.15.2:0/2259679395 wait complete. 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.793+0000 7f11833fd740 20 client.15312 trim_cache size 0 max 16384 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24646, 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 80.378242271000005, 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:24:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 141.08061265500001 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 msgr2=0x7f11600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 0x7f11600b7120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1170005fd0 tx=0x7f1170009500 comp rx=0 tx=0).stop 2024-08-31T04:24:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 msgr2=0x7f117819ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f116c00d740 tx=0x7f116c00dc00 comp rx=0 tx=0).stop 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 shutdown_connections 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f11600b4c10 0x7f11600b7120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1178075e20 0x7f117819ca50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f117810fee0 0x7f11781a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 --2- 172.21.15.2:0/2033634722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11780754d0 0x7f117819c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 >> 172.21.15.2:0/2033634722 conn(0x7f117807b5f0 msgr2=0x7f1178101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 shutdown_connections 2024-08-31T04:24:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:24:59.794+0000 7f117ce88640 1 -- 172.21.15.2:0/2033634722 wait complete. 2024-08-31T04:25:00.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:00.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:00.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:24:59 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:25:00.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:00.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:00.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:24:59 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:25:00.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:00.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:00.318 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:24:59 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:25:00.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T04:25:00.760 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:01.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:00 smithi002 ceph-mon[18656]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 -- 172.21.15.2:0/3271528218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109240 msgr2=0x7f9598109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 --2- 172.21.15.2:0/3271528218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109240 0x7f9598109650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f958c009900 tx=0x7f958c02a410 comp rx=0 tx=0).stop 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 -- 172.21.15.2:0/3271528218 shutdown_connections 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 --2- 172.21.15.2:0/3271528218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109240 0x7f9598109650 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 --2- 172.21.15.2:0/3271528218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598109b90 0x7f95981103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 --2- 172.21.15.2:0/3271528218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598103900 0x7f9598103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 -- 172.21.15.2:0/3271528218 >> 172.21.15.2:0/3271528218 conn(0x7f959807b5f0 msgr2=0x7f959807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 -- 172.21.15.2:0/3271528218 shutdown_connections 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.206+0000 7f959e659640 1 -- 172.21.15.2:0/3271528218 wait complete. 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 Processor -- start 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 -- start start 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598103900 0x7f959819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598109240 0x7f959819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9598113850 con 0x7f9598109b90 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95981136d0 con 0x7f9598109240 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.207+0000 7f959e659640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95981139d0 con 0x7f9598103900 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53010/0 (socket says 172.21.15.2:53010) 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 -- 172.21.15.2:0/3647288314 learned_addr learned my addr 172.21.15.2:0/3647288314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f95977fe640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598109240 0x7f959819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f9597fff640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598103900 0x7f959819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 -- 172.21.15.2:0/3647288314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598103900 msgr2=0x7f959819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598103900 0x7f959819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 -- 172.21.15.2:0/3647288314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598109240 msgr2=0x7f959819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598109240 0x7f959819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 -- 172.21.15.2:0/3647288314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95981a01b0 con 0x7f9598109b90 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f959cbf6640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f959000eaa0 tx=0x7f959000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f95957fa640 1 -- 172.21.15.2:0/3647288314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959000cdb0 con 0x7f9598109b90 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.208+0000 7f95957fa640 1 -- 172.21.15.2:0/3647288314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9590005020 con 0x7f9598109b90 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.209+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95981a04a0 con 0x7f9598109b90 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.209+0000 7f95957fa640 1 -- 172.21.15.2:0/3647288314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900116d0 con 0x7f9598109b90 2024-08-31T04:25:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.209+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95981a6c00 con 0x7f9598109b90 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.211+0000 7f95a4bce740 1 Processor -- start 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.211+0000 7f95957fa640 1 -- 172.21.15.2:0/3647288314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f9590011870 con 0x7f9598109b90 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.211+0000 7f95a4bce740 1 -- start start 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55650e74c3f0 con 0x55650e4070a0 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55650e73b980 con 0x55650e40f280 2024-08-31T04:25:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95a4bce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55650e73f930 con 0x55650e42ff60 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53026/0 (socket says 172.21.15.2:53026) 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 -- 172.21.15.2:0/1769285682 learned_addr learned my addr 172.21.15.2:0/1769285682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95977fe640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95977fe640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95957fa640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 0x7f95800b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 -- 172.21.15.2:0/1769285682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 msgr2=0x55650e7d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7d57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 -- 172.21.15.2:0/1769285682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 msgr2=0x55650e7d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 -- 172.21.15.2:0/1769285682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650e49b540 con 0x55650e4070a0 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95977fe640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f959cbf6640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 0x7f95800b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f95957fa640 1 -- 172.21.15.2:0/3647288314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f95900e5980 con 0x7f9598109b90 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.212+0000 7f9597fff640 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9588009cf0 tx=0x7f9588011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dece78490f3fd6c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.213+0000 7f957e7fc640 1 -- 172.21.15.2:0/1769285682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958801e070 con 0x55650e4070a0 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.213+0000 7f957e7fc640 1 -- 172.21.15.2:0/1769285682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9588009de0 con 0x55650e4070a0 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.213+0000 7f957e7fc640 1 -- 172.21.15.2:0/1769285682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588019450 con 0x55650e4070a0 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- 172.21.15.2:0/1769285682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 msgr2=0x55650e7d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f959cbf6640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 0x7f95800b7120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95900abac0 tx=0x7f9590075e60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9588009cf0 tx=0x7f9588011810 comp rx=0 tx=0).stop 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- 172.21.15.2:0/1769285682 shutdown_connections 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7d5cf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7d6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 --2- 172.21.15.2:0/1769285682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- 172.21.15.2:0/1769285682 >> 172.21.15.2:0/1769285682 conn(0x55650e424350 msgr2=0x55650e7d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- 172.21.15.2:0/1769285682 shutdown_connections 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- 172.21.15.2:0/1769285682 wait complete. 2024-08-31T04:25:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 -- start start 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.214+0000 7f95a4bce740 1 Processor -- start 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55650e59e5f0 con 0x55650e4070a0 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55650e6c2600 con 0x55650e40f280 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55650e7e82f0 con 0x55650e42ff60 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95a4bce740 10 client.0 _ll_register_callbacks cb 0x55650e6e8af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53032/0 (socket says 172.21.15.2:53032) 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f95977fe640 1 -- 172.21.15.2:0/625902269 learned_addr learned my addr 172.21.15.2:0/625902269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.215+0000 7f9597fff640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 -- 172.21.15.2:0/625902269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 msgr2=0x55650e7f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 -- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 msgr2=0x55650e7e5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 -- 172.21.15.2:0/625902269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650e6fb7b0 con 0x55650e4070a0 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f9597fff640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95977fe640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f958c0096c0 tx=0x7f958c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5e016ba1ea8446 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.216+0000 7f95777fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c035040 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f958c004450 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9588009de0 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f958c052050 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 10 client.15324 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55650e7f4070 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9588009de0 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f958c004b90 con 0x55650e4070a0 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 10 client.15324 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 10 client.15324 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 20 client.15324 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3ee8e0 0x55650e7f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 4 client.15324 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.217+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55650e74e340 con 0x55650e3ee8e0 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.218+0000 7f9597fff640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3ee8e0 0x55650e7f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.218+0000 7f9597fff640 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3ee8e0 0x55650e7f7a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae50cad0bb2611c3 server_cookie=878a2171dd0d15e1 in_seq=0 out_seq=0 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.218+0000 7f95777fe640 10 client.15324 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95777fe640 1 -- 172.21.15.2:0/625902269 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55650e74e340 con 0x55650e3ee8e0 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95777fe640 10 client.15324 handle_command_reply: tid=0 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 client.15324 shutdown 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 msgr2=0x55650e7e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f958c0096c0 tx=0x7f958c009260 comp rx=0 tx=0).stop 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 shutdown_connections 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e7f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3ee8e0 0x55650e7f7a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 --2- 172.21.15.2:0/625902269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7e52e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95777fe640 0 client.15324 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 >> 172.21.15.2:0/625902269 conn(0x55650e424350 msgr2=0x55650e7d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 shutdown_connections 2024-08-31T04:25:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.219+0000 7f95a4bce740 1 -- 172.21.15.2:0/625902269 wait complete. 2024-08-31T04:25:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.220+0000 7f95a4bce740 20 client.15324 trim_cache size 0 max 16384 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 Processor -- start 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 -- start start 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e4070a0 0x55650e7e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f5dd0 con 0x55650e42ff60 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f64a0 con 0x55650e40f280 2024-08-31T04:25:01.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95a4bce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f6b70 con 0x55650e4070a0 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53040/0 (socket says 172.21.15.2:53040) 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 -- 172.21.15.2:0/4025977878 learned_addr learned my addr 172.21.15.2:0/4025977878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e4070a0 0x55650e7e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f9597fff640 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 -- 172.21.15.2:0/4025977878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e4070a0 msgr2=0x55650e7e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e4070a0 0x55650e7e57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 -- 172.21.15.2:0/4025977878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 msgr2=0x55650e7e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.238+0000 7f95977fe640 1 -- 172.21.15.2:0/4025977878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650e7d85e0 con 0x55650e42ff60 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f95977fe640 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f958c032e60 tx=0x7f958c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165249028f284b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f957dffb640 1 -- 172.21.15.2:0/4025977878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c041070 con 0x55650e42ff60 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f957dffb640 1 -- 172.21.15.2:0/4025977878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c004450 con 0x55650e42ff60 2024-08-31T04:25:01.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f957dffb640 1 -- 172.21.15.2:0/4025977878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c035070 con 0x55650e42ff60 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f95a4bce740 1 -- 172.21.15.2:0/4025977878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 msgr2=0x55650e7e24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.239+0000 7f95a4bce740 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f958c032e60 tx=0x7f958c005db0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 -- 172.21.15.2:0/4025977878 shutdown_connections 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e42ff60 0x55650e7e24d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 --2- 172.21.15.2:0/4025977878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e4070a0 0x55650e7e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 -- 172.21.15.2:0/4025977878 >> 172.21.15.2:0/4025977878 conn(0x55650e424350 msgr2=0x55650e7e5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 -- 172.21.15.2:0/4025977878 shutdown_connections 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 -- 172.21.15.2:0/4025977878 wait complete. 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 -- start start 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 Processor -- start 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.240+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7fc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e861f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f7910 con 0x55650e4070a0 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f7240 con 0x55650e40f280 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55650e7f7fe0 con 0x55650e42ff60 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 10 client.0 _ll_register_callbacks cb 0x7f958c032f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53042/0 (socket says 172.21.15.2:53042) 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 -- 172.21.15.2:0/691889901 learned_addr learned my addr 172.21.15.2:0/691889901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f9597fff640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7fc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 -- 172.21.15.2:0/691889901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 msgr2=0x55650e861f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e861f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 -- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 msgr2=0x55650e7fc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7fc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 -- 172.21.15.2:0/691889901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650e7fcd20 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95977fe640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f958c032af0 tx=0x7f958c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d8d0febba15845 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95777fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c041040 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f958c005140 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.241+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c004450 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f958c035040 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 10 client.15330 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55650e863470 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c004450 con 0x55650e4070a0 2024-08-31T04:25:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f958c004a80 con 0x55650e4070a0 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 10 client.15330 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 10 client.15330 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 20 client.15330 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3c3c90 0x55650e866940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 4 client.15330 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "status"}) -- 0x55650e749de0 con 0x55650e3c3c90 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.242+0000 7f9597fff640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3c3c90 0x55650e866940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f9597fff640 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3c3c90 0x55650e866940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0fd6d1738180691 server_cookie=95aaa75e16fbe03c in_seq=0 out_seq=0 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95777fe640 10 client.15330 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95777fe640 1 -- 172.21.15.2:0/691889901 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55650e749de0 con 0x55650e3c3c90 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95777fe640 10 client.15330 handle_command_reply: tid=0 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 client.15330 shutdown 2024-08-31T04:25:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 msgr2=0x55650e7fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f958c032af0 tx=0x7f958c000bc0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 shutdown_connections 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55650e42ff60 0x55650e861f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55650e40f280 0x55650e7fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55650e3c3c90 0x55650e866940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 --2- 172.21.15.2:0/691889901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55650e4070a0 0x55650e7fbfc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95777fe640 0 client.15330 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.243+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 >> 172.21.15.2:0/691889901 conn(0x55650e424350 msgr2=0x55650e7da950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 shutdown_connections 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f95a4bce740 1 -- 172.21.15.2:0/691889901 wait complete. 2024-08-31T04:25:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f95a4bce740 20 client.15330 trim_cache size 0 max 16384 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24671, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 82.843316770000001, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 145.13167117399999 2024-08-31T04:25:01.250 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 msgr2=0x7f95800b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 0x7f95800b7120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95900abac0 tx=0x7f9590075e60 comp rx=0 tx=0).stop 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 msgr2=0x7f959819fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f959000eaa0 tx=0x7f959000ef60 comp rx=0 tx=0).stop 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 shutdown_connections 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95800b4c10 0x7f95800b7120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9598109b90 0x7f959819fa80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9598109240 0x7f959819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 --2- 172.21.15.2:0/3647288314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9598103900 0x7f959819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.244+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 >> 172.21.15.2:0/3647288314 conn(0x7f959807b5f0 msgr2=0x7f95981052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.245+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 shutdown_connections 2024-08-31T04:25:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:01.245+0000 7f959e659640 1 -- 172.21.15.2:0/3647288314 wait complete. 2024-08-31T04:25:01.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:00 smithi064 ceph-mon[22007]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:00 smithi132 ceph-mon[22335]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:01.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:25:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:02.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 -- 172.21.15.2:0/1237050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538108170 msgr2=0x7fe538108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1237050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538108170 0x7fe538108580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009900 tx=0x7fe52c02a410 comp rx=0 tx=0).stop 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 -- 172.21.15.2:0/1237050563 shutdown_connections 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1237050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538108170 0x7fe538108580 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1237050563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe53810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1237050563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538102880 0x7fe538102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 -- 172.21.15.2:0/1237050563 >> 172.21.15.2:0/1237050563 conn(0x7fe538079500 msgr2=0x7fe538079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 -- 172.21.15.2:0/1237050563 shutdown_connections 2024-08-31T04:25:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.782+0000 7fe53ef40640 1 -- 172.21.15.2:0/1237050563 wait complete. 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 Processor -- start 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 -- start start 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538108170 0x7fe5380ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe5380ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5381126f0 con 0x7fe538102880 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe538112570 con 0x7fe538108ac0 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ef40640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe538112870 con 0x7fe538108170 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ccdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ccdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53054/0 (socket says 172.21.15.2:53054) 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53ccdc640 1 -- 172.21.15.2:0/1393046320 learned_addr learned my addr 172.21.15.2:0/1393046320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe537fff640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538108170 0x7fe5380ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.783+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe5380ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 -- 172.21.15.2:0/1393046320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538108170 msgr2=0x7fe5380ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538108170 0x7fe5380ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 -- 172.21.15.2:0/1393046320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 msgr2=0x7fe5380ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe5380ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 -- 172.21.15.2:0/1393046320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5381a8530 con 0x7fe538102880 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe5380ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d950 tx=0x7fe52800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe535ffb640 1 -- 172.21.15.2:0/1393046320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528017070 con 0x7fe538102880 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5381a8820 con 0x7fe538102880 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe535ffb640 1 -- 172.21.15.2:0/1393046320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe528009c30 con 0x7fe538102880 2024-08-31T04:25:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe535ffb640 1 -- 172.21.15.2:0/1393046320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52800f620 con 0x7fe538102880 2024-08-31T04:25:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.784+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381a8d30 con 0x7fe538102880 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe535ffb640 1 -- 172.21.15.2:0/1393046320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fe528010460 con 0x7fe538102880 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 Processor -- start 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 -- start start 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1589cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e158a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5591e15003f0 con 0x5591e11e3f60 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591e14ef980 con 0x5591e11c3280 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe5454b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5591e14f3930 con 0x5591e11bb0a0 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe53d4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe53d4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53068/0 (socket says 172.21.15.2:53068) 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe53d4dd640 1 -- 172.21.15.2:0/2727544262 learned_addr learned my addr 172.21.15.2:0/2727544262 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.787+0000 7fe537fff640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e158a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe535ffb640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 0x7fe5200b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1589cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 -- 172.21.15.2:0/2727544262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 msgr2=0x5591e1589cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1589cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 -- 172.21.15.2:0/2727544262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 msgr2=0x5591e158a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e158a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 -- 172.21.15.2:0/2727544262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e124f540 con 0x5591e11e3f60 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1589cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 0x7fe5200b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe535ffb640 1 -- 172.21.15.2:0/1393046320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe5280e54c0 con 0x7fe538102880 2024-08-31T04:25:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe530010540 tx=0x7fe530010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45094ef538197f3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe51effd640 1 -- 172.21.15.2:0/2727544262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53001d400 con 0x5591e11e3f60 2024-08-31T04:25:02.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe51effd640 1 -- 172.21.15.2:0/2727544262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5300134c0 con 0x5591e11e3f60 2024-08-31T04:25:02.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe51effd640 1 -- 172.21.15.2:0/2727544262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5300116b0 con 0x5591e11e3f60 2024-08-31T04:25:02.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.788+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 0x7fe5200b7120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe530021000 tx=0x7fe53001e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 -- 172.21.15.2:0/2727544262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 msgr2=0x5591e15897b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe530010540 tx=0x7fe530010a00 comp rx=0 tx=0).stop 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 -- 172.21.15.2:0/2727544262 shutdown_connections 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e158a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1589cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 --2- 172.21.15.2:0/2727544262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15897b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 -- 172.21.15.2:0/2727544262 >> 172.21.15.2:0/2727544262 conn(0x5591e11d8350 msgr2=0x5591e15876a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 -- 172.21.15.2:0/2727544262 shutdown_connections 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.789+0000 7fe5454b5740 1 -- 172.21.15.2:0/2727544262 wait complete. 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 -- start start 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 Processor -- start 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1594e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e15953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5591e13525f0 con 0x5591e11e3f60 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591e1476600 con 0x5591e11c3280 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.790+0000 7fe5454b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5591e1597f90 con 0x5591e11bb0a0 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe5454b5740 10 client.0 _ll_register_callbacks cb 0x5591e149caf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53080/0 (socket says 172.21.15.2:53080) 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 -- 172.21.15.2:0/3340720683 learned_addr learned my addr 172.21.15.2:0/3340720683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe537fff640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e15953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1594e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 -- 172.21.15.2:0/3340720683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 msgr2=0x5591e1594e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1594e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 -- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 msgr2=0x5591e15953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e15953a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 -- 172.21.15.2:0/3340720683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e14af7b0 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe530011be0 tx=0x7fe530011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496bc2aaddc51857 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe517fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530034060 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe530004c10 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.791+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5300134c0 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe53003b050 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 10 client.15342 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591e15a3ca0 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5300134c0 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe53000f040 con 0x5591e11e3f60 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 10 client.15342 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 10 client.15342 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 20 client.15342 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e11a28e0 0x5591e15a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 4 client.15342 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591e1502340 con 0x5591e11a28e0 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.792+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e11a28e0 0x5591e15a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.793+0000 7fe517fff640 10 client.15342 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.793+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e11a28e0 0x5591e15a74d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02dc427389e605c server_cookie=3ffd2a230bbf1db3 in_seq=0 out_seq=0 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.793+0000 7fe517fff640 1 -- 172.21.15.2:0/3340720683 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591e1502340 con 0x5591e11a28e0 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.793+0000 7fe517fff640 10 client.15342 handle_command_reply: tid=0 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 client.15342 shutdown 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 msgr2=0x5591e15a1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe530011be0 tx=0x7fe530011c10 comp rx=0 tx=0).stop 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 shutdown_connections 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e11a28e0 0x5591e15a74d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11e3f60 0x5591e15a1280 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11c3280 0x5591e15953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 --2- 172.21.15.2:0/3340720683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e1594e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe517fff640 0 client.15342 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 >> 172.21.15.2:0/3340720683 conn(0x5591e11d8350 msgr2=0x5591e158c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 shutdown_connections 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 1 -- 172.21.15.2:0/3340720683 wait complete. 2024-08-31T04:25:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.794+0000 7fe5454b5740 20 client.15342 trim_cache size 0 max 16384 2024-08-31T04:25:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 Processor -- start 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 -- start start 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e158b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e1594c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a5810 con 0x5591e11c3280 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a5ee0 con 0x5591e11e3f60 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.812+0000 7fe5454b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a65b0 con 0x5591e11bb0a0 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53088/0 (socket says 172.21.15.2:53088) 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 -- 172.21.15.2:0/4263758373 learned_addr learned my addr 172.21.15.2:0/4263758373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e158b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 -- 172.21.15.2:0/4263758373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 msgr2=0x5591e158b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e158b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 -- 172.21.15.2:0/4263758373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 msgr2=0x5591e1594c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e1594c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 -- 172.21.15.2:0/4263758373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e158c610 con 0x5591e11c3280 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe537fff640 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009900 tx=0x7fe52c032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f06a1137c583dac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.813+0000 7fe51e7fc640 1 -- 172.21.15.2:0/4263758373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c035040 con 0x5591e11c3280 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.814+0000 7fe51e7fc640 1 -- 172.21.15.2:0/4263758373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe52c031d10 con 0x5591e11c3280 2024-08-31T04:25:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.814+0000 7fe51e7fc640 1 -- 172.21.15.2:0/4263758373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0053c0 con 0x5591e11c3280 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- 172.21.15.2:0/4263758373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 msgr2=0x5591e15a11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009900 tx=0x7fe52c032e50 comp rx=0 tx=0).stop 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- 172.21.15.2:0/4263758373 shutdown_connections 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11c3280 0x5591e15a11f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e1594c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 --2- 172.21.15.2:0/4263758373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11bb0a0 0x5591e158b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- 172.21.15.2:0/4263758373 >> 172.21.15.2:0/4263758373 conn(0x5591e11d8350 msgr2=0x5591e15936e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- 172.21.15.2:0/4263758373 shutdown_connections 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- 172.21.15.2:0/4263758373 wait complete. 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 -- start start 2024-08-31T04:25:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.815+0000 7fe5454b5740 1 Processor -- start 2024-08-31T04:25:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11c3280 0x5591e15a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e15aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a7350 con 0x5591e11bb0a0 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a6c80 con 0x5591e11e3f60 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5591e15a7a20 con 0x5591e11c3280 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe5454b5740 10 client.0 _ll_register_callbacks cb 0x7fe530010370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53102/0 (socket says 172.21.15.2:53102) 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 -- 172.21.15.2:0/365103091 learned_addr learned my addr 172.21.15.2:0/365103091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe537fff640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11c3280 0x5591e15a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e15aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 -- 172.21.15.2:0/365103091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11c3280 msgr2=0x5591e15a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11c3280 0x5591e15a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 -- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 msgr2=0x5591e15aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e15aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53ccdc640 1 -- 172.21.15.2:0/365103091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e15af0d0 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.816+0000 7fe53d4dd640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e15aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe53ccdc640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe5280a78d0 tx=0x7fe5280e2db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5484ac9a52ae5174 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528020040 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe5280acb80 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52c031d10 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5280abf50 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe5454b5740 10 client.15348 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591e1612d20 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe528009de0 con 0x5591e11bb0a0 2024-08-31T04:25:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe5280a71c0 con 0x5591e11bb0a0 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.817+0000 7fe5454b5740 10 client.15348 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe5454b5740 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe5454b5740 20 client.15348 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e1177c90 0x5591e1616560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe5454b5740 4 client.15348 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "status"}) -- 0x7fe52c031d10 con 0x5591e1177c90 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe537fff640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e1177c90 0x5591e1616560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe537fff640 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e1177c90 0x5591e1616560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41930f7d35a8a26 server_cookie=965a70e23deaeebe in_seq=0 out_seq=0 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe517fff640 10 client.15348 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe517fff640 1 -- 172.21.15.2:0/365103091 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x7fe52c031d10 con 0x5591e1177c90 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.818+0000 7fe517fff640 10 client.15348 handle_command_reply: tid=0 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 client.15348 shutdown 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 msgr2=0x5591e15a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe5280a78d0 tx=0x7fe5280e2db0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 shutdown_connections 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5591e1177c90 0x5591e1616560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591e11e3f60 0x5591e15aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5591e11c3280 0x5591e15a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 --2- 172.21.15.2:0/365103091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5591e11bb0a0 0x5591e15a9890 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 >> 172.21.15.2:0/365103091 conn(0x5591e11d8350 msgr2=0x5591e1596310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe517fff640 0 client.15348 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 shutdown_connections 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 1 -- 172.21.15.2:0/365103091 wait complete. 2024-08-31T04:25:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.819+0000 7fe5454b5740 20 client.15348 trim_cache size 0 max 16384 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24704, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 124.58941869, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:25:02.827 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 135.30978470100001 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 msgr2=0x7fe5200b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 0x7fe5200b7120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe530021000 tx=0x7fe53001e000 comp rx=0 tx=0).stop 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 msgr2=0x7fe5380ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d950 tx=0x7fe52800de10 comp rx=0 tx=0).stop 2024-08-31T04:25:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 shutdown_connections 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe538108ac0 0x7fe5380ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe538108170 0x7fe5380ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe5200b4c10 0x7fe5200b7120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 --2- 172.21.15.2:0/1393046320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe538102880 0x7fe5380ff410 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 >> 172.21.15.2:0/1393046320 conn(0x7fe538079500 msgr2=0x7fe5381018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 shutdown_connections 2024-08-31T04:25:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:02.820+0000 7fe53ef40640 1 -- 172.21.15.2:0/1393046320 wait complete. 2024-08-31T04:25:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:02 smithi002 ceph-mon[18656]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:02 smithi064 ceph-mon[22007]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:02 smithi132 ceph-mon[22335]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:03.526 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T04:25:03.527 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T04:25:03.539 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:25:03.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T04:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 -- 172.21.15.2:0/1902638526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8103900 msgr2=0x7fddd8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/1902638526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8103900 0x7fddd8103d10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009900 tx=0x7fddc802a410 comp rx=0 tx=0).stop 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 -- 172.21.15.2:0/1902638526 shutdown_connections 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/1902638526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8109b90 0x7fddd81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/1902638526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/1902638526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8103900 0x7fddd8103d10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 -- 172.21.15.2:0/1902638526 >> 172.21.15.2:0/1902638526 conn(0x7fddd807b5f0 msgr2=0x7fddd807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.276+0000 7fdddcd0d640 1 -- 172.21.15.2:0/1902638526 shutdown_connections 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.277+0000 7fdddcd0d640 1 -- 172.21.15.2:0/1902638526 wait complete. 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.277+0000 7fdddcd0d640 1 Processor -- start 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.277+0000 7fdddcd0d640 1 -- start start 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8103900 0x7fddd819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddd81138e0 con 0x7fddd8109b90 2024-08-31T04:25:04.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8113760 con 0x7fddd8103900 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8113a60 con 0x7fddd8109240 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53110/0 (socket says 172.21.15.2:53110) 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 -- 172.21.15.2:0/4134509837 learned_addr learned my addr 172.21.15.2:0/4134509837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd659c640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8103900 0x7fddd819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd5d9b640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 -- 172.21.15.2:0/4134509837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 msgr2=0x7fddd819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 -- 172.21.15.2:0/4134509837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8103900 msgr2=0x7fddd819c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8103900 0x7fddd819c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 -- 172.21.15.2:0/4134509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd81a2420 con 0x7fddd8109b90 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd5d9b640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:04.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddd6d9d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fddd000eaa0 tx=0x7fddd000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd000cdb0 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddd0005020 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd81a2710 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.278+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00116d0 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.279+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81a8e70 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.279+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd8103d10 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.282+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fddd00051d0 con 0x7fddd8109b90 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.282+0000 7fddcf7fe640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 0x7fddc40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:04.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.283+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fddd00e5e30 con 0x7fddd8109b90 2024-08-31T04:25:04.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.283+0000 7fddd659c640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 0x7fddc40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:04.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.283+0000 7fddd659c640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 0x7fddc40b7120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc8005ab0 tx=0x7fddc8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.287+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fddd0016030 con 0x7fddd8109b90 2024-08-31T04:25:04.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.494+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fddd8107760 con 0x7fddc40b4c10 2024-08-31T04:25:04.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.495+0000 7fddcf7fe640 1 -- 172.21.15.2:0/4134509837 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fddd8107760 con 0x7fddc40b4c10 2024-08-31T04:25:04.497 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-08-31T04:25:04.497 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-08-31T04:25:04.497 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-08-31T04:25:04.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 msgr2=0x7fddc40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:04.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 0x7fddc40b7120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc8005ab0 tx=0x7fddc8005a20 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 msgr2=0x7fddd81a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fddd000eaa0 tx=0x7fddd000ef60 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 shutdown_connections 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fddc40b4c10 0x7fddc40b7120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddd8109b90 0x7fddd81a1cf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd8109240 0x7fddd819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 --2- 172.21.15.2:0/4134509837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddd8103900 0x7fddd819c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 >> 172.21.15.2:0/4134509837 conn(0x7fddd807b5f0 msgr2=0x7fddd8107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 shutdown_connections 2024-08-31T04:25:04.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:04.498+0000 7fdddcd0d640 1 -- 172.21.15.2:0/4134509837 wait complete. 2024-08-31T04:25:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:04 smithi002 ceph-mon[18656]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:05.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T04:25:05.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:04 smithi064 ceph-mon[22007]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:04 smithi132 ceph-mon[22335]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:05.461 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:05.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:05 smithi002 ceph-mon[18656]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 -- 172.21.15.2:0/1977569630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109b90 msgr2=0x7f0f841103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 --2- 172.21.15.2:0/1977569630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109b90 0x7f0f841103c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009ca0 tx=0x7f0f7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 -- 172.21.15.2:0/1977569630 shutdown_connections 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 --2- 172.21.15.2:0/1977569630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109b90 0x7f0f841103c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 --2- 172.21.15.2:0/1977569630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84109240 0x7f0f84109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 --2- 172.21.15.2:0/1977569630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84103900 0x7f0f84103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 -- 172.21.15.2:0/1977569630 >> 172.21.15.2:0/1977569630 conn(0x7f0f8407b5f0 msgr2=0x7f0f8407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 -- 172.21.15.2:0/1977569630 shutdown_connections 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.970+0000 7f0f89164640 1 -- 172.21.15.2:0/1977569630 wait complete. 2024-08-31T04:25:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.971+0000 7f0f89164640 1 Processor -- start 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.971+0000 7f0f89164640 1 -- start start 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.971+0000 7f0f89164640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84103900 0x7f0f8419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84109b90 0x7f0f8419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84113850 con 0x7f0f84109240 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0f841136d0 con 0x7f0f84109b90 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0f841139d0 con 0x7f0f84103900 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45072/0 (socket says 172.21.15.2:45072) 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 -- 172.21.15.2:0/791781999 learned_addr learned my addr 172.21.15.2:0/791781999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f82d9d640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84103900 0x7f0f8419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:05.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8359e640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84109b90 0x7f0f8419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 -- 172.21.15.2:0/791781999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84103900 msgr2=0x7f0f8419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84103900 0x7f0f8419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 -- 172.21.15.2:0/791781999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84109b90 msgr2=0x7f0f8419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84109b90 0x7f0f8419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 -- 172.21.15.2:0/791781999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f841a0110 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f8259c640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c970 tx=0x7f0f7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78007bb0 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f841a0400 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f78007d50 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.972+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800f450 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.973+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f84075390 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.974+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f84103d10 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.976+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f0f78004eb0 con 0x7f0f84109240 2024-08-31T04:25:05.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.977+0000 7f0f6bfff640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 0x7f0f6c0bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:05.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.977+0000 7f0f82d9d640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 0x7f0f6c0bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:05.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.977+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0f780e5760 con 0x7f0f84109240 2024-08-31T04:25:05.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.977+0000 7f0f82d9d640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 0x7f0f6c0bb4a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005d00 tx=0x7f0f7400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:05.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:05.981+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0f78014030 con 0x7f0f84109240 2024-08-31T04:25:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.174+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0f8410b9e0 con 0x7f0f6c0b8f90 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.186+0000 7f0f6bfff640 1 -- 172.21.15.2:0/791781999 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f0f8410b9e0 con 0x7f0f6c0b8f90 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (2m) 7s ago 2m 84.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 91fab9dfbc2e 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi064 running (2m) 8s ago 2m 93.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 25475801b8e4 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi132 running (2m) 8s ago 2m 85.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 503d822a4f6c 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (2m) 7s ago 2m 82.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 a4e052cf020f 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi064 running (2m) 8s ago 2m 86.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 81742cf9c25e 2024-08-31T04:25:06.188 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi132 running (2m) 8s ago 2m 82.1M - 19.3.0-4560-gd19e6118 79f4cde5e369 ee93736f8257 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (2m) 7s ago 2m 81.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 604f1ff561af 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi064 running (2m) 8s ago 2m 86.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 f94244822c72 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi132 running (2m) 8s ago 2m 86.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 8a3b2cc30c4d 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (2m) 7s ago 2m 82.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 6997f8e0ef6d 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi064 running (2m) 8s ago 2m 85.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 add45e878c73 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi132 running (2m) 8s ago 2m 82.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 f4bf515877a9 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (10m) 7s ago 10m 587M - 19.3.0-4560-gd19e6118 79f4cde5e369 9f6b9dc37523 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi064 *:8443,8765 running (8m) 8s ago 8m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 17324dfcc8f7 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi132 *:8443,8765 running (8m) 8s ago 8m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 ba25d0b243a4 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (10m) 7s ago 10m 123M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 4c59e47fdc18 2024-08-31T04:25:06.189 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi064 running (8m) 8s ago 8m 116M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 2d4e22f94ddc 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi132 running (8m) 8s ago 8m 114M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 ee8d0cd37108 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 7s ago 7m 123M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 c0e8014a08c9 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi064 running (7m) 8s ago 7m 114M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 7cb1bd57f064 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi132 running (6m) 8s ago 6m 115M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 7c6ee6c7ba7b 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (6m) 7s ago 6m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 cd50be53946d 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi064 running (6m) 8s ago 6m 111M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 5fb66da245af 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi132 running (5m) 8s ago 5m 123M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 d3dcbdbcda31 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (5m) 7s ago 5m 117M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 728521699ed4 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi064 running (4m) 8s ago 4m 119M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 b4b5009bf5c1 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi132 running (4m) 8s ago 4m 111M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 9b50450c3025 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (4m) 7s ago 4m 118M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7fcc7dc5703f 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi064 running (3m) 8s ago 3m 120M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 7d190307c71d 2024-08-31T04:25:06.190 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi132 running (3m) 8s ago 3m 116M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 035b82873687 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 msgr2=0x7f0f6c0bb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 0x7f0f6c0bb4a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005d00 tx=0x7f0f7400b410 comp rx=0 tx=0).stop 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 msgr2=0x7f0f8419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c970 tx=0x7f0f7800ce30 comp rx=0 tx=0).stop 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 shutdown_connections 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0f6c0b8f90 0x7f0f6c0bb4a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f84109240 0x7f0f8419a740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f84109b90 0x7f0f8419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 --2- 172.21.15.2:0/791781999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f84103900 0x7f0f8419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 >> 172.21.15.2:0/791781999 conn(0x7f0f8407b5f0 msgr2=0x7f0f84107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 shutdown_connections 2024-08-31T04:25:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:06.189+0000 7f0f89164640 1 -- 172.21.15.2:0/791781999 wait complete. 2024-08-31T04:25:06.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:05 smithi064 ceph-mon[22007]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:06.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:05 smithi132 ceph-mon[22335]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:06.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T04:25:07.140 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:06 smithi002 ceph-mon[18656]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:06 smithi002 ceph-mon[18656]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T04:25:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:06 smithi064 ceph-mon[22007]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:06 smithi064 ceph-mon[22007]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T04:25:07.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:06 smithi132 ceph-mon[22335]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:07.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:06 smithi132 ceph-mon[22335]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T04:25:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 -- 172.21.15.2:0/2591943421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 msgr2=0x7f39e81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2591943421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e81103c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009ca0 tx=0x7f39e002a8e0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 -- 172.21.15.2:0/2591943421 shutdown_connections 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2591943421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e81103c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2591943421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 0x7f39e8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2591943421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 0x7f39e8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 -- 172.21.15.2:0/2591943421 >> 172.21.15.2:0/2591943421 conn(0x7f39e807b5f0 msgr2=0x7f39e807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 -- 172.21.15.2:0/2591943421 shutdown_connections 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.671+0000 7f39edbd9640 1 -- 172.21.15.2:0/2591943421 wait complete. 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 Processor -- start 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 -- start start 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 0x7f39e80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 0x7f39e80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81138e0 con 0x7f39e8109b90 2024-08-31T04:25:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8113760 con 0x7f39e8103900 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.672+0000 7f39edbd9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8113a60 con 0x7f39e8109240 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 0x7f39e80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45090/0 (socket says 172.21.15.2:45090) 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 -- 172.21.15.2:0/2485770610 learned_addr learned my addr 172.21.15.2:0/2485770610 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39deffd640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 0x7f39e80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 -- 172.21.15.2:0/2485770610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 msgr2=0x7f39e80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 0x7f39e80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 -- 172.21.15.2:0/2485770610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 msgr2=0x7f39e80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 0x7f39e80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 -- 172.21.15.2:0/2485770610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81a84b0 con 0x7f39e8109b90 2024-08-31T04:25:07.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e7fff640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39e0003bd0 tx=0x7f39e0003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0004240 con 0x7f39e8109b90 2024-08-31T04:25:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e81a8740 con 0x7f39e8109b90 2024-08-31T04:25:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e0003e20 con 0x7f39e8109b90 2024-08-31T04:25:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.673+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0030eb0 con 0x7f39e8109b90 2024-08-31T04:25:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.674+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e81a8d50 con 0x7f39e8109b90 2024-08-31T04:25:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.674+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e8103d10 con 0x7f39e8109b90 2024-08-31T04:25:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.676+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f39e00305e0 con 0x7f39e8109b90 2024-08-31T04:25:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.677+0000 7f39e57fa640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 0x7f39d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.677+0000 7f39e77fe640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 0x7f39d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.678+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f39e0106ba0 con 0x7f39e8109b90 2024-08-31T04:25:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.678+0000 7f39e77fe640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 0x7f39d40b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39d80058c0 tx=0x7f39d800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:07.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.680+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39e0106e20 con 0x7f39e8109b90 2024-08-31T04:25:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.873+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f39e80635a0 con 0x7f39d40b4b80 2024-08-31T04:25:07.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.879+0000 7f39e57fa640 1 -- 172.21.15.2:0/2485770610 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f39e80635a0 con 0x7f39d40b4b80 2024-08-31T04:25:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T04:25:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 10s ago 2m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi064=b;smithi064=e;smithi064=h;smithi064=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-08-31T04:25:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 10s ago 8m smithi002=x;smithi064=y;smithi132=z;count:3 2024-08-31T04:25:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 10s ago 9m smithi002:172.21.15.2=a;smithi064:172.21.15.64=b;smithi132:172.21.15.132=c;count:3 2024-08-31T04:25:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 10s ago - 2024-08-31T04:25:07.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.881+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 msgr2=0x7f39d40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:07.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.881+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 0x7f39d40b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39d80058c0 tx=0x7f39d800a2d0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.881+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 msgr2=0x7f39e8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.881+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39e0003bd0 tx=0x7f39e0003c00 comp rx=0 tx=0).stop 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 shutdown_connections 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39d40b4b80 0x7f39d40b7090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39e8109b90 0x7f39e8075f30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e8109240 0x7f39e80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 --2- 172.21.15.2:0/2485770610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8103900 0x7f39e80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 >> 172.21.15.2:0/2485770610 conn(0x7f39e807b5f0 msgr2=0x7f39e8107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 shutdown_connections 2024-08-31T04:25:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:07.882+0000 7f39edbd9640 1 -- 172.21.15.2:0/2485770610 wait complete. 2024-08-31T04:25:08.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:07 smithi002 ceph-mon[18656]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:08.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:07 smithi064 ceph-mon[22007]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:08.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:07 smithi132 ceph-mon[22335]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:08.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T04:25:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:09.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:08 smithi002 ceph-mon[18656]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:09.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:08 smithi002 ceph-mon[18656]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:08 smithi064 ceph-mon[22007]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:08 smithi064 ceph-mon[22007]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:08 smithi132 ceph-mon[22335]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:08 smithi132 ceph-mon[22335]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 -- 172.21.15.2:0/769127600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 msgr2=0x7f966c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 --2- 172.21.15.2:0/769127600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c1100a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9664009ca0 tx=0x7f966402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 -- 172.21.15.2:0/769127600 shutdown_connections 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 --2- 172.21.15.2:0/769127600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c1100a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 --2- 172.21.15.2:0/769127600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 0x7f966c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 --2- 172.21.15.2:0/769127600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 0x7f966c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 -- 172.21.15.2:0/769127600 >> 172.21.15.2:0/769127600 conn(0x7f966c0794d0 msgr2=0x7f966c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 -- 172.21.15.2:0/769127600 shutdown_connections 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.351+0000 7f9670e0f640 1 -- 172.21.15.2:0/769127600 wait complete. 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 Processor -- start 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 -- start start 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 0x7f966c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 0x7f966c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f966c113810 con 0x7f966c10dbd0 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f966c113690 con 0x7f966c105050 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.352+0000 7f9670e0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f966c113990 con 0x7f966c104620 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 0x7f966c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45114/0 (socket says 172.21.15.2:45114) 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 -- 172.21.15.2:0/1016749123 learned_addr learned my addr 172.21.15.2:0/1016749123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f9669d9b640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 0x7f966c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 -- 172.21.15.2:0/1016749123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 msgr2=0x7f966c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 0x7f966c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 -- 172.21.15.2:0/1016749123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 msgr2=0x7f966c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 0x7f966c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 -- 172.21.15.2:0/1016749123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c1a01b0 con 0x7f966c10dbd0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f966ad9d640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9664005cc0 tx=0x7f966402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664003bf0 con 0x7f966c10dbd0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9664003d90 con 0x7f966c10dbd0 2024-08-31T04:25:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c1a0440 con 0x7f966c10dbd0 2024-08-31T04:25:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.353+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966402fbc0 con 0x7f966c10dbd0 2024-08-31T04:25:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.354+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c1a6c00 con 0x7f966c10dbd0 2024-08-31T04:25:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.355+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966c104a30 con 0x7f966c10dbd0 2024-08-31T04:25:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.357+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f966402fd60 con 0x7f966c10dbd0 2024-08-31T04:25:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.358+0000 7f96637fe640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 0x7f96580b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.358+0000 7f966a59c640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 0x7f96580b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.358+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f9664106dd0 con 0x7f966c10dbd0 2024-08-31T04:25:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.358+0000 7f966a59c640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 0x7f96580b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9654005fd0 tx=0x7f965400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.361+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9664083130 con 0x7f966c10dbd0 2024-08-31T04:25:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.555+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f966c107dc0 con 0x7f96580b4b80 2024-08-31T04:25:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.556+0000 7f96637fe640 1 -- 172.21.15.2:0/1016749123 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f966c107dc0 con 0x7f96580b4b80 2024-08-31T04:25:09.558 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-08-31T04:25:09.558 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-08-31T04:25:09.558 INFO:teuthology.orchestra.run.smithi002.stdout:smithi064 172.21.15.64 2024-08-31T04:25:09.558 INFO:teuthology.orchestra.run.smithi002.stdout:smithi132 172.21.15.132 2024-08-31T04:25:09.558 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.558+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 msgr2=0x7f96580b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.558+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 0x7f96580b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9654005fd0 tx=0x7f965400b390 comp rx=0 tx=0).stop 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.558+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 msgr2=0x7f966c19fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.558+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9664005cc0 tx=0x7f966402f380 comp rx=0 tx=0).stop 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.558+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 shutdown_connections 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f96580b4b80 0x7f96580b7090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f966c10dbd0 0x7f966c19fa80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f966c105050 0x7f966c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 --2- 172.21.15.2:0/1016749123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c104620 0x7f966c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 >> 172.21.15.2:0/1016749123 conn(0x7f966c0794d0 msgr2=0x7f966c1076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 shutdown_connections 2024-08-31T04:25:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:09.559+0000 7f9670e0f640 1 -- 172.21.15.2:0/1016749123 wait complete. 2024-08-31T04:25:10.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T04:25:10.553 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:10.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:10 smithi002 ceph-mon[18656]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:10.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:10 smithi002 ceph-mon[18656]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.049+0000 7f50dac84640 1 -- 172.21.15.2:0/4029657993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4108170 msgr2=0x7f50d4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.049+0000 7f50dac84640 1 --2- 172.21.15.2:0/4029657993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4108170 0x7f50d4108580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009900 tx=0x7f50c002a410 comp rx=0 tx=0).stop 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.049+0000 7f50dac84640 1 -- 172.21.15.2:0/4029657993 shutdown_connections 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 --2- 172.21.15.2:0/4029657993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4108170 0x7f50d4108580 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 --2- 172.21.15.2:0/4029657993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108ac0 0x7f50d410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 --2- 172.21.15.2:0/4029657993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4102880 0x7f50d4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 -- 172.21.15.2:0/4029657993 >> 172.21.15.2:0/4029657993 conn(0x7f50d4079500 msgr2=0x7f50d4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 -- 172.21.15.2:0/4029657993 shutdown_connections 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 -- 172.21.15.2:0/4029657993 wait complete. 2024-08-31T04:25:11.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 Processor -- start 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.050+0000 7f50dac84640 1 -- start start 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108170 0x7f50d419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 0x7f50d419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50d41126f0 con 0x7f50d4102880 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4112570 con 0x7f50d4108170 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4112870 con 0x7f50d4108ac0 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45128/0 (socket says 172.21.15.2:45128) 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 -- 172.21.15.2:0/1771453690 learned_addr learned my addr 172.21.15.2:0/1771453690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d9221640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 0x7f50d419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d3fff640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108170 0x7f50d419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 -- 172.21.15.2:0/1771453690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 msgr2=0x7f50d419fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 0x7f50d419fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 -- 172.21.15.2:0/1771453690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108170 msgr2=0x7f50d419a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108170 0x7f50d419a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 -- 172.21.15.2:0/1771453690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d41a0240 con 0x7f50d4102880 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d9221640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 0x7f50d419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d8a20640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f50c800d950 tx=0x7f50c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8017070 con 0x7f50d4102880 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c8009c30 con 0x7f50d4102880 2024-08-31T04:25:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.051+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d41a0530 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.052+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c800f620 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.052+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d41a6c90 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.053+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d4103ab0 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.054+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f50c8005030 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.055+0000 7f50d1ffb640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 0x7f50c40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.055+0000 7f50d3fff640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 0x7f50c40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.055+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f50c80e5370 con 0x7f50d4102880 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.055+0000 7f50d3fff640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 0x7f50c40b7090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50c0000c00 tx=0x7f50c0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.058+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f50c80abf60 con 0x7f50d4102880 2024-08-31T04:25:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.253+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f50d410b920 con 0x7f50c40b4b80 2024-08-31T04:25:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.255+0000 7f50d1ffb640 1 -- 172.21.15.2:0/1771453690 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f50d410b920 con 0x7f50c40b4b80 2024-08-31T04:25:11.257 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T04:25:11.257 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T04:25:11.257 INFO:teuthology.orchestra.run.smithi002.stdout:smithi064 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT534400C2400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-31T04:25:11.257 INFO:teuthology.orchestra.run.smithi002.stdout:smithi132 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232000B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 msgr2=0x7f50c40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 0x7f50c40b7090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50c0000c00 tx=0x7f50c0031400 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 msgr2=0x7f50d419a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f50c800d950 tx=0x7f50c800de10 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 shutdown_connections 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50d4108ac0 0x7f50d419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50d4108170 0x7f50d419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f50c40b4b80 0x7f50c40b7090 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 --2- 172.21.15.2:0/1771453690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50d4102880 0x7f50d419a2d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 >> 172.21.15.2:0/1771453690 conn(0x7f50d4079500 msgr2=0x7f50d41018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 shutdown_connections 2024-08-31T04:25:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:11.257+0000 7f50dac84640 1 -- 172.21.15.2:0/1771453690 wait complete. 2024-08-31T04:25:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:10 smithi064 ceph-mon[22007]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:10 smithi064 ceph-mon[22007]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:11.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:10 smithi132 ceph-mon[22335]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:11.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:10 smithi132 ceph-mon[22335]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:11.960 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T04:25:11.971 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:25:11.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T04:25:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 -- 172.21.15.2:0/835662319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4104800 msgr2=0x7f46b4104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 --2- 172.21.15.2:0/835662319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4104800 0x7f46b4104c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f469c009900 tx=0x7f469c02a410 comp rx=0 tx=0).stop 2024-08-31T04:25:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 -- 172.21.15.2:0/835662319 shutdown_connections 2024-08-31T04:25:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 --2- 172.21.15.2:0/835662319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b4110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 --2- 172.21.15.2:0/835662319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4105150 0x7f46b410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 --2- 172.21.15.2:0/835662319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4104800 0x7f46b4104c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 -- 172.21.15.2:0/835662319 >> 172.21.15.2:0/835662319 conn(0x7f46b4079470 msgr2=0x7f46b4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 -- 172.21.15.2:0/835662319 shutdown_connections 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 -- 172.21.15.2:0/835662319 wait complete. 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.714+0000 7f46baa89640 1 Processor -- start 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 -- start start 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4104800 0x7f46b419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113940 con 0x7f46b4105150 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41137c0 con 0x7f46b4104800 2024-08-31T04:25:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46baa89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113ac0 con 0x7f46b410dc60 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45138/0 (socket says 172.21.15.2:45138) 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 -- 172.21.15.2:0/511510023 learned_addr learned my addr 172.21.15.2:0/511510023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b8825640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4104800 0x7f46b419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b9026640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 -- 172.21.15.2:0/511510023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 msgr2=0x7f46b419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 -- 172.21.15.2:0/511510023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4104800 msgr2=0x7f46b419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4104800 0x7f46b419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b3fff640 1 -- 172.21.15.2:0/511510023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41a0290 con 0x7f46b4105150 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.715+0000 7f46b9026640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46b3fff640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a400e9f0 tx=0x7f46a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a400ccc0 con 0x7f46b4105150 2024-08-31T04:25:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a40108e0 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a0580 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4018860 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.716+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a6ce0 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.717+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4104c10 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.719+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f46a4010430 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.719+0000 7f46b1ffb640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 0x7f46a00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.719+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f46a40e5f30 con 0x7f46b4105150 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.719+0000 7f46b8825640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 0x7f46a00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.720+0000 7f46b8825640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 0x7f46a00b7090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f469c031440 tx=0x7f469c009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.723+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f46a40acb20 con 0x7f46b4105150 2024-08-31T04:25:12.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:12 smithi002 ceph-mon[18656]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:12.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:12 smithi002 ceph-mon[18656]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.947+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f46b41a6fd0 con 0x7f46b4105150 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.948+0000 7f46b1ffb640 1 -- 172.21.15.2:0/511510023 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3078 (secure 0 0 0) 0x7f46a40b5060 con 0x7f46b4105150 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-08-31T04:23:42:423062+0000 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:12.949 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-08-31T04:22:57.945132+0000 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-08-31T04:23:42.352718+0000 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-08-31T04:25:12.950 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 3 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24704,1=24671,2=24646} 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3,4] 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-08-31T04:25:12.951 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24704 members: 24646,24671,24704 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24704} state up:active seq 4 addr [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{0:24641} state up:standby-replay seq 1 addr [v2:172.21.15.64:6834/3881208235,v1:172.21.15.64:6835/3881208235] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{1:24671} state up:active seq 17 addr [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{1:24623} state up:standby-replay seq 1 addr [v2:172.21.15.64:6832/3514773724,v1:172.21.15.64:6833/3514773724] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{2:24646} state up:active seq 17 addr [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{2:24622} state up:standby-replay seq 1 addr [v2:172.21.15.132:6836/209815036,v1:172.21.15.132:6837/209815036] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14757} state up:standby seq 1 addr [v2:172.21.15.2:6834/3395319824,v1:172.21.15.2:6835/3395319824] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.952 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14769} state up:standby seq 1 addr [v2:172.21.15.2:6836/1100615699,v1:172.21.15.2:6837/1100615699] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14808} state up:standby seq 1 addr [v2:172.21.15.2:6838/1028238905,v1:172.21.15.2:6839/1028238905] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14820} state up:standby seq 1 addr [v2:172.21.15.2:6840/3442554545,v1:172.21.15.2:6841/3442554545] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24583} state up:standby seq 1 addr [v2:172.21.15.132:6832/4201237499,v1:172.21.15.132:6833/4201237499] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{-1:24616} state up:standby seq 1 addr [v2:172.21.15.132:6834/355644328,v1:172.21.15.132:6835/355644328] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:25:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 msgr2=0x7f46a00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 0x7f46a00b7090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f469c031440 tx=0x7f469c009560 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 msgr2=0x7f46b419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a400e9f0 tx=0x7f46a400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 shutdown_connections 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46a00b4b80 0x7f46a00b7090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b4105150 0x7f46b419a8c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46b410dc60 0x7f46b419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 --2- 172.21.15.2:0/511510023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b4104800 0x7f46b419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 >> 172.21.15.2:0/511510023 conn(0x7f46b4079470 msgr2=0x7f46b4107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 shutdown_connections 2024-08-31T04:25:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:12.950+0000 7f46baa89640 1 -- 172.21.15.2:0/511510023 wait complete. 2024-08-31T04:25:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:12 smithi064 ceph-mon[22007]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:12 smithi064 ceph-mon[22007]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:13.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:12 smithi132 ceph-mon[22335]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:13.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:12 smithi132 ceph-mon[22335]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:13.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T04:25:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:13 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/511510023' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:25:14.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:13 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/511510023' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:25:14.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:13 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/511510023' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:25:14.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.382+0000 7fc4b62e2640 1 -- 172.21.15.2:0/1748189872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 msgr2=0x7fc4b0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:14.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.382+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/1748189872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b0108580 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc498009900 tx=0x7fc49802a410 comp rx=0 tx=0).stop 2024-08-31T04:25:14.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 -- 172.21.15.2:0/1748189872 shutdown_connections 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/1748189872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b0108580 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/1748189872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0108ac0 0x7fc4b010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/1748189872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0102880 0x7fc4b0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 -- 172.21.15.2:0/1748189872 >> 172.21.15.2:0/1748189872 conn(0x7fc4b0079500 msgr2=0x7fc4b0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 -- 172.21.15.2:0/1748189872 shutdown_connections 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 -- 172.21.15.2:0/1748189872 wait complete. 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 Processor -- start 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.383+0000 7fc4b62e2640 1 -- start start 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0102880 0x7fc4b019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0108ac0 0x7fc4b019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01126f0 con 0x7fc4b0108170 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0112570 con 0x7fc4b0108ac0 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b62e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0112870 con 0x7fc4b0102880 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45150/0 (socket says 172.21.15.2:45150) 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 -- 172.21.15.2:0/4250024783 learned_addr learned my addr 172.21.15.2:0/4250024783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4affff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0102880 0x7fc4b019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4b487f640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0108ac0 0x7fc4b019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 -- 172.21.15.2:0/4250024783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0102880 msgr2=0x7fc4b019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0102880 0x7fc4b019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 -- 172.21.15.2:0/4250024783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0108ac0 msgr2=0x7fc4b019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0108ac0 0x7fc4b019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.384+0000 7fc4a7fff640 1 -- 172.21.15.2:0/4250024783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b01a01c0 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4a7fff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc498006010 tx=0x7fc498004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49803f030 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b01a0450 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc498003aa0 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498035070 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.385+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b01a6c10 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.386+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0103ab0 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.389+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fc498042030 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.389+0000 7fc4adffb640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 0x7fc49c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.389+0000 7fc4affff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 0x7fc49c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.389+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc498105f60 con 0x7fc4b0108170 2024-08-31T04:25:14.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.390+0000 7fc4affff640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 0x7fc49c0b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009bd0 tx=0x7fc4a0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:14.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.392+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc4980cc4a0 con 0x7fc4b0108170 2024-08-31T04:25:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.578+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc4b0102c90 con 0x7fc4b0108170 2024-08-31T04:25:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.579+0000 7fc4adffb640 1 -- 172.21.15.2:0/4250024783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+6178 (secure 0 0 0) 0x7fc4980d0c60 con 0x7fc4b0108170 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 85 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-08-31T04:14:46.410110+0000 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-08-31T04:24:34.895861+0000 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 27 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-08-31T04:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 9 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/1178687126,v1:172.21.15.2:6803/1178687126] [v2:172.21.15.2:6804/1178687126,v1:172.21.15.2:6805/1178687126] exists,up 04b1eadc-fc29-4c3a-b5fc-baf84660347b 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 14 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6800/4211233345,v1:172.21.15.64:6801/4211233345] [v2:172.21.15.64:6802/4211233345,v1:172.21.15.64:6803/4211233345] exists,up ddf40256-b4dc-4669-882b-cb08a7b1871c 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 19 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6800/1699390891,v1:172.21.15.132:6801/1699390891] [v2:172.21.15.132:6802/1699390891,v1:172.21.15.132:6803/1699390891] exists,up c67a3487-d5b9-4171-a372-4746ee7828fe 2024-08-31T04:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 25 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/2669191868,v1:172.21.15.2:6811/2669191868] [v2:172.21.15.2:6812/2669191868,v1:172.21.15.2:6813/2669191868] exists,up e216ee69-c75f-4ed4-934c-64e65fac20a9 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 31 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6808/4269153190,v1:172.21.15.64:6809/4269153190] [v2:172.21.15.64:6810/4269153190,v1:172.21.15.64:6811/4269153190] exists,up a5585cc1-f8f8-4c13-bffc-893da439f2ff 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 36 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6808/3694952222,v1:172.21.15.132:6809/3694952222] [v2:172.21.15.132:6810/3694952222,v1:172.21.15.132:6811/3694952222] exists,up 3c826df0-d572-44f2-950f-9c1d60d195e9 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 42 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/2257797183,v1:172.21.15.2:6819/2257797183] [v2:172.21.15.2:6820/2257797183,v1:172.21.15.2:6821/2257797183] exists,up 417ac9aa-e876-4135-be80-ee260fd3d904 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 46 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6816/2487011735,v1:172.21.15.64:6817/2487011735] [v2:172.21.15.64:6818/2487011735,v1:172.21.15.64:6819/2487011735] exists,up 8a85816f-eef9-4786-a3ab-29640863c16d 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 52 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6816/3969222999,v1:172.21.15.132:6817/3969222999] [v2:172.21.15.132:6818/3969222999,v1:172.21.15.132:6819/3969222999] exists,up 62ec99e5-2cff-4ab4-984f-bffffd019944 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 58 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/3837959291,v1:172.21.15.2:6827/3837959291] [v2:172.21.15.2:6828/3837959291,v1:172.21.15.2:6829/3837959291] exists,up 5631cd2a-008f-40a9-b09d-7fa3e05bbddd 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6824/431915757,v1:172.21.15.64:6825/431915757] [v2:172.21.15.64:6826/431915757,v1:172.21.15.64:6827/431915757] exists,up 3f893c6f-12bd-4afc-8b24-c706cd68cb1b 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 69 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6824/655576737,v1:172.21.15.132:6825/655576737] [v2:172.21.15.132:6826/655576737,v1:172.21.15.132:6827/655576737] exists,up c4c97091-28c9-441a-a030-afe7b066620e 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.0 [5,6] 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.3 [10,11] 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.b [2,4] 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.c [2,4] 2024-08-31T04:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.11 [7,11] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1a [8,1] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1b [2,4] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1f [8,1] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.0 [4,8] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.7 [3,9] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.12 [3,9] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1b [4,6] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.21 [4,8,5,9] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.31 [4,6] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.37 [5,7] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.13 [9,10] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.17 [9,8] 2024-08-31T04:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.19 [9,8] 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.1a [5,8] 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3769218802 expires 2024-09-01T04:16:32.968503+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/737748268 expires 2024-09-01T04:15:07.436437+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/676946348 expires 2024-09-01T04:16:32.968503+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3520570143 expires 2024-09-01T04:15:31.947876+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/3950990944 expires 2024-09-01T04:16:32.968503+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/383819124 expires 2024-09-01T04:15:07.436437+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2196385741 expires 2024-09-01T04:15:07.436437+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1227945442 expires 2024-09-01T04:15:07.436437+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/737748268 expires 2024-09-01T04:15:07.436437+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/967619453 expires 2024-09-01T04:15:31.947876+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3454213639 expires 2024-09-01T04:15:31.947876+0000 2024-08-31T04:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2617567314 expires 2024-09-01T04:15:31.947876+0000 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/967619453 expires 2024-09-01T04:15:31.947876+0000 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/3950990944 expires 2024-09-01T04:16:32.968503+0000 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2564901012 expires 2024-09-01T04:16:32.968503+0000 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 msgr2=0x7fc49c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 0x7fc49c0b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009bd0 tx=0x7fc4a0005f90 comp rx=0 tx=0).stop 2024-08-31T04:25:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 msgr2=0x7fc4b019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc498006010 tx=0x7fc498004060 comp rx=0 tx=0).stop 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 shutdown_connections 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc49c0b4b80 0x7fc49c0b7090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4b0108170 0x7fc4b019a7f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b0108ac0 0x7fc4b019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 --2- 172.21.15.2:0/4250024783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4b0102880 0x7fc4b019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.581+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 >> 172.21.15.2:0/4250024783 conn(0x7fc4b0079500 msgr2=0x7fc4b006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.582+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 shutdown_connections 2024-08-31T04:25:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:14.582+0000 7fc4b62e2640 1 -- 172.21.15.2:0/4250024783 wait complete. 2024-08-31T04:25:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:14 smithi002 ceph-mon[18656]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:14 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4250024783' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:25:15.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:14 smithi132 ceph-mon[22335]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:15.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:14 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4250024783' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:25:15.287 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T04:25:15.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:25:15.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:14 smithi064 ceph-mon[22007]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T04:25:15.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:14 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4250024783' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:25:15.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 -- 172.21.15.2:0/3448145959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0102800 msgr2=0x7ff5b0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/3448145959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0102800 0x7ff5b0102c10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009900 tx=0x7ff5a402a410 comp rx=0 tx=0).stop 2024-08-31T04:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 -- 172.21.15.2:0/3448145959 shutdown_connections 2024-08-31T04:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/3448145959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0108a90 0x7ff5b010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/3448145959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/3448145959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0102800 0x7ff5b0102c10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.057+0000 7ff5b6c26640 1 -- 172.21.15.2:0/3448145959 >> 172.21.15.2:0/3448145959 conn(0x7ff5b00794d0 msgr2=0x7ff5b00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.058+0000 7ff5b6c26640 1 -- 172.21.15.2:0/3448145959 shutdown_connections 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.058+0000 7ff5b6c26640 1 -- 172.21.15.2:0/3448145959 wait complete. 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 Processor -- start 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 -- start start 2024-08-31T04:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0102800 0x7ff5b0103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0112710 con 0x7ff5b0108a90 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0112590 con 0x7ff5b0102800 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b6c26640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0112890 con 0x7ff5b0108140 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b51c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b51c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34496/0 (socket says 172.21.15.2:34496) 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b51c3640 1 -- 172.21.15.2:0/2129481301 learned_addr learned my addr 172.21.15.2:0/2129481301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5b49c2640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0102800 0x7ff5b0103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.059+0000 7ff5affff640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 -- 172.21.15.2:0/2129481301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 msgr2=0x7ff5b0104530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0104530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 -- 172.21.15.2:0/2129481301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0102800 msgr2=0x7ff5b0103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0102800 0x7ff5b0103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 -- 172.21.15.2:0/2129481301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b01a84d0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5affff640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b51c3640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800eaa0 tx=0x7ff5a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800cdb0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5a8005020 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b01a87c0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80116d0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.060+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b01a8cb0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.061+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b0102c10 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.062+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7ff5a80051d0 con 0x7ff5b0108a90 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.063+0000 7ff5adffb640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 0x7ff5a00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.063+0000 7ff5b49c2640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 0x7ff5a00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.063+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff5a80e5950 con 0x7ff5b0108a90 2024-08-31T04:25:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.064+0000 7ff5b49c2640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 0x7ff5a00b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.068+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff5a8016030 con 0x7ff5b0108a90 2024-08-31T04:25:16.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.291+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5b01a90d0 con 0x7ff5b0108a90 2024-08-31T04:25:16.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.292+0000 7ff5adffb640 1 -- 172.21.15.2:0/2129481301 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7ff5a80ac4e0 con 0x7ff5b0108a90 2024-08-31T04:25:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:25:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 msgr2=0x7ff5a00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 0x7ff5a00b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a4031400 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 msgr2=0x7ff5b0104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800eaa0 tx=0x7ff5a800ef60 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 shutdown_connections 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff5a00b4b80 0x7ff5a00b7090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5b0108a90 0x7ff5b0104a70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b0108140 0x7ff5b0104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 --2- 172.21.15.2:0/2129481301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b0102800 0x7ff5b0103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 >> 172.21.15.2:0/2129481301 conn(0x7ff5b00794d0 msgr2=0x7ff5b0101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:16.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 shutdown_connections 2024-08-31T04:25:16.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:16.294+0000 7ff5b6c26640 1 -- 172.21.15.2:0/2129481301 wait complete. 2024-08-31T04:25:16.907 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:16 smithi002 ceph-mon[18656]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:16.907 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:16 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2129481301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:16.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:25:17.193 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:16 smithi064 ceph-mon[22007]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:16 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2129481301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:17.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:16 smithi132 ceph-mon[22335]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T04:25:17.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:16 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2129481301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 -- 172.21.15.2:0/2873149433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 msgr2=0x7ff098108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/2873149433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff098108580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff088009900 tx=0x7ff08802a410 comp rx=0 tx=0).stop 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 -- 172.21.15.2:0/2873149433 shutdown_connections 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/2873149433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff098108580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/2873149433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 0x7ff09810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/2873149433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 0x7ff098102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 -- 172.21.15.2:0/2873149433 >> 172.21.15.2:0/2873149433 conn(0x7ff098079500 msgr2=0x7ff098079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 -- 172.21.15.2:0/2873149433 shutdown_connections 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.727+0000 7ff0a04ea640 1 -- 172.21.15.2:0/2873149433 wait complete. 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 Processor -- start 2024-08-31T04:25:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 -- start start 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 0x7ff09819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 0x7ff09819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff098112770 con 0x7ff098108170 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981125f0 con 0x7ff098108ac0 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff0a04ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0981128f0 con 0x7ff098102880 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34518/0 (socket says 172.21.15.2:34518) 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 -- 172.21.15.2:0/1652759404 learned_addr learned my addr 172.21.15.2:0/1652759404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09ea87640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 0x7ff09819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09e286640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 0x7ff09819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 -- 172.21.15.2:0/1652759404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 msgr2=0x7ff09819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 0x7ff09819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 -- 172.21.15.2:0/1652759404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 msgr2=0x7ff09819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 0x7ff09819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.728+0000 7ff09da85640 1 -- 172.21.15.2:0/1652759404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981a0120 con 0x7ff098108170 2024-08-31T04:25:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff09da85640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff088031a90 tx=0x7ff088004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08803f030 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0981a03b0 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff088003cb0 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088035070 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.729+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a6c30 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.730+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff098103ab0 con 0x7ff098108170 2024-08-31T04:25:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.731+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7ff088042030 con 0x7ff098108170 2024-08-31T04:25:17.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.732+0000 7ff08f7fe640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 0x7ff0840b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.733+0000 7ff09e286640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 0x7ff0840b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.733+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff088106150 con 0x7ff098108170 2024-08-31T04:25:17.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.733+0000 7ff09e286640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 0x7ff0840b70c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff094009890 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:17.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.736+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0880ccce0 con 0x7ff098108170 2024-08-31T04:25:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.958+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff09819b3a0 con 0x7ff098108170 2024-08-31T04:25:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.959+0000 7ff08f7fe640 1 -- 172.21.15.2:0/1652759404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7ff09819b3a0 con 0x7ff098108170 2024-08-31T04:25:17.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:17.961 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-08-31T04:23:42:423062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:23:42.352718+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:25:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 msgr2=0x7ff0840b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 0x7ff0840b70c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff094009890 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 msgr2=0x7ff09819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff088031a90 tx=0x7ff088004270 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 shutdown_connections 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0840b4bb0 0x7ff0840b70c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff098108170 0x7ff09819a810 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff098108ac0 0x7ff09819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 --2- 172.21.15.2:0/1652759404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff098102880 0x7ff09819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 >> 172.21.15.2:0/1652759404 conn(0x7ff098079500 msgr2=0x7ff098101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 shutdown_connections 2024-08-31T04:25:17.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:17.961+0000 7ff0a04ea640 1 -- 172.21.15.2:0/1652759404 wait complete. 2024-08-31T04:25:18.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:25:18.822 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:19.139 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:18 smithi064 ceph-mon[22007]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:19.139 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:18 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1652759404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:18 smithi002 ceph-mon[18656]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:18 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1652759404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 -- 172.21.15.2:0/988288109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc201058d0 msgr2=0x7efc2010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 --2- 172.21.15.2:0/988288109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc201058d0 0x7efc2010f320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ca0 tx=0x7efc1802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 -- 172.21.15.2:0/988288109 shutdown_connections 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 --2- 172.21.15.2:0/988288109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc201058d0 0x7efc2010f320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 --2- 172.21.15.2:0/988288109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc20104f80 0x7efc20105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 --2- 172.21.15.2:0/988288109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20102fb0 0x7efc201033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 -- 172.21.15.2:0/988288109 >> 172.21.15.2:0/988288109 conn(0x7efc20079d30 msgr2=0x7efc2007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 -- 172.21.15.2:0/988288109 shutdown_connections 2024-08-31T04:25:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.294+0000 7efc27f09640 1 -- 172.21.15.2:0/988288109 wait complete. 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 Processor -- start 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 -- start start 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20104f80 0x7efc2019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 0x7efc2019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc20112780 con 0x7efc20102fb0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc20112600 con 0x7efc201058d0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc27f09640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efc20112900 con 0x7efc20104f80 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc25ca5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc25ca5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34522/0 (socket says 172.21.15.2:34522) 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc25ca5640 1 -- 172.21.15.2:0/573077059 learned_addr learned my addr 172.21.15.2:0/573077059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc264a6640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 0x7efc2019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.295+0000 7efc254a4640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20104f80 0x7efc2019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 -- 172.21.15.2:0/573077059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20104f80 msgr2=0x7efc2019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20104f80 0x7efc2019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 -- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 msgr2=0x7efc2019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 -- 172.21.15.2:0/573077059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc201a01d0 con 0x7efc201058d0 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc25ca5640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc264a6640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 0x7efc2019faa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc1802ade0 tx=0x7efc180316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18003b70 con 0x7efc201058d0 2024-08-31T04:25:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201a0460 con 0x7efc201058d0 2024-08-31T04:25:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc18003d10 con 0x7efc201058d0 2024-08-31T04:25:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1802f9e0 con 0x7efc201058d0 2024-08-31T04:25:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.296+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a6c20 con 0x7efc201058d0 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.297+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc201033c0 con 0x7efc201058d0 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.299+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7efc18004b40 con 0x7efc201058d0 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.299+0000 7efc16ffd640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 0x7efc0c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.300+0000 7efc25ca5640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 0x7efc0c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.300+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7efc18106910 con 0x7efc201058d0 2024-08-31T04:25:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.300+0000 7efc25ca5640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 0x7efc0c0b7090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0058c0 tx=0x7efc1c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.303+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efc180cd500 con 0x7efc201058d0 2024-08-31T04:25:19.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:18 smithi132 ceph-mon[22335]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:25:19.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:18 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1652759404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.510+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc2019b390 con 0x7efc201058d0 2024-08-31T04:25:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.512+0000 7efc16ffd640 1 -- 172.21.15.2:0/573077059 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25348 (secure 0 0 0) 0x7efc2019b390 con 0x7efc201058d0 2024-08-31T04:25:19.514 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:19.514 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:24:34.895861+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 msgr2=0x7efc0c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 0x7efc0c0b7090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0058c0 tx=0x7efc1c005f90 comp rx=0 tx=0).stop 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 msgr2=0x7efc2019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 0x7efc2019faa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc1802ade0 tx=0x7efc180316f0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 shutdown_connections 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc201058d0 0x7efc2019faa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc20104f80 0x7efc2019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc0c0b4b80 0x7efc0c0b7090 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 --2- 172.21.15.2:0/573077059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc20102fb0 0x7efc2019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 >> 172.21.15.2:0/573077059 conn(0x7efc20079d30 msgr2=0x7efc201062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.514+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 shutdown_connections 2024-08-31T04:25:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:19.515+0000 7efc27f09640 1 -- 172.21.15.2:0/573077059 wait complete. 2024-08-31T04:25:20.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:19 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/573077059' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:20.232 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T04:22:57.945132+0000', 'modified': '2024-08-31T04:23:42.352718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24704, 'mds_1': 24671, 'mds_2': 24646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24622': {'gid': 24622, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.132:6837/209815036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 209815036}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 209815036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6833/3514773724', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 3514773724}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 3514773724}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/3881208235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3881208235}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3881208235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.132:6839/1468403629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6838', 'nonce': 1468403629}, {'type': 'v1', 'addr': '172.21.15.132:6839', 'nonce': 1468403629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24671': {'gid': 24671, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.64:6837/2463382536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 2463382536}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 2463382536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6839/574572481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 574572481}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 574572481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24646, 24671, 24704]} 2024-08-31T04:25:20.232 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T04:25:20.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T04:25:20.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:19 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/573077059' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:20.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:19 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/573077059' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:20.487 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 -- 172.21.15.2:0/3288381614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c4108b40 msgr2=0x7f35c410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/3288381614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c4108b40 0x7f35c410f370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009ca0 tx=0x7f35bc02a8e0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 -- 172.21.15.2:0/3288381614 shutdown_connections 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/3288381614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c4108b40 0x7f35c410f370 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/3288381614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41081f0 0x7f35c4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/3288381614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c41028b0 0x7f35c4102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 -- 172.21.15.2:0/3288381614 >> 172.21.15.2:0/3288381614 conn(0x7f35c4079470 msgr2=0x7f35c4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 -- 172.21.15.2:0/3288381614 shutdown_connections 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.981+0000 7f35cbaf7640 1 -- 172.21.15.2:0/3288381614 wait complete. 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 Processor -- start 2024-08-31T04:25:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 -- start start 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41028b0 0x7f35c40ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c4108b40 0x7f35c40ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4112840 con 0x7f35c41081f0 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41126c0 con 0x7f35c4108b40 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35cbaf7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41129c0 con 0x7f35c41028b0 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35c9092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35c9092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34528/0 (socket says 172.21.15.2:34528) 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35c9092640 1 -- 172.21.15.2:0/1315577602 learned_addr learned my addr 172.21.15.2:0/1315577602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35ca094640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c4108b40 0x7f35c40ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.982+0000 7f35c9893640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41028b0 0x7f35c40ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 -- 172.21.15.2:0/1315577602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41028b0 msgr2=0x7f35c40ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41028b0 0x7f35c40ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 -- 172.21.15.2:0/1315577602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c4108b40 msgr2=0x7f35c40ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c4108b40 0x7f35c40ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 -- 172.21.15.2:0/1315577602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c41a8580 con 0x7f35c41081f0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35c9092640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006fd0 tx=0x7f35b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35baffd640 1 -- 172.21.15.2:0/1315577602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011830 con 0x7f35c41081f0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35baffd640 1 -- 172.21.15.2:0/1315577602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35b4016070 con 0x7f35c41081f0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c41a8870 con 0x7f35c41081f0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35baffd640 1 -- 172.21.15.2:0/1315577602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4010e00 con 0x7f35c41081f0 2024-08-31T04:25:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.983+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c41a8d60 con 0x7f35c41081f0 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 Processor -- start 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 -- start start 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35baffd640 1 -- 172.21.15.2:0/1315577602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f35b401b480 con 0x7f35c41081f0 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 0x5561eab72cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab73230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561eaae93f0 con 0x5561ea7ccf60 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5561eaad8980 con 0x5561ea7a40a0 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35d206c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5561eaadc930 con 0x5561ea7ac280 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35ca094640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35ca094640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34544/0 (socket says 172.21.15.2:34544) 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.986+0000 7f35ca094640 1 -- 172.21.15.2:0/1071133197 learned_addr learned my addr 172.21.15.2:0/1071133197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35c9092640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab73230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35c9893640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 0x5561eab72cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 -- 172.21.15.2:0/1071133197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 msgr2=0x5561eab73230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab73230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 -- 172.21.15.2:0/1071133197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 msgr2=0x5561eab72cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 0x5561eab72cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 -- 172.21.15.2:0/1071133197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ea838540 con 0x5561ea7ccf60 2024-08-31T04:25:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35c9893640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 0x5561eab72cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35baffd640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 0x7f35b00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35ca094640 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f35bc031620 tx=0x7f35bc031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660f0569b01e3ded server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35c9893640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 0x7f35b00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35affff640 1 -- 172.21.15.2:0/1071133197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc031ad0 con 0x5561ea7ccf60 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35affff640 1 -- 172.21.15.2:0/1071133197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35bc036030 con 0x5561ea7ccf60 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35baffd640 1 -- 172.21.15.2:0/1315577602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f35b40e4bf0 con 0x7f35c41081f0 2024-08-31T04:25:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.987+0000 7f35affff640 1 -- 172.21.15.2:0/1071133197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004660 con 0x5561ea7ccf60 2024-08-31T04:25:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 -- 172.21.15.2:0/1071133197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 msgr2=0x5561eab727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35c9893640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 0x7f35b00b7090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5561eab71430 tx=0x7f35c000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f35bc031620 tx=0x7f35bc031650 comp rx=0 tx=0).stop 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 -- 172.21.15.2:0/1071133197 shutdown_connections 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab73230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7a40a0 0x5561eab72cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 --2- 172.21.15.2:0/1071133197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7ccf60 0x5561eab727b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.988+0000 7f35d206c740 1 -- 172.21.15.2:0/1071133197 >> 172.21.15.2:0/1071133197 conn(0x5561ea7c1350 msgr2=0x5561eab706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.989+0000 7f35d206c740 1 -- 172.21.15.2:0/1071133197 shutdown_connections 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.989+0000 7f35d206c740 1 -- 172.21.15.2:0/1071133197 wait complete. 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.989+0000 7f35d206c740 1 -- start start 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.989+0000 7f35d206c740 1 Processor -- start 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.989+0000 7f35d206c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab7e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ccf60 0x5561eab8a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561ea93b5f0 con 0x5561ea7a40a0 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5561eaa5f600 con 0x5561ea7ccf60 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5561eab80f30 con 0x5561ea7ac280 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 10 client.0 _ll_register_callbacks cb 0x5561eaa85af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34560/0 (socket says 172.21.15.2:34560) 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 -- 172.21.15.2:0/2504320338 learned_addr learned my addr 172.21.15.2:0/2504320338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9092640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab7e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35ca094640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ccf60 0x5561eab8a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 -- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 msgr2=0x5561eab7e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab7e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 -- 172.21.15.2:0/2504320338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ccf60 msgr2=0x5561eab8a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ccf60 0x5561eab8a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 -- 172.21.15.2:0/2504320338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561eaa987b0 con 0x5561ea7a40a0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35c9893640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35c0010e10 tx=0x7f35c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989df914f4222729 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c000fd50 con 0x5561ea7a40a0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f35c0004020 con 0x5561ea7a40a0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.990+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35bc036030 con 0x5561ea7a40a0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f35c002f050 con 0x5561ea7a40a0 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 10 client.15420 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5561eab8cc40 con 0x5561ea7a40a0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35bc036030 con 0x5561ea7a40a0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f35c0027400 con 0x5561ea7a40a0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 10 client.15420 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 20 client.15420 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea78b8e0 0x5561eab90770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 4 client.15420 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561eaaeb340 con 0x5561ea78b8e0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.991+0000 7f35c9092640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea78b8e0 0x5561eab90770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.992+0000 7f35c9092640 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea78b8e0 0x5561eab90770 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae695ec1d5f56a2c server_cookie=93d4b49913e8e268 in_seq=0 out_seq=0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.992+0000 7f35ad7fa640 10 client.15420 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35ad7fa640 1 -- 172.21.15.2:0/2504320338 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561eaaeb340 con 0x5561ea78b8e0 2024-08-31T04:25:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35ad7fa640 10 client.15420 handle_command_reply: tid=0 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 client.15420 shutdown 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 msgr2=0x5561eab7de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35c0010e10 tx=0x7f35c00046c0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 shutdown_connections 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea78b8e0 0x5561eab90770 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ccf60 0x5561eab8a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7ac280 0x5561eab7e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35ad7fa640 0 client.15420 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 --2- 172.21.15.2:0/2504320338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab7de70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 >> 172.21.15.2:0/2504320338 conn(0x5561ea7c1350 msgr2=0x5561eab75990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 shutdown_connections 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 1 -- 172.21.15.2:0/2504320338 wait complete. 2024-08-31T04:25:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:20.993+0000 7f35d206c740 20 client.15420 trim_cache size 0 max 16384 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 Processor -- start 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 -- start start 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 0x5561eab6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561eab8eab0 con 0x5561ea78b8e0 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5561eab8f180 con 0x5561ea7ac280 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.011+0000 7f35d206c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5561eab8f850 con 0x5561ea7a40a0 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34574/0 (socket says 172.21.15.2:34574) 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 -- 172.21.15.2:0/3451539985 learned_addr learned my addr 172.21.15.2:0/3451539985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9092640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 0x5561eab6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35ca094640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 -- 172.21.15.2:0/3451539985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 msgr2=0x5561eab6fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 0x5561eab6fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 -- 172.21.15.2:0/3451539985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 msgr2=0x5561eab70230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab70230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 -- 172.21.15.2:0/3451539985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561eab74d70 con 0x5561ea78b8e0 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9092640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 0x5561eab6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35ca094640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab70230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35c9893640 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35c0027820 tx=0x7f35c0012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78732dd9c1fcc27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35af7fe640 1 -- 172.21.15.2:0/3451539985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0027a90 con 0x5561ea78b8e0 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35af7fe640 1 -- 172.21.15.2:0/3451539985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35c0027c30 con 0x5561ea78b8e0 2024-08-31T04:25:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.012+0000 7f35af7fe640 1 -- 172.21.15.2:0/3451539985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c003baf0 con 0x5561ea78b8e0 2024-08-31T04:25:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- 172.21.15.2:0/3451539985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 msgr2=0x5561eab8a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35c0027820 tx=0x7f35c0012f90 comp rx=0 tx=0).stop 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- 172.21.15.2:0/3451539985 shutdown_connections 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab70230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea7a40a0 0x5561eab6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 --2- 172.21.15.2:0/3451539985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea78b8e0 0x5561eab8a190 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- 172.21.15.2:0/3451539985 >> 172.21.15.2:0/3451539985 conn(0x5561ea7c1350 msgr2=0x5561eab78fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- 172.21.15.2:0/3451539985 shutdown_connections 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- 172.21.15.2:0/3451539985 wait complete. 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.013+0000 7f35d206c740 1 -- start start 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 Processor -- start 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea78b8e0 0x5561eab92bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561eab905f0 con 0x5561ea7a40a0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5561eab8ff20 con 0x5561ea7ac280 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5561eab90cc0 con 0x5561ea78b8e0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35d206c740 10 client.0 _ll_register_callbacks cb 0x7f35c0010ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34578/0 (socket says 172.21.15.2:34578) 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 -- 172.21.15.2:0/359378539 learned_addr learned my addr 172.21.15.2:0/359378539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9893640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea78b8e0 0x5561eab92bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35ca094640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 -- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea78b8e0 msgr2=0x5561eab92bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea78b8e0 0x5561eab92bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 -- 172.21.15.2:0/359378539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 msgr2=0x5561eab93670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab93670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.014+0000 7f35c9092640 1 -- 172.21.15.2:0/359378539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561eab984e0 con 0x5561ea7a40a0 2024-08-31T04:25:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35c9092640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35b40aade0 tx=0x7f35b40e86d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8265e03ed3351edd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b40aabf0 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f35b4010410 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35c0027c30 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f35b40ab7e0 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5561eabfbfe0 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35c0027c30 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f35b40d1020 con 0x5561ea7a40a0 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 20 client.15426 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea7ccf60 0x5561eabff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 4 client.15426 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.015+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "status"}) -- 0x5561eaae6de0 con 0x5561ea7ccf60 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.016+0000 7f35c9893640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea7ccf60 0x5561eabff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.016+0000 7f35ad7fa640 10 client.15426 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.016+0000 7f35c9893640 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea7ccf60 0x5561eabff8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c70148812e7c54e8 server_cookie=f43967d1f8bc455a in_seq=0 out_seq=0 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35ad7fa640 1 -- 172.21.15.2:0/359378539 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5561eaae6de0 con 0x5561ea7ccf60 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35ad7fa640 10 client.15426 handle_command_reply: tid=0 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 client.15426 shutdown 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 msgr2=0x5561eab93130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35b40aade0 tx=0x7f35b40e86d0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 shutdown_connections 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5561ea7ccf60 0x5561eabff8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561ea7a40a0 0x5561eab93130 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5561ea7ac280 0x5561eab93670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 --2- 172.21.15.2:0/359378539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5561ea78b8e0 0x5561eab92bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35ad7fa640 0 client.15426 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 >> 172.21.15.2:0/359378539 conn(0x5561ea7c1350 msgr2=0x5561eab737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 shutdown_connections 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 1 -- 172.21.15.2:0/359378539 wait complete. 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.017+0000 7f35d206c740 20 client.15426 trim_cache size 0 max 16384 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24646, 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:25:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 101.60209900700001, 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 162.30447939000001 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:21.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 msgr2=0x7f35b00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 0x7f35b00b7090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5561eab71430 tx=0x7f35c000a2d0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 msgr2=0x7f35c40ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006fd0 tx=0x7f35b400b8e0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 shutdown_connections 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35b00b4b80 0x7f35b00b7090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c41081f0 0x7f35c40ff970 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35c4108b40 0x7f35c40ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 --2- 172.21.15.2:0/1315577602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c41028b0 0x7f35c40ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 >> 172.21.15.2:0/1315577602 conn(0x7f35c4079470 msgr2=0x7f35c4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 shutdown_connections 2024-08-31T04:25:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:21.018+0000 7f35cbaf7640 1 -- 172.21.15.2:0/1315577602 wait complete. 2024-08-31T04:25:21.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:20 smithi002 ceph-mon[18656]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:20 smithi064 ceph-mon[22007]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:21.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:20 smithi132 ceph-mon[22335]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:21.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T04:25:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 -- 172.21.15.2:0/3904014093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 msgr2=0x7fb1341100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 --2- 172.21.15.2:0/3904014093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb1341100e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009ca0 tx=0x7fb12c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 -- 172.21.15.2:0/3904014093 shutdown_connections 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 --2- 172.21.15.2:0/3904014093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb1341100e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 --2- 172.21.15.2:0/3904014093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1341050e0 0x7fb13410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.648+0000 7fb13af78640 1 --2- 172.21.15.2:0/3904014093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb134104790 0x7fb134104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.649+0000 7fb13af78640 1 -- 172.21.15.2:0/3904014093 >> 172.21.15.2:0/3904014093 conn(0x7fb1340794f0 msgr2=0x7fb134079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.649+0000 7fb13af78640 1 -- 172.21.15.2:0/3904014093 shutdown_connections 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.649+0000 7fb13af78640 1 -- 172.21.15.2:0/3904014093 wait complete. 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.649+0000 7fb13af78640 1 Processor -- start 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.649+0000 7fb13af78640 1 -- start start 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb134104790 0x7fb13419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1341050e0 0x7fb13419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb134113850 con 0x7fb13410dbf0 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341136d0 con 0x7fb134104790 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341139d0 con 0x7fb1341050e0 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34596/0 (socket says 172.21.15.2:34596) 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 -- 172.21.15.2:0/2804566744 learned_addr learned my addr 172.21.15.2:0/2804566744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb138d14640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb134104790 0x7fb13419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb133fff640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1341050e0 0x7fb13419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 -- 172.21.15.2:0/2804566744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1341050e0 msgr2=0x7fb13419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1341050e0 0x7fb13419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 -- 172.21.15.2:0/2804566744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb134104790 msgr2=0x7fb13419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb134104790 0x7fb13419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 -- 172.21.15.2:0/2804566744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1341a0090 con 0x7fb13410dbf0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb139515640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb12c005cc0 tx=0x7fb12c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb131ffb640 1 -- 172.21.15.2:0/2804566744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c003bf0 con 0x7fb13410dbf0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb131ffb640 1 -- 172.21.15.2:0/2804566744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb12c003d90 con 0x7fb13410dbf0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.650+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1341a0320 con 0x7fb13410dbf0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.651+0000 7fb131ffb640 1 -- 172.21.15.2:0/2804566744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c02fb20 con 0x7fb13410dbf0 2024-08-31T04:25:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.651+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1341a6ba0 con 0x7fb13410dbf0 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.653+0000 7fb1414ed740 1 Processor -- start 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.653+0000 7fb131ffb640 1 -- 172.21.15.2:0/2804566744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fb12c004580 con 0x7fb13410dbf0 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.653+0000 7fb1414ed740 1 -- start start 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e385457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e38546230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e384bc3f0 con 0x558e381770a0 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558e384ab980 con 0x558e3819ff60 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb1414ed740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558e384af930 con 0x558e3817f280 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34610/0 (socket says 172.21.15.2:34610) 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 -- 172.21.15.2:0/2768144735 learned_addr learned my addr 172.21.15.2:0/2768144735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb133fff640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e385457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb131ffb640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 0x7fb1240b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb133fff640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e38546230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 -- 172.21.15.2:0/2768144735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 msgr2=0x558e38546230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e38546230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 -- 172.21.15.2:0/2768144735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 msgr2=0x558e385457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e385457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 -- 172.21.15.2:0/2768144735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3820b540 con 0x558e381770a0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb133fff640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e38546230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb139515640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 0x7fb1240b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb131ffb640 1 -- 172.21.15.2:0/2804566744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb12c106930 con 0x7fb13410dbf0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.654+0000 7fb138d14640 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb12800ad00 tx=0x7fb12800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12272e93cc29870e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.655+0000 7fb11effd640 1 -- 172.21.15.2:0/2768144735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12801d070 con 0x558e381770a0 2024-08-31T04:25:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.655+0000 7fb11effd640 1 -- 172.21.15.2:0/2768144735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb128018af0 con 0x558e381770a0 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.655+0000 7fb11effd640 1 -- 172.21.15.2:0/2768144735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128010ae0 con 0x558e381770a0 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- 172.21.15.2:0/2768144735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 msgr2=0x558e38545cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb139515640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 0x7fb1240b7140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ccb20 tx=0x7fb12c096fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb12800ad00 tx=0x7fb12800f790 comp rx=0 tx=0).stop 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- 172.21.15.2:0/2768144735 shutdown_connections 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38545cf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e38546230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2768144735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e385457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- 172.21.15.2:0/2768144735 >> 172.21.15.2:0/2768144735 conn(0x558e38194350 msgr2=0x558e385436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- 172.21.15.2:0/2768144735 shutdown_connections 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- 172.21.15.2:0/2768144735 wait complete. 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 -- start start 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.656+0000 7fb1414ed740 1 Processor -- start 2024-08-31T04:25:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e381770a0 0x558e38550e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e3855d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e3830e5f0 con 0x558e3817f280 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558e38432600 con 0x558e3819ff60 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558e38553f90 con 0x558e381770a0 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb1414ed740 10 client.0 _ll_register_callbacks cb 0x558e38458af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34626/0 (socket says 172.21.15.2:34626) 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 -- 172.21.15.2:0/2277409272 learned_addr learned my addr 172.21.15.2:0/2277409272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb133fff640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e381770a0 0x558e38550e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb133fff640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e3855d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 -- 172.21.15.2:0/2277409272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e381770a0 msgr2=0x558e38550e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e381770a0 0x558e38550e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 -- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 msgr2=0x558e3855d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e3855d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 -- 172.21.15.2:0/2277409272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3846b7b0 con 0x558e3817f280 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb133fff640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e3855d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb138d14640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb128010660 tx=0x7fb128018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bb640ccc60084d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb113fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.657+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128026020 con 0x558e3817f280 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb128018af0 con 0x558e3817f280 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb128005240 con 0x558e3817f280 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb128031050 con 0x558e3817f280 2024-08-31T04:25:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e3855fbe0 con 0x558e3817f280 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb128018af0 con 0x558e3817f280 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb128004750 con 0x558e3817f280 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 10 client.15438 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 20 client.15438 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e3815e8e0 0x558e38563290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 4 client.15438 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.658+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e384be340 con 0x558e3815e8e0 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.659+0000 7fb133fff640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e3815e8e0 0x558e38563290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.659+0000 7fb113fff640 10 client.15438 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.659+0000 7fb133fff640 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e3815e8e0 0x558e38563290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ccb6e69ec4f8e6c server_cookie=ba89cc3bef5a89e0 in_seq=0 out_seq=0 2024-08-31T04:25:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb113fff640 1 -- 172.21.15.2:0/2277409272 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e384be340 con 0x558e3815e8e0 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb113fff640 10 client.15438 handle_command_reply: tid=0 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 client.15438 shutdown 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 msgr2=0x558e385513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb128010660 tx=0x7fb128018670 comp rx=0 tx=0).stop 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 shutdown_connections 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e3815e8e0 0x558e38563290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3817f280 0x558e385513a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3819ff60 0x558e3855d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2277409272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e381770a0 0x558e38550e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 >> 172.21.15.2:0/2277409272 conn(0x558e38194350 msgr2=0x558e38548940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb113fff640 0 client.15438 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.660+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 shutdown_connections 2024-08-31T04:25:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.661+0000 7fb1414ed740 1 -- 172.21.15.2:0/2277409272 wait complete. 2024-08-31T04:25:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.661+0000 7fb1414ed740 20 client.15438 trim_cache size 0 max 16384 2024-08-31T04:25:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 Processor -- start 2024-08-31T04:25:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 -- start start 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e381770a0 0x558e38563290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e3854c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e385615d0 con 0x558e3819ff60 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558e38561ca0 con 0x558e381770a0 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb1414ed740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558e38562370 con 0x558e3817f280 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb133fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb133fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34640/0 (socket says 172.21.15.2:34640) 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.679+0000 7fb133fff640 1 -- 172.21.15.2:0/2810607086 learned_addr learned my addr 172.21.15.2:0/2810607086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e381770a0 0x558e38563290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb138d14640 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e3854c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 -- 172.21.15.2:0/2810607086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 msgr2=0x558e3854c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e3854c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 -- 172.21.15.2:0/2810607086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e381770a0 msgr2=0x558e38563290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e381770a0 0x558e38563290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 -- 172.21.15.2:0/2810607086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3853eeb0 con 0x558e3819ff60 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb133fff640 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb120000c00 tx=0x7fb12000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cfb4a8d77e74f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb11e7fc640 1 -- 172.21.15.2:0/2810607086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12002b070 con 0x558e3819ff60 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb11e7fc640 1 -- 172.21.15.2:0/2810607086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb12001fd20 con 0x558e3819ff60 2024-08-31T04:25:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.680+0000 7fb11e7fc640 1 -- 172.21.15.2:0/2810607086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120003a50 con 0x558e3819ff60 2024-08-31T04:25:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- 172.21.15.2:0/2810607086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 msgr2=0x558e3855d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb120000c00 tx=0x7fb12000b390 comp rx=0 tx=0).stop 2024-08-31T04:25:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- 172.21.15.2:0/2810607086 shutdown_connections 2024-08-31T04:25:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e3819ff60 0x558e3855d220 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3817f280 0x558e3854c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 --2- 172.21.15.2:0/2810607086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e381770a0 0x558e38563290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- 172.21.15.2:0/2810607086 >> 172.21.15.2:0/2810607086 conn(0x558e38194350 msgr2=0x558e3853e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- 172.21.15.2:0/2810607086 shutdown_connections 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- 172.21.15.2:0/2810607086 wait complete. 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 -- start start 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.681+0000 7fb1414ed740 1 Processor -- start 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3817f280 0x558e385667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3819ff60 0x558e3856a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e38563110 con 0x558e381770a0 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558e38562a40 con 0x558e3817f280 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558e385637e0 con 0x558e3819ff60 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb1414ed740 10 client.0 _ll_register_callbacks cb 0x7fb12800a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34646/0 (socket says 172.21.15.2:34646) 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 -- 172.21.15.2:0/1434043528 learned_addr learned my addr 172.21.15.2:0/1434043528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb138d14640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3817f280 0x558e385667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 -- 172.21.15.2:0/1434043528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3819ff60 msgr2=0x558e3856a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3819ff60 0x558e3856a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 -- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3817f280 msgr2=0x558e385667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3817f280 0x558e385667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.682+0000 7fb133fff640 1 -- 172.21.15.2:0/1434043528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3856a8e0 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb133fff640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb1200134f0 tx=0x7fb120013520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1efef95d6f81922 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120034020 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb120005040 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb12001fd20 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb12002b070 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb1414ed740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e3856bca0 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb12001fd20 con 0x558e381770a0 2024-08-31T04:25:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb120023050 con 0x558e381770a0 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb1414ed740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.683+0000 7fb1414ed740 10 client.15444 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb1414ed740 20 client.15444 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e38133c90 0x558e385d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb1414ed740 4 client.15444 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "status"}) -- 0x558e384b9de0 con 0x558e38133c90 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb138d14640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e38133c90 0x558e385d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb138d14640 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e38133c90 0x558e385d1500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4b6d245ea75b2db server_cookie=c2bc28521308f5f1 in_seq=0 out_seq=0 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb113fff640 10 client.15444 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb113fff640 1 -- 172.21.15.2:0/1434043528 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x558e384b9de0 con 0x558e38133c90 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb113fff640 10 client.15444 handle_command_reply: tid=0 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.684+0000 7fb1414ed740 1 client.15444 shutdown 2024-08-31T04:25:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 msgr2=0x558e38566200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb1200134f0 tx=0x7fb120013520 comp rx=0 tx=0).stop 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 shutdown_connections 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e3819ff60 0x558e3856a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558e3817f280 0x558e385667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x558e38133c90 0x558e385d1500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 --2- 172.21.15.2:0/1434043528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e381770a0 0x558e38566200 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 >> 172.21.15.2:0/1434043528 conn(0x558e38194350 msgr2=0x558e3854c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb113fff640 0 client.15444 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 shutdown_connections 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 1 -- 172.21.15.2:0/1434043528 wait complete. 2024-08-31T04:25:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.685+0000 7fb1414ed740 20 client.15444 trim_cache size 0 max 16384 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24671, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 104.284618958, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:25:22.692 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 166.572973504 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 msgr2=0x7fb1240b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 0x7fb1240b7140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ccb20 tx=0x7fb12c096fd0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 msgr2=0x7fb13419fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb12c005cc0 tx=0x7fb12c02f380 comp rx=0 tx=0).stop 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 shutdown_connections 2024-08-31T04:25:22.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1240b4c30 0x7fb1240b7140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13410dbf0 0x7fb13419fa20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1341050e0 0x7fb13419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 --2- 172.21.15.2:0/2804566744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb134104790 0x7fb13419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 >> 172.21.15.2:0/2804566744 conn(0x7fb1340794f0 msgr2=0x7fb1341055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 shutdown_connections 2024-08-31T04:25:22.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:22.686+0000 7fb13af78640 1 -- 172.21.15.2:0/2804566744 wait complete. 2024-08-31T04:25:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:22 smithi002 ceph-mon[18656]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:23.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:22 smithi064 ceph-mon[22007]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:23.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:22 smithi132 ceph-mon[22335]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:25:23.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:25:23.609 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 -- 172.21.15.2:0/3695706344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c41060b0 msgr2=0x7f04c41064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 --2- 172.21.15.2:0/3695706344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c41060b0 0x7f04c41064c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009900 tx=0x7f04b802a410 comp rx=0 tx=0).stop 2024-08-31T04:25:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 -- 172.21.15.2:0/3695706344 shutdown_connections 2024-08-31T04:25:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 --2- 172.21.15.2:0/3695706344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c41060b0 0x7f04c41064c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 --2- 172.21.15.2:0/3695706344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4106a00 0x7f04c4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.123+0000 7f04ca808640 1 --2- 172.21.15.2:0/3695706344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c4101ec0 0x7f04c41022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.124+0000 7f04ca808640 1 -- 172.21.15.2:0/3695706344 >> 172.21.15.2:0/3695706344 conn(0x7f04c4079c40 msgr2=0x7f04c407a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.124+0000 7f04ca808640 1 -- 172.21.15.2:0/3695706344 shutdown_connections 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.124+0000 7f04ca808640 1 -- 172.21.15.2:0/3695706344 wait complete. 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.124+0000 7f04ca808640 1 Processor -- start 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.124+0000 7f04ca808640 1 -- start start 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4101ec0 0x7f04c419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 0x7f04c419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4113900 con 0x7f04c4106a00 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4113780 con 0x7f04c41060b0 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04ca808640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4113a80 con 0x7f04c4101ec0 2024-08-31T04:25:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34662/0 (socket says 172.21.15.2:34662) 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 -- 172.21.15.2:0/1661995610 learned_addr learned my addr 172.21.15.2:0/1661995610 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c3fff640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4101ec0 0x7f04c419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 0x7f04c419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 -- 172.21.15.2:0/1661995610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4101ec0 msgr2=0x7f04c419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4101ec0 0x7f04c419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 -- 172.21.15.2:0/1661995610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 msgr2=0x7f04c419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 0x7f04c419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 -- 172.21.15.2:0/1661995610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c41a0260 con 0x7f04c4106a00 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 0x7f04c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.125+0000 7f04c8da5640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00eaa0 tx=0x7f04bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.126+0000 7f04c17fa640 1 -- 172.21.15.2:0/1661995610 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00cdb0 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.126+0000 7f04c17fa640 1 -- 172.21.15.2:0/1661995610 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04bc005020 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.126+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c41a0550 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.126+0000 7f04c17fa640 1 -- 172.21.15.2:0/1661995610 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0116d0 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.126+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c41a6cb0 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.128+0000 7f04d0d7d740 1 Processor -- start 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.128+0000 7f04c17fa640 1 -- 172.21.15.2:0/1661995610 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f04bc0051d0 con 0x7f04c4106a00 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.128+0000 7f04d0d7d740 1 -- start start 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a966b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a966bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e3a95e23f0 con 0x55e3a92a5280 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e3a95d1980 con 0x55e3a929d0a0 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e3a95d5930 con 0x55e3a92c5f60 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34676/0 (socket says 172.21.15.2:34676) 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 -- 172.21.15.2:0/3733841085 learned_addr learned my addr 172.21.15.2:0/3733841085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c3fff640 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a966bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a966b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 -- 172.21.15.2:0/3733841085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 msgr2=0x55e3a966b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a966b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 -- 172.21.15.2:0/3733841085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 msgr2=0x55e3a966bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a966bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 -- 172.21.15.2:0/3733841085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a9331540 con 0x55e3a92a5280 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c37fe640 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f04b8033000 tx=0x7f04b8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c769225e715728 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c17fa640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 0x7f04ac0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04aa7fc640 1 -- 172.21.15.2:0/3733841085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8045070 con 0x55e3a92a5280 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.129+0000 7f04c3fff640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 0x7f04ac0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04aa7fc640 1 -- 172.21.15.2:0/3733841085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b80316a0 con 0x55e3a92a5280 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04aa7fc640 1 -- 172.21.15.2:0/3733841085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8035040 con 0x55e3a92a5280 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04c17fa640 1 -- 172.21.15.2:0/1661995610 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f04bc0e5880 con 0x7f04c4106a00 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 -- 172.21.15.2:0/3733841085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 msgr2=0x55e3a966c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f04b8033000 tx=0x7f04b8031400 comp rx=0 tx=0).stop 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04c3fff640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 0x7f04ac0b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55e3a966a430 tx=0x7f04b4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 -- 172.21.15.2:0/3733841085 shutdown_connections 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a966c230 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a966bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/3733841085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a966b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.130+0000 7f04d0d7d740 1 -- 172.21.15.2:0/3733841085 >> 172.21.15.2:0/3733841085 conn(0x55e3a92ba350 msgr2=0x55e3a96696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- 172.21.15.2:0/3733841085 shutdown_connections 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- 172.21.15.2:0/3733841085 wait complete. 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- start start 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 Processor -- start 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92a5280 0x55e3a9677410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a9683280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e3a94345f0 con 0x55e3a929d0a0 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9558600 con 0x55e3a92a5280 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9679f30 con 0x55e3a92c5f60 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.131+0000 7f04d0d7d740 10 client.0 _ll_register_callbacks cb 0x55e3a957eaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34690/0 (socket says 172.21.15.2:34690) 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 -- 172.21.15.2:0/2721357247 learned_addr learned my addr 172.21.15.2:0/2721357247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c8da5640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a9683280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c37fe640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92a5280 0x55e3a9677410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 -- 172.21.15.2:0/2721357247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 msgr2=0x55e3a9683280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a9683280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 -- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92a5280 msgr2=0x55e3a9677410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92a5280 0x55e3a9677410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 -- 172.21.15.2:0/2721357247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a95917b0 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04c3fff640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04b40045f0 tx=0x7f04b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7f59bff1c107a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b401f640 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b80316a0 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.132+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f04b401f7e0 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04b401fa20 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3a9685db0 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b80316a0 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f04b4027070 con 0x55e3a929d0a0 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 10 client.15456 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:25:24.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 20 client.15456 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92848e0 0x55e3a9689d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 4 client.15456 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.133+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3a95e4340 con 0x55e3a92848e0 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.134+0000 7f04c37fe640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92848e0 0x55e3a9689d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.134+0000 7f04a37fe640 10 client.15456 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:24.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.134+0000 7f04c37fe640 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92848e0 0x55e3a9689d60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb6e527a4227724 server_cookie=a9b7ccab9cdfa75a in_seq=0 out_seq=0 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04a37fe640 1 -- 172.21.15.2:0/2721357247 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3a95e4340 con 0x55e3a92848e0 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04a37fe640 10 client.15456 handle_command_reply: tid=0 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 client.15456 shutdown 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 msgr2=0x55e3a9676ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04b40045f0 tx=0x7f04b4004730 comp rx=0 tx=0).stop 2024-08-31T04:25:24.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 shutdown_connections 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92848e0 0x55e3a9689d60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92c5f60 0x55e3a9683280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92a5280 0x55e3a9677410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04a37fe640 0 client.15456 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2721357247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a929d0a0 0x55e3a9676ed0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 >> 172.21.15.2:0/2721357247 conn(0x55e3a92ba350 msgr2=0x55e3a966e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 shutdown_connections 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2721357247 wait complete. 2024-08-31T04:25:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.135+0000 7f04d0d7d740 20 client.15456 trim_cache size 0 max 16384 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.153+0000 7f04d0d7d740 1 Processor -- start 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.153+0000 7f04d0d7d740 1 -- start start 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92848e0 0x55e3a96831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a929d0a0 0x55e3a9675750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e3a96880a0 con 0x55e3a92a5280 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9688770 con 0x55e3a92848e0 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9688e40 con 0x55e3a929d0a0 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34702/0 (socket says 172.21.15.2:34702) 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 -- 172.21.15.2:0/2443807111 learned_addr learned my addr 172.21.15.2:0/2443807111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c37fe640 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a929d0a0 0x55e3a9675750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 -- 172.21.15.2:0/2443807111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a929d0a0 msgr2=0x55e3a9675750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a929d0a0 0x55e3a9675750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 -- 172.21.15.2:0/2443807111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92848e0 msgr2=0x55e3a96831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c3fff640 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92848e0 0x55e3a96831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92848e0 0x55e3a96831f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 -- 172.21.15.2:0/2443807111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a96753d0 con 0x55e3a92a5280 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04c8da5640 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e2e90 tx=0x7f04bc0ab5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b79f4e299b599c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.154+0000 7f04a9ffb640 1 -- 172.21.15.2:0/2443807111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc01f040 con 0x55e3a92a5280 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04a9ffb640 1 -- 172.21.15.2:0/2443807111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04bc0cee50 con 0x55e3a92a5280 2024-08-31T04:25:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04a9ffb640 1 -- 172.21.15.2:0/2443807111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0054f0 con 0x55e3a92a5280 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2443807111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 msgr2=0x55e3a9675c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e2e90 tx=0x7f04bc0ab5f0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2443807111 shutdown_connections 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a9675c90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a929d0a0 0x55e3a9675750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/2443807111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a92848e0 0x55e3a96831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2443807111 >> 172.21.15.2:0/2443807111 conn(0x55e3a92ba350 msgr2=0x55e3a9664400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2443807111 shutdown_connections 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.155+0000 7f04d0d7d740 1 -- 172.21.15.2:0/2443807111 wait complete. 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 -- start start 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 Processor -- start 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92848e0 0x55e3a968b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a968bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9689be0 con 0x55e3a92a5280 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e3a9689510 con 0x55e3a929d0a0 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e3a968a2b0 con 0x55e3a92848e0 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04d0d7d740 10 client.0 _ll_register_callbacks cb 0x7f04b40044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04c8da5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34712/0 (socket says 172.21.15.2:34712) 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.156+0000 7f04c8da5640 1 -- 172.21.15.2:0/4248705528 learned_addr learned my addr 172.21.15.2:0/4248705528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c37fe640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a968bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c3fff640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92848e0 0x55e3a968b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 -- 172.21.15.2:0/4248705528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92848e0 msgr2=0x55e3a968b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92848e0 0x55e3a968b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 -- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 msgr2=0x55e3a968bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a968bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 -- 172.21.15.2:0/4248705528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a96f3760 con 0x55e3a92a5280 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c37fe640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a968bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04c8da5640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0a8fe0 tx=0x7f04bc0abef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df921730621d43a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc093050 con 0x55e3a92a5280 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f04bc0054f0 con 0x55e3a92a5280 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc0cee50 con 0x55e3a92a5280 2024-08-31T04:25:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04bc0931f0 con 0x55e3a92a5280 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04d0d7d740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3a96f4940 con 0x55e3a92a5280 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.157+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04bc0cee50 con 0x55e3a92a5280 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f04bc00f040 con 0x55e3a92a5280 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 10 client.15462 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 20 client.15462 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92c5f60 0x55e3a96f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 4 client.15462 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "status"}) -- 0x55e3a95dfde0 con 0x55e3a92c5f60 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04c3fff640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92c5f60 0x55e3a96f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04c3fff640 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92c5f60 0x55e3a96f7cc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfd9021420d3dfc server_cookie=7c044e3a0d481238 in_seq=0 out_seq=0 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.158+0000 7f04a37fe640 10 client.15462 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:24.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04a37fe640 1 -- 172.21.15.2:0/4248705528 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e3a95dfde0 con 0x55e3a92c5f60 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04a37fe640 10 client.15462 handle_command_reply: tid=0 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 client.15462 shutdown 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 msgr2=0x55e3a96f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0a8fe0 tx=0x7f04bc0abef0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 shutdown_connections 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e3a92c5f60 0x55e3a96f7cc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3a92a5280 0x55e3a96f3220 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e3a929d0a0 0x55e3a968bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 --2- 172.21.15.2:0/4248705528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e3a92848e0 0x55e3a968b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04a37fe640 0 client.15462 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 >> 172.21.15.2:0/4248705528 conn(0x55e3a92ba350 msgr2=0x55e3a9676c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 shutdown_connections 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 1 -- 172.21.15.2:0/4248705528 wait complete. 2024-08-31T04:25:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.159+0000 7f04d0d7d740 20 client.15462 trim_cache size 0 max 16384 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "4070480a-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24704, 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 145.929574817, 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-08-31T04:25:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 85, 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 156.64994166700001 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 msgr2=0x7f04ac0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 0x7f04ac0b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55e3a966a430 tx=0x7f04b4005f90 comp rx=0 tx=0).stop 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 msgr2=0x7f04c419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00eaa0 tx=0x7f04bc00ef60 comp rx=0 tx=0).stop 2024-08-31T04:25:24.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 shutdown_connections 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04ac0b4b80 0x7f04ac0b7090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c4106a00 0x7f04c419fb30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04c41060b0 0x7f04c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 --2- 172.21.15.2:0/1661995610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c4101ec0 0x7f04c419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 >> 172.21.15.2:0/1661995610 conn(0x7f04c4079c40 msgr2=0x7f04c4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 shutdown_connections 2024-08-31T04:25:24.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:24.160+0000 7f04ca808640 1 -- 172.21.15.2:0/1661995610 wait complete. 2024-08-31T04:25:24.859 INFO:teuthology.run_tasks:Running task kclient... 2024-08-31T04:25:24.872 INFO:tasks.kclient:Mounting kernel clients... 2024-08-31T04:25:24.872 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-31T04:25:24.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:24.873 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-31T04:25:24.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-31T04:25:24.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:24.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:25:24.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:24.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-31T04:25:25.051 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-08-31T04:25:25.051 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T04:25:25.051 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:25.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T04:25:25.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:24 smithi002 ceph-mon[18656]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:25.303 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:25.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:24 smithi064 ceph-mon[22007]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:25.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:24 smithi132 ceph-mon[22335]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-31T04:25:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 -- 172.21.15.2:0/824858450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102190 msgr2=0x7f8e441025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/824858450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102190 0x7f8e441025a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009900 tx=0x7f8e4002a480 comp rx=0 tx=0).stop 2024-08-31T04:25:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 -- 172.21.15.2:0/824858450 shutdown_connections 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/824858450 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e44112160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/824858450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102ae0 0x7f8e4410f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/824858450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102190 0x7f8e441025a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 -- 172.21.15.2:0/824858450 >> 172.21.15.2:0/824858450 conn(0x7f8e440fe070 msgr2=0x7f8e441004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 -- 172.21.15.2:0/824858450 shutdown_connections 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.801+0000 7f8e4a99f640 1 -- 172.21.15.2:0/824858450 wait complete. 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 Processor -- start 2024-08-31T04:25:25.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 -- start start 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102190 0x7f8e4419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e441a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44115870 con 0x7f8e44102ae0 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441156f0 con 0x7f8e44102190 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.802+0000 7f8e4a99f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441159f0 con 0x7f8e4410fd40 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44394/0 (socket says 172.21.15.2:44394) 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 -- 172.21.15.2:0/2264900583 learned_addr learned my addr 172.21.15.2:0/2264900583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:25.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4a19e640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e441a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4999d640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102190 0x7f8e4419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 -- 172.21.15.2:0/2264900583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 msgr2=0x7f8e441a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e441a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 -- 172.21.15.2:0/2264900583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102190 msgr2=0x7f8e4419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102190 0x7f8e4419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 -- 172.21.15.2:0/2264900583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e441a2230 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4a19e640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e441a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4919c640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400d950 tx=0x7f8e3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34017070 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e441a2520 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e34009c30 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400f620 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.803+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e441a8c80 con 0x7f8e44102ae0 2024-08-31T04:25:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.805+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e441025a0 con 0x7f8e44102ae0 2024-08-31T04:25:25.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.807+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f8e34010460 con 0x7f8e44102ae0 2024-08-31T04:25:25.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.808+0000 7f8e3affd640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 0x7f8e300b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:25.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.808+0000 7f8e4999d640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 0x7f8e300b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:25.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.808+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8e340e5420 con 0x7f8e44102ae0 2024-08-31T04:25:25.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.808+0000 7f8e4999d640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 0x7f8e300b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8e40031440 tx=0x7f8e40005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:25.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:25.811+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e340abfb0 con 0x7f8e44102ae0 2024-08-31T04:25:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.036+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8e4419d3f0 con 0x7f8e44102ae0 2024-08-31T04:25:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.037+0000 7f8e3affd640 1 -- 172.21.15.2:0/2264900583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7f8e4419d3f0 con 0x7f8e44102ae0 2024-08-31T04:25:26.038 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T04:25:26.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 msgr2=0x7f8e300b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 0x7f8e300b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8e40031440 tx=0x7f8e40005d50 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 msgr2=0x7f8e4419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400d950 tx=0x7f8e3400de10 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 shutdown_connections 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8e300b4b80 0x7f8e300b7090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e44102ae0 0x7f8e4419c860 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e4410fd40 0x7f8e441a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 --2- 172.21.15.2:0/2264900583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e44102190 0x7f8e4419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 >> 172.21.15.2:0/2264900583 conn(0x7f8e440fe070 msgr2=0x7f8e44111ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 shutdown_connections 2024-08-31T04:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26.040+0000 7f8e4a99f640 1 -- 172.21.15.2:0/2264900583 wait complete. 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T04:25:26.667 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:25:26.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:26.668 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:25:26.684 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42000sec preferred_lft 42000sec 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::6f05:b039:a4ec:1f10/64 scope link noprefixroute 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:25:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:25:26.686 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-31T04:25:26.686 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T04:25:26.686 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:25:26.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:26.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:26.825 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T04:25:26.849 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-31T04:25:26.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:26.851 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-31T04:25:26.908 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-31T04:25:26.908 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T04:25:26.908 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T04:25:26.908 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T04:25:26.908 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T04:25:26.908 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:25:26.908 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:25:26.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T04:25:26.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T04:25:26.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T04:25:26.909 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:25:26.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:27.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:27.035 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-31T04:25:27.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:27.050 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-31T04:25:27.106 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:25:27.107 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:25:27.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:25:27.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T04:25:27.107 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:25:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:26 smithi002 ceph-mon[18656]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:26 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2264900583' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:25:27.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:27.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T04:25:27.225 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:25:27.225 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T04:25:27.226 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:25:27.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:26 smithi064 ceph-mon[22007]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:26 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2264900583' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:25:27.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:26 smithi132 ceph-mon[22335]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:25:27.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:26 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2264900583' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:25:27.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.341 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:25:27.341 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-31T04:25:27.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-31T04:25:27.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T04:25:27.342 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-31T04:25:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:25:27.418 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:27.433 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:25:27.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:25:27.434 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:27.489 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-31T04:25:27.489 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-31T04:25:27.489 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/8a650a09-e3bb-42b7-a91b-e46279072352 2024-08-31T04:25:27.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:27.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/8a650a09-e3bb-42b7-a91b-e46279072352 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-31T04:25:27.582 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-31T04:25:27.583 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-08-31T04:25:27.583 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.64:3300,172.21.15.132:3300" 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:3300,172.21.15.64:3300,172.21.15.132:3300:/volumes/qa/sv_1/8a650a09-e3bb-42b7-a91b-e46279072352 2024-08-31T04:25:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=4070480a-674f-11ef-bcd4-c7b262605968" will pass to kernel 2024-08-31T04:25:27.712 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-31T04:25:27.712 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-31T04:25:27.712 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-31T04:25:27.712 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-31T04:25:27.712 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-31T04:25:27.713 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-31T04:25:27.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:25:27.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:27.743 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:25:27.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:25:27.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.840 INFO:teuthology.orchestra.run.smithi002.stdout:client25205 2024-08-31T04:25:27.840 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:25:27.840 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:25:27.857 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:25:27.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:25:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:27.953 INFO:teuthology.orchestra.run.smithi002.stdout:client25205 2024-08-31T04:25:27.953 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:25:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:25:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:28.009 INFO:teuthology.orchestra.run.smithi002.stdout:client25205 2024-08-31T04:25:28.009 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4070480a-674f-11ef-bcd4-c7b262605968.client25205/status') 2024-08-31T04:25:28.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:25:28.067 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.25205 (3)172.21.15.2:0/3429797904 2024-08-31T04:25:28.067 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-08-31T04:25:28.068 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-08-31T04:25:28.068 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-08-31T04:25:28.068 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 2.2972e-05 s, 3.0 MB/s 2024-08-31T04:25:28.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:25:28.075 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T04:25:28.084 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T04:25:28.084 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:25:28.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 -- 172.21.15.2:0/2719697658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1057e0 msgr2=0x7f53dc10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 --2- 172.21.15.2:0/2719697658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1057e0 0x7f53dc10f250 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009ca0 tx=0x7f53d402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 -- 172.21.15.2:0/2719697658 shutdown_connections 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 --2- 172.21.15.2:0/2719697658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1057e0 0x7f53dc10f250 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 --2- 172.21.15.2:0/2719697658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc104e90 0x7f53dc1052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 --2- 172.21.15.2:0/2719697658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc102ed0 0x7f53dc1032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 -- 172.21.15.2:0/2719697658 >> 172.21.15.2:0/2719697658 conn(0x7f53dc079bf0 msgr2=0x7f53dc07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 -- 172.21.15.2:0/2719697658 shutdown_connections 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.194+0000 7f53e23a3640 1 -- 172.21.15.2:0/2719697658 wait complete. 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 Processor -- start 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 -- start start 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 0x7f53dc0fea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 0x7f53dc0ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1126f0 con 0x7f53dc104e90 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc112570 con 0x7f53dc1057e0 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e23a3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc112870 con 0x7f53dc102ed0 2024-08-31T04:25:28.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44414/0 (socket says 172.21.15.2:44414) 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53d3fff640 1 -- 172.21.15.2:0/1743944534 learned_addr learned my addr 172.21.15.2:0/1743944534 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53e0940640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 0x7f53dc0ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.195+0000 7f53dbfff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 0x7f53dc0fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 -- 172.21.15.2:0/1743944534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 msgr2=0x7f53dc0fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 0x7f53dc0fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 -- 172.21.15.2:0/1743944534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 msgr2=0x7f53dc0ff4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 0x7f53dc0ff4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 -- 172.21.15.2:0/1743944534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc1a84d0 con 0x7f53dc104e90 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53dbfff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 0x7f53dc0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53e0940640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 0x7f53dc0ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d3fff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d750 tx=0x7f53c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:28.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4017070 con 0x7f53dc104e90 2024-08-31T04:25:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c40054d0 con 0x7f53dc104e90 2024-08-31T04:25:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc1a87c0 con 0x7f53dc104e90 2024-08-31T04:25:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004c30 con 0x7f53dc104e90 2024-08-31T04:25:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.196+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a8d10 con 0x7f53dc104e90 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.197+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc1032e0 con 0x7f53dc104e90 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.198+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f53c4004dd0 con 0x7f53dc104e90 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.199+0000 7f53d9ffb640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 0x7f53c80b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.200+0000 7f53dbfff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 0x7f53c80b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.200+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f53c40e5560 con 0x7f53dc104e90 2024-08-31T04:25:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.200+0000 7f53dbfff640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 0x7f53c80b7140 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:28.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.203+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f53c40ac170 con 0x7f53dc104e90 2024-08-31T04:25:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.429+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f53dc02e430 con 0x7f53dc104e90 2024-08-31T04:25:28.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.899+0000 7f53d9ffb640 1 -- 172.21.15.2:0/1743944534 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f53c40aba70 con 0x7f53dc104e90 2024-08-31T04:25:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 msgr2=0x7f53c80b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 0x7f53c80b7140 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc005850 comp rx=0 tx=0).stop 2024-08-31T04:25:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 msgr2=0x7f53dc0fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d750 tx=0x7f53c400dc10 comp rx=0 tx=0).stop 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 shutdown_connections 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53c80b4c30 0x7f53c80b7140 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc104e90 0x7f53dc0fef80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53dc1057e0 0x7f53dc0ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 --2- 172.21.15.2:0/1743944534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53dc102ed0 0x7f53dc0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 >> 172.21.15.2:0/1743944534 conn(0x7f53dc079bf0 msgr2=0x7f53dc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 shutdown_connections 2024-08-31T04:25:28.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:28.903+0000 7f53e23a3640 1 -- 172.21.15.2:0/1743944534 wait complete. 2024-08-31T04:25:28.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-08-31T04:25:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.032+0000 7fdeec08b640 1 -- 172.21.15.2:0/269388900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 msgr2=0x7fdee41084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.032+0000 7fdeec08b640 1 --2- 172.21.15.2:0/269388900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee41084b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fded4009900 tx=0x7fded402a410 comp rx=0 tx=0).stop 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 -- 172.21.15.2:0/269388900 shutdown_connections 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 --2- 172.21.15.2:0/269388900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee41084b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 --2- 172.21.15.2:0/269388900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 0x7fdee410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 --2- 172.21.15.2:0/269388900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 -- 172.21.15.2:0/269388900 >> 172.21.15.2:0/269388900 conn(0x7fdee40fe150 msgr2=0x7fdee41005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 -- 172.21.15.2:0/269388900 shutdown_connections 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 -- 172.21.15.2:0/269388900 wait complete. 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 Processor -- start 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.033+0000 7fdeec08b640 1 -- start start 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 0x7fdee419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41137d0 con 0x7fdee41080a0 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4113650 con 0x7fdee4102770 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4113950 con 0x7fdee41089f0 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44438/0 (socket says 172.21.15.2:44438) 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 -- 172.21.15.2:0/3773980042 learned_addr learned my addr 172.21.15.2:0/3773980042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9e27640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeea628640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 0x7fdee419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 -- 172.21.15.2:0/3773980042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 msgr2=0x7fdee419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 0x7fdee419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 -- 172.21.15.2:0/3773980042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 msgr2=0x7fdee419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 -- 172.21.15.2:0/3773980042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee41a0120 con 0x7fdee41080a0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9e27640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdee9626640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fded402a930 tx=0x7fded4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded403f030 con 0x7fdee41080a0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded4003aa0 con 0x7fdee41080a0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee41a03b0 con 0x7fdee41080a0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4035070 con 0x7fdee41080a0 2024-08-31T04:25:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.034+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee41a6ba0 con 0x7fdee41080a0 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.036+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee41039e0 con 0x7fdee41080a0 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.037+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fded4042030 con 0x7fdee41080a0 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.038+0000 7fdedaffd640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 0x7fded00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.038+0000 7fdee9e27640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 0x7fded00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.038+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fded41062f0 con 0x7fdee41080a0 2024-08-31T04:25:29.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.038+0000 7fdee9e27640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 0x7fded00b7090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdee00058c0 tx=0x7fdee0005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.041+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fded40cce80 con 0x7fdee41080a0 2024-08-31T04:25:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.257+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fdee4104f00 con 0x7fded00b4b80 2024-08-31T04:25:29.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:28 smithi002 ceph-mon[18656]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:25:29.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:28 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T04:25:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.275+0000 7fdedaffd640 1 -- 172.21.15.2:0/3773980042 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fdee4104f00 con 0x7fded00b4b80 2024-08-31T04:25:29.278 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-08-31T04:25:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 msgr2=0x7fded00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 0x7fded00b7090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdee00058c0 tx=0x7fdee0005850 comp rx=0 tx=0).stop 2024-08-31T04:25:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 msgr2=0x7fdee419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fded402a930 tx=0x7fded4004270 comp rx=0 tx=0).stop 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 shutdown_connections 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fded00b4b80 0x7fded00b7090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdee41080a0 0x7fdee419a790 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee41089f0 0x7fdee419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 --2- 172.21.15.2:0/3773980042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdee4102770 0x7fdee419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 >> 172.21.15.2:0/3773980042 conn(0x7fdee40fe150 msgr2=0x7fdee41047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 shutdown_connections 2024-08-31T04:25:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.278+0000 7fdeec08b640 1 -- 172.21.15.2:0/3773980042 wait complete. 2024-08-31T04:25:29.291 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T04:25:29.302 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-31T04:25:29.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:25:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:28 smithi064 ceph-mon[22007]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:25:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:28 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T04:25:29.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:28 smithi132 ceph-mon[22335]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:25:29.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:28 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T04:25:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 -- 172.21.15.2:0/1731925499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 msgr2=0x7f152010f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 --2- 172.21.15.2:0/1731925499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f152010f220 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1518009ca0 tx=0x7f151802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 -- 172.21.15.2:0/1731925499 shutdown_connections 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 --2- 172.21.15.2:0/1731925499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f152010f220 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 --2- 172.21.15.2:0/1731925499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15201080a0 0x7f15201084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.421+0000 7f15273a3640 1 --2- 172.21.15.2:0/1731925499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1520102770 0x7f1520102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.422+0000 7f15273a3640 1 -- 172.21.15.2:0/1731925499 >> 172.21.15.2:0/1731925499 conn(0x7f15200fe150 msgr2=0x7f15201005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.422+0000 7f15273a3640 1 -- 172.21.15.2:0/1731925499 shutdown_connections 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.422+0000 7f15273a3640 1 -- 172.21.15.2:0/1731925499 wait complete. 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.422+0000 7f15273a3640 1 Processor -- start 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.422+0000 7f15273a3640 1 -- start start 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 0x7f152019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15201080a0 0x7f152019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15201126c0 con 0x7f15201089f0 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1520112540 con 0x7f1520102770 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15273a3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1520112840 con 0x7f15201080a0 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44480/0 (socket says 172.21.15.2:44480) 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 -- 172.21.15.2:0/2530762349 learned_addr learned my addr 172.21.15.2:0/2530762349 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f152513f640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 0x7f152019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f152493e640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15201080a0 0x7f152019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 -- 172.21.15.2:0/2530762349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15201080a0 msgr2=0x7f152019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15201080a0 0x7f152019c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 -- 172.21.15.2:0/2530762349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 msgr2=0x7f152019c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 0x7f152019c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 -- 172.21.15.2:0/2530762349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15201a22e0 con 0x7f15201089f0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f152513f640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 0x7f152019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f1525940640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1518005cc0 tx=0x7f151802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518003bf0 con 0x7f15201089f0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.423+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1518003d90 con 0x7f15201089f0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.424+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151802fbc0 con 0x7f15201089f0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.424+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15201a2570 con 0x7f15201089f0 2024-08-31T04:25:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.424+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15201a8d60 con 0x7f15201089f0 2024-08-31T04:25:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.425+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1520102b80 con 0x7f15201089f0 2024-08-31T04:25:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.427+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f151802fd60 con 0x7f15201089f0 2024-08-31T04:25:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.428+0000 7f15127fc640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 0x7f150c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.428+0000 7f152513f640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 0x7f150c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.428+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1518106e60 con 0x7f15201089f0 2024-08-31T04:25:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.428+0000 7f152513f640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 0x7f150c0b7110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f151c0058c0 tx=0x7f151c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.431+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15180cd9f0 con 0x7f15201089f0 2024-08-31T04:25:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.618+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15201a90d0 con 0x7f15201089f0 2024-08-31T04:25:29.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.619+0000 7f15127fc640 1 -- 172.21.15.2:0/2530762349 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25348 (secure 0 0 0) 0x7f15180cd2f0 con 0x7f15201089f0 2024-08-31T04:25:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:24:34.895861+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.621+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 msgr2=0x7f150c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.621+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 0x7f150c0b7110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f151c0058c0 tx=0x7f151c005850 comp rx=0 tx=0).stop 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.621+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 msgr2=0x7f15201a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.621+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1518005cc0 tx=0x7f151802f380 comp rx=0 tx=0).stop 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 shutdown_connections 2024-08-31T04:25:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f150c0b4c00 0x7f150c0b7110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15201089f0 0x7f15201a1be0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15201080a0 0x7f152019c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 --2- 172.21.15.2:0/2530762349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1520102770 0x7f152019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 >> 172.21.15.2:0/2530762349 conn(0x7f15200fe150 msgr2=0x7f1520105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 shutdown_connections 2024-08-31T04:25:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.622+0000 7f15273a3640 1 -- 172.21.15.2:0/2530762349 wait complete. 2024-08-31T04:25:29.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:25:29.263+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:25:29.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:25:29.263+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:25:29.635 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:25:29.263+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:25:29.635 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:25:29.263+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:25:29.635 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:25:29.263+0000 7f286686c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:25:29.636 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T04:18:21.427633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T04:22:53.823776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T04:22:55.938232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-31T04:23:02.265074+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-31T04:25:29.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T04:25:29.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 -- 172.21.15.2:0/1814052810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 msgr2=0x7f6d30104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 --2- 172.21.15.2:0/1814052810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d30104aa0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009900 tx=0x7f6d2002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 -- 172.21.15.2:0/1814052810 shutdown_connections 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 --2- 172.21.15.2:0/1814052810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d3010daf0 0x7f6d3010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 --2- 172.21.15.2:0/1814052810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d30104fe0 0x7f6d3010d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 --2- 172.21.15.2:0/1814052810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d30104aa0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 -- 172.21.15.2:0/1814052810 >> 172.21.15.2:0/1814052810 conn(0x7f6d300fe180 msgr2=0x7f6d301005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 -- 172.21.15.2:0/1814052810 shutdown_connections 2024-08-31T04:25:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.748+0000 7f6d34edd640 1 -- 172.21.15.2:0/1814052810 wait complete. 2024-08-31T04:25:29.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 Processor -- start 2024-08-31T04:25:29.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 -- start start 2024-08-31T04:25:29.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 0x7f6d3019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 0x7f6d3019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d30113760 con 0x7f6d30104690 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6d301135e0 con 0x7f6d3010daf0 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d34edd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6d301138e0 con 0x7f6d30104fe0 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44496/0 (socket says 172.21.15.2:44496) 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 -- 172.21.15.2:0/2387946301 learned_addr learned my addr 172.21.15.2:0/2387946301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2ed9d640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 0x7f6d3019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2dd9b640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 0x7f6d3019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 -- 172.21.15.2:0/2387946301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 msgr2=0x7f6d3019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 0x7f6d3019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 -- 172.21.15.2:0/2387946301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 msgr2=0x7f6d3019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 0x7f6d3019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2e59c640 1 -- 172.21.15.2:0/2387946301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3019ffa0 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2dd9b640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 0x7f6d3019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.749+0000 7f6d2ed9d640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 0x7f6d3019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d2e59c640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6d20006010 tx=0x7f6d200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2003f030 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d20003800 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d301a0230 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20035070 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.750+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d301a0720 con 0x7f6d30104690 2024-08-31T04:25:29.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.751+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3006ad30 con 0x7f6d30104690 2024-08-31T04:25:29.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.752+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f6d20003cb0 con 0x7f6d30104690 2024-08-31T04:25:29.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.753+0000 7f6d1f7fe640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 0x7f6d180b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:29.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.753+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f6d20106340 con 0x7f6d30104690 2024-08-31T04:25:29.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.753+0000 7f6d2dd9b640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 0x7f6d180b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:29.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.754+0000 7f6d2dd9b640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 0x7f6d180b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ff290 tx=0x7f6d24005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.756+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6d200cced0 con 0x7f6d30104690 2024-08-31T04:25:29.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.946+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d301a6c30 con 0x7f6d30104690 2024-08-31T04:25:29.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.946+0000 7f6d1f7fe640 1 -- 172.21.15.2:0/2387946301 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f6d200cc7d0 con 0x7f6d30104690 2024-08-31T04:25:29.949 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 msgr2=0x7f6d180b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 0x7f6d180b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ff290 tx=0x7f6d24005d90 comp rx=0 tx=0).stop 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 msgr2=0x7f6d3019a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6d20006010 tx=0x7f6d200042f0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 shutdown_connections 2024-08-31T04:25:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d3010daf0 0x7f6d3019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d30104fe0 0x7f6d3019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6d180b4b80 0x7f6d180b7090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 --2- 172.21.15.2:0/2387946301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104690 0x7f6d3019a100 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 >> 172.21.15.2:0/2387946301 conn(0x7f6d300fe180 msgr2=0x7f6d30107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 shutdown_connections 2024-08-31T04:25:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:29.948+0000 7f6d34edd640 1 -- 172.21.15.2:0/2387946301 wait complete. 2024-08-31T04:25:29.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 -- 172.21.15.2:0/1691888619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109180 msgr2=0x7fb78c109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 --2- 172.21.15.2:0/1691888619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109180 0x7fb78c109590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb774009900 tx=0x7fb77402a410 comp rx=0 tx=0).stop 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 -- 172.21.15.2:0/1691888619 shutdown_connections 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 --2- 172.21.15.2:0/1691888619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109180 0x7fb78c109590 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 --2- 172.21.15.2:0/1691888619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c109ad0 0x7fb78c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 --2- 172.21.15.2:0/1691888619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c103850 0x7fb78c103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 -- 172.21.15.2:0/1691888619 >> 172.21.15.2:0/1691888619 conn(0x7fb78c0ff290 msgr2=0x7fb78c1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 -- 172.21.15.2:0/1691888619 shutdown_connections 2024-08-31T04:25:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.073+0000 7fb791cec640 1 -- 172.21.15.2:0/1691888619 wait complete. 2024-08-31T04:25:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 Processor -- start 2024-08-31T04:25:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 -- start start 2024-08-31T04:25:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c103850 0x7fb78c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 0x7fb78c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c113740 con 0x7fb78c109ad0 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c1135c0 con 0x7fb78c109180 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb791cec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c1138c0 con 0x7fb78c103850 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb78bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb78bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44500/0 (socket says 172.21.15.2:44500) 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb78bfff640 1 -- 172.21.15.2:0/1216322230 learned_addr learned my addr 172.21.15.2:0/1216322230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb78b7fe640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c103850 0x7fb78c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.074+0000 7fb782ffd640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 0x7fb78c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 -- 172.21.15.2:0/1216322230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c103850 msgr2=0x7fb78c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c103850 0x7fb78c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 -- 172.21.15.2:0/1216322230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 msgr2=0x7fb78c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 0x7fb78c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 -- 172.21.15.2:0/1216322230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c1a0130 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb782ffd640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 0x7fb78c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb78bfff640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb784009fd0 tx=0x7fb78400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784017070 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb784003e20 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c1a0420 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784010460 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.075+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c1a6bb0 con 0x7fb78c109ad0 2024-08-31T04:25:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.076+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c104ac0 con 0x7fb78c109ad0 2024-08-31T04:25:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.077+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fb784003970 con 0x7fb78c109ad0 2024-08-31T04:25:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.078+0000 7fb7897fa640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 0x7fb7780b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.079+0000 7fb78b7fe640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 0x7fb7780b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.079+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb7840e54c0 con 0x7fb78c109ad0 2024-08-31T04:25:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.079+0000 7fb78b7fe640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 0x7fb7780b7090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00bbe0 tx=0x7fb77c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.083+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb7840ac050 con 0x7fb78c109ad0 2024-08-31T04:25:30.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.268+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb78c10b8b0 con 0x7fb78c109ad0 2024-08-31T04:25:30.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.269+0000 7fb7897fa640 1 -- 172.21.15.2:0/1216322230 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7fb7840ab950 con 0x7fb78c109ad0 2024-08-31T04:25:30.271 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 msgr2=0x7fb7780b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 0x7fb7780b7090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00bbe0 tx=0x7fb77c00b390 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 msgr2=0x7fb78c19fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb784009fd0 tx=0x7fb78400b260 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 shutdown_connections 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb7780b4b80 0x7fb7780b7090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c109ad0 0x7fb78c19fa30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb78c109180 0x7fb78c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 --2- 172.21.15.2:0/1216322230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78c103850 0x7fb78c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 >> 172.21.15.2:0/1216322230 conn(0x7fb78c0ff290 msgr2=0x7fb78c1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 shutdown_connections 2024-08-31T04:25:30.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.271+0000 7fb791cec640 1 -- 172.21.15.2:0/1216322230 wait complete. 2024-08-31T04:25:30.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T04:25:30.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:25:30.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:29 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2530762349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:30.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T04:25:30.316 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:29 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T04:25:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:29 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:25:30.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:29 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2530762349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:29 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1743944534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T04:25:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:29 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:25:30.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:29 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2530762349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:30.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/3135836281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc44102770 msgr2=0x7fbc44102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/3135836281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc44102770 0x7fbc44102b80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009900 tx=0x7fbc3402a410 comp rx=0 tx=0).stop 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/3135836281 shutdown_connections 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/3135836281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/3135836281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc441080a0 0x7fbc441084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/3135836281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc44102770 0x7fbc44102b80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/3135836281 >> 172.21.15.2:0/3135836281 conn(0x7fbc440fe190 msgr2=0x7fbc441005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/3135836281 shutdown_connections 2024-08-31T04:25:30.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/3135836281 wait complete. 2024-08-31T04:25:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.398+0000 7fbc4a7cf640 1 Processor -- start 2024-08-31T04:25:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 -- start start 2024-08-31T04:25:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc44102770 0x7fbc4419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441126a0 con 0x7fbc441080a0 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44112520 con 0x7fbc441089f0 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc4a7cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44112820 con 0x7fbc44102770 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44520/0 (socket says 172.21.15.2:44520) 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 -- 172.21.15.2:0/2409046996 learned_addr learned my addr 172.21.15.2:0/2409046996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc48d6c640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc43fff640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc44102770 0x7fbc4419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 -- 172.21.15.2:0/2409046996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc44102770 msgr2=0x7fbc4419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc44102770 0x7fbc4419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 -- 172.21.15.2:0/2409046996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 msgr2=0x7fbc4419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc437fe640 1 -- 172.21.15.2:0/2409046996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc441a00e0 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.399+0000 7fbc48d6c640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc437fe640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800e9f0 tx=0x7fbc3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800ccc0 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc380108e0 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc441a03d0 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38018860 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.400+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441a6b60 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.401+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc441039e0 con 0x7fbc441080a0 2024-08-31T04:25:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.403+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fbc38010430 con 0x7fbc441080a0 2024-08-31T04:25:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.404+0000 7fbc417fa640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 0x7fbc2c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.404+0000 7fbc43fff640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 0x7fbc2c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.404+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fbc380e5ee0 con 0x7fbc441080a0 2024-08-31T04:25:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.404+0000 7fbc43fff640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 0x7fbc2c0b7110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc34031440 tx=0x7fbc34005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.407+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbc380acad0 con 0x7fbc441080a0 2024-08-31T04:25:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.594+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbc4419b2d0 con 0x7fbc441080a0 2024-08-31T04:25:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.595+0000 7fbc417fa640 1 -- 172.21.15.2:0/2409046996 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7fbc380ac3d0 con 0x7fbc441080a0 2024-08-31T04:25:30.596 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-31T04:25:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 msgr2=0x7fbc2c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 0x7fbc2c0b7110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc34031440 tx=0x7fbc34005d50 comp rx=0 tx=0).stop 2024-08-31T04:25:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 msgr2=0x7fbc4419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800e9f0 tx=0x7fbc3800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 shutdown_connections 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbc2c0b4c00 0x7fbc2c0b7110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441080a0 0x7fbc4419a750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc441089f0 0x7fbc4419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 --2- 172.21.15.2:0/2409046996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc44102770 0x7fbc4419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 >> 172.21.15.2:0/2409046996 conn(0x7fbc440fe190 msgr2=0x7fbc44101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 shutdown_connections 2024-08-31T04:25:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.597+0000 7fbc4a7cf640 1 -- 172.21.15.2:0/2409046996 wait complete. 2024-08-31T04:25:30.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 -- 172.21.15.2:0/7357167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109ad0 msgr2=0x7ff7b0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 --2- 172.21.15.2:0/7357167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109ad0 0x7ff7b0110300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009ca0 tx=0x7ff7a802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 -- 172.21.15.2:0/7357167 shutdown_connections 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 --2- 172.21.15.2:0/7357167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109ad0 0x7ff7b0110300 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 --2- 172.21.15.2:0/7357167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0109180 0x7ff7b0109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 --2- 172.21.15.2:0/7357167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0103850 0x7ff7b0103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 -- 172.21.15.2:0/7357167 >> 172.21.15.2:0/7357167 conn(0x7ff7b00ff290 msgr2=0x7ff7b01016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 -- 172.21.15.2:0/7357167 shutdown_connections 2024-08-31T04:25:30.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.722+0000 7ff7b5270640 1 -- 172.21.15.2:0/7357167 wait complete. 2024-08-31T04:25:30.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 Processor -- start 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 -- start start 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 0x7ff7b019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0109ad0 0x7ff7b019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b01137a0 con 0x7ff7b0109180 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0113620 con 0x7ff7b0103850 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7b5270640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0113920 con 0x7ff7b0109ad0 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.723+0000 7ff7ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44534/0 (socket says 172.21.15.2:44534) 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 -- 172.21.15.2:0/64997940 learned_addr learned my addr 172.21.15.2:0/64997940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7af7fe640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0109ad0 0x7ff7b019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7aeffd640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 0x7ff7b019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 -- 172.21.15.2:0/64997940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0109ad0 msgr2=0x7ff7b019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0109ad0 0x7ff7b019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 -- 172.21.15.2:0/64997940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 msgr2=0x7ff7b019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 0x7ff7b019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 -- 172.21.15.2:0/64997940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b01a00b0 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7aeffd640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 0x7ff7b019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7ae7fc640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400e9f0 tx=0x7ff7a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400ccc0 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7a40108e0 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4018860 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b01a03a0 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.724+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b01a6b30 con 0x7ff7b0109180 2024-08-31T04:25:30.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.725+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b0104ac0 con 0x7ff7b0109180 2024-08-31T04:25:30.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.727+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7ff7a4010430 con 0x7ff7b0109180 2024-08-31T04:25:30.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.727+0000 7ff797fff640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 0x7ff7980b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.728+0000 7ff7aeffd640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 0x7ff7980b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.728+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff7a40e5f00 con 0x7ff7b0109180 2024-08-31T04:25:30.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.728+0000 7ff7aeffd640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 0x7ff7980b7090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009c20 tx=0x7ff7a0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.731+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7a40acaf0 con 0x7ff7b0109180 2024-08-31T04:25:30.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.917+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff7b019b2a0 con 0x7ff7b0109180 2024-08-31T04:25:30.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.918+0000 7ff797fff640 1 -- 172.21.15.2:0/64997940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v85) ==== 103+0+11 (secure 0 0 0) 0x7ff7a40ac3f0 con 0x7ff7b0109180 2024-08-31T04:25:30.920 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 msgr2=0x7ff7980b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 0x7ff7980b7090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009c20 tx=0x7ff7a0005f90 comp rx=0 tx=0).stop 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 msgr2=0x7ff7b019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400e9f0 tx=0x7ff7a400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 shutdown_connections 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff7980b4b80 0x7ff7980b7090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b0109180 0x7ff7b019a720 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7b0109ad0 0x7ff7b019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 --2- 172.21.15.2:0/64997940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7b0103850 0x7ff7b019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.920+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 >> 172.21.15.2:0/64997940 conn(0x7ff7b00ff290 msgr2=0x7ff7b0106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.921+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 shutdown_connections 2024-08-31T04:25:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:30.921+0000 7ff7b5270640 1 -- 172.21.15.2:0/64997940 wait complete. 2024-08-31T04:25:30.933 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-31T04:25:30.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:25:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:31.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:30 smithi002 ceph-mon[18656]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:30 smithi002 ceph-mon[18656]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:30 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2387946301' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:30 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1216322230' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:30 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2409046996' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:30 smithi064 ceph-mon[22007]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:30 smithi064 ceph-mon[22007]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:30 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2387946301' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:30 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1216322230' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:30 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2409046996' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:30 smithi132 ceph-mon[22335]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:31.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:30 smithi132 ceph-mon[22335]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:31.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:30 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2387946301' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:30 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1216322230' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:30 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2409046996' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:25:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 -- 172.21.15.2:0/3286326094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d0108220 msgr2=0x7f63d010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3286326094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d0108220 0x7f63d010ea50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009ca0 tx=0x7f63c802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 -- 172.21.15.2:0/3286326094 shutdown_connections 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3286326094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d0108220 0x7f63d010ea50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3286326094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d01078d0 0x7f63d0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3286326094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0101f90 0x7f63d01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 -- 172.21.15.2:0/3286326094 >> 172.21.15.2:0/3286326094 conn(0x7f63d0077a00 msgr2=0x7f63d0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 -- 172.21.15.2:0/3286326094 shutdown_connections 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.703+0000 7f63d50e3640 1 -- 172.21.15.2:0/3286326094 wait complete. 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 Processor -- start 2024-08-31T04:25:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 -- start start 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d0101f90 0x7f63d00feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0108220 0x7f63d00ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63d0112760 con 0x7f63d01078d0 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63d01125e0 con 0x7f63d0108220 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.704+0000 7f63d50e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f63d01128e0 con 0x7f63d0101f90 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44554/0 (socket says 172.21.15.2:44554) 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 -- 172.21.15.2:0/3925598157 learned_addr learned my addr 172.21.15.2:0/3925598157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63cf59e640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0108220 0x7f63d00ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ced9d640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d0101f90 0x7f63d00feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 -- 172.21.15.2:0/3925598157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d0101f90 msgr2=0x7f63d00feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d0101f90 0x7f63d00feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 -- 172.21.15.2:0/3925598157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0108220 msgr2=0x7f63d00ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0108220 0x7f63d00ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 -- 172.21.15.2:0/3925598157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d01a8560 con 0x7f63d01078d0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63ce59c640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d750 tx=0x7f63b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8017070 con 0x7f63d01078d0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d01a8850 con 0x7f63d01078d0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.705+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b80054d0 con 0x7f63d01078d0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.706+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8004c30 con 0x7f63d01078d0 2024-08-31T04:25:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.706+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d01a8d90 con 0x7f63d01078d0 2024-08-31T04:25:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.707+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d01023a0 con 0x7f63d01078d0 2024-08-31T04:25:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.708+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f63b8004dd0 con 0x7f63d01078d0 2024-08-31T04:25:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.709+0000 7f63c7fff640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 0x7f63bc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.709+0000 7f63ced9d640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 0x7f63bc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.709+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f63b80e5020 con 0x7f63d01078d0 2024-08-31T04:25:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.709+0000 7f63ced9d640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 0x7f63bc0b7090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63d01005d0 tx=0x7f63c000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.713+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f63b80ab5c0 con 0x7f63d01078d0 2024-08-31T04:25:31.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.933+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f63b80a7850 con 0x7f63d01078d0 2024-08-31T04:25:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.940+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63d01a9020 con 0x7f63d01078d0 2024-08-31T04:25:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.941+0000 7f63c7fff640 1 -- 172.21.15.2:0/3925598157 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11897 (secure 0 0 0) 0x7f63b8097550 con 0x7f63d01078d0 2024-08-31T04:25:31.942 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:31.943 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-08-31T04:25:28:900170+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:25:28.432300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:25:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 msgr2=0x7f63bc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 0x7f63bc0b7090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63d01005d0 tx=0x7f63c000b390 comp rx=0 tx=0).stop 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 msgr2=0x7f63d00ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d750 tx=0x7f63b800dc10 comp rx=0 tx=0).stop 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 shutdown_connections 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f63bc0b4b80 0x7f63bc0b7090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63d01078d0 0x7f63d00ff0c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d0108220 0x7f63d00ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 --2- 172.21.15.2:0/3925598157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d0101f90 0x7f63d00feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.943+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 >> 172.21.15.2:0/3925598157 conn(0x7f63d0077a00 msgr2=0x7f63d0104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.944+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 shutdown_connections 2024-08-31T04:25:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:31.944+0000 7f63d50e3640 1 -- 172.21.15.2:0/3925598157 wait complete. 2024-08-31T04:25:32.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:31 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/64997940' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:25:32.320 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:31 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/64997940' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:25:32.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:31 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/64997940' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:25:32.645 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-31T04:25:32.645 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-31T04:25:32.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:25:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.766+0000 7efd86444640 1 -- 172.21.15.2:0/1974134751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075550 msgr2=0x7efd80075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.766+0000 7efd86444640 1 --2- 172.21.15.2:0/1974134751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075550 0x7efd80075960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efd70009900 tx=0x7efd7002a410 comp rx=0 tx=0).stop 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 -- 172.21.15.2:0/1974134751 shutdown_connections 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 --2- 172.21.15.2:0/1974134751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd8010fdd0 0x7efd80112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 --2- 172.21.15.2:0/1974134751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd80075ea0 0x7efd8010f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 --2- 172.21.15.2:0/1974134751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075550 0x7efd80075960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 -- 172.21.15.2:0/1974134751 >> 172.21.15.2:0/1974134751 conn(0x7efd800ff2a0 msgr2=0x7efd801016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 -- 172.21.15.2:0/1974134751 shutdown_connections 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 -- 172.21.15.2:0/1974134751 wait complete. 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 Processor -- start 2024-08-31T04:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.767+0000 7efd86444640 1 -- start start 2024-08-31T04:25:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 0x7efd8019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8010fdd0 0x7efd801a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd801159a0 con 0x7efd80075ea0 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efd80115820 con 0x7efd80075550 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd86444640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efd80115b20 con 0x7efd8010fdd0 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44572/0 (socket says 172.21.15.2:44572) 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1241507564 learned_addr learned my addr 172.21.15.2:0/1241507564 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7ffff640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 0x7efd8019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd849e1640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8010fdd0 0x7efd801a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1241507564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8010fdd0 msgr2=0x7efd801a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8010fdd0 0x7efd801a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1241507564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 msgr2=0x7efd8019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 0x7efd8019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1241507564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd801a2350 con 0x7efd80075ea0 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7ffff640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 0x7efd8019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efd7400c970 tx=0x7efd7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.768+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74007bb0 con 0x7efd80075ea0 2024-08-31T04:25:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.769+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd74007d50 con 0x7efd80075ea0 2024-08-31T04:25:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.769+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd801a2640 con 0x7efd80075ea0 2024-08-31T04:25:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.769+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7400f450 con 0x7efd80075ea0 2024-08-31T04:25:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.769+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd801a8dd0 con 0x7efd80075ea0 2024-08-31T04:25:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.770+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd80075960 con 0x7efd80075ea0 2024-08-31T04:25:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.771+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7efd74004eb0 con 0x7efd80075ea0 2024-08-31T04:25:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.772+0000 7efd7d7fa640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 0x7efd680b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.772+0000 7efd7ffff640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 0x7efd680b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.772+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7efd740e5a40 con 0x7efd80075ea0 2024-08-31T04:25:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.773+0000 7efd7ffff640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 0x7efd680b7120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efd70031440 tx=0x7efd70009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.775+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efd74014030 con 0x7efd80075ea0 2024-08-31T04:25:32.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.961+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd8010a010 con 0x7efd680b4c10 2024-08-31T04:25:32.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.967+0000 7efd7d7fa640 1 -- 172.21.15.2:0/1241507564 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340446 (secure 0 0 0) 0x7efd8010a010 con 0x7efd680b4c10 2024-08-31T04:25:32.972 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:25:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.970+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 msgr2=0x7efd680b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.970+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 0x7efd680b7120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efd70031440 tx=0x7efd70009680 comp rx=0 tx=0).stop 2024-08-31T04:25:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 msgr2=0x7efd8019c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efd7400c970 tx=0x7efd7400ce30 comp rx=0 tx=0).stop 2024-08-31T04:25:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 shutdown_connections 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efd680b4c10 0x7efd680b7120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80075ea0 0x7efd8019c9c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8010fdd0 0x7efd801a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 --2- 172.21.15.2:0/1241507564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd80075550 0x7efd8019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 >> 172.21.15.2:0/1241507564 conn(0x7efd800ff2a0 msgr2=0x7efd80109900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 shutdown_connections 2024-08-31T04:25:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:32.971+0000 7efd86444640 1 -- 172.21.15.2:0/1241507564 wait complete. 2024-08-31T04:25:32.984 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-08-31T04:25:31.115132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665156,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":769,"num_read_kb":494,"num_write":313,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":754,"ondisk_log_size":754,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404420,"kb_used_data":13572,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537404,"statfs":{"total":1151940427776,"available":1151526301696,"internally_reserved":0,"allocated":13897728,"data_stored":7969619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5013,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003262"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903785+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903785+0000","last_peered":"2024-08-31T04:24:34.903785+0000","last_clean":"2024-08-31T04:24:34.903785+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903785+0000","last_undegraded":"2024-08-31T04:24:34.903785+0000","last_fullsized":"2024-08-31T04:24:34.903785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468842+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:25:03.468842+0000","last_peered":"2024-08-31T04:25:03.468842+0000","last_clean":"2024-08-31T04:25:03.468842+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:25:03.468842+0000","last_undegraded":"2024-08-31T04:25:03.468842+0000","last_fullsized":"2024-08-31T04:25:03.468842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176789+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.176789+0000","last_peered":"2024-08-31T04:24:35.176789+0000","last_clean":"2024-08-31T04:24:35.176789+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.176789+0000","last_undegraded":"2024-08-31T04:24:35.176789+0000","last_fullsized":"2024-08-31T04:24:35.176789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924339+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:34.924339+0000","last_peered":"2024-08-31T04:24:34.924339+0000","last_clean":"2024-08-31T04:24:34.924339+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:34.924339+0000","last_undegraded":"2024-08-31T04:24:34.924339+0000","last_fullsized":"2024-08-31T04:24:34.924339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479409+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:25:03.479409+0000","last_peered":"2024-08-31T04:25:03.479409+0000","last_clean":"2024-08-31T04:25:03.479409+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:25:03.479409+0000","last_undegraded":"2024-08-31T04:25:03.479409+0000","last_fullsized":"2024-08-31T04:25:03.479409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901696+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901696+0000","last_peered":"2024-08-31T04:24:34.901696+0000","last_clean":"2024-08-31T04:24:34.901696+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901696+0000","last_undegraded":"2024-08-31T04:24:34.901696+0000","last_fullsized":"2024-08-31T04:24:34.901696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908022+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:34.908022+0000","last_peered":"2024-08-31T04:24:34.908022+0000","last_clean":"2024-08-31T04:24:34.908022+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:34.908022+0000","last_undegraded":"2024-08-31T04:24:34.908022+0000","last_fullsized":"2024-08-31T04:24:34.908022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.482868+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:25:03.482868+0000","last_peered":"2024-08-31T04:25:03.482868+0000","last_clean":"2024-08-31T04:25:03.482868+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:25:03.482868+0000","last_undegraded":"2024-08-31T04:25:03.482868+0000","last_fullsized":"2024-08-31T04:25:03.482868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907899+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:34.907899+0000","last_peered":"2024-08-31T04:24:34.907899+0000","last_clean":"2024-08-31T04:24:34.907899+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:34.907899+0000","last_undegraded":"2024-08-31T04:24:34.907899+0000","last_fullsized":"2024-08-31T04:24:34.907899+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484908+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:25:03.484908+0000","last_peered":"2024-08-31T04:25:03.484908+0000","last_clean":"2024-08-31T04:25:03.484908+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:25:03.484908+0000","last_undegraded":"2024-08-31T04:25:03.484908+0000","last_fullsized":"2024-08-31T04:25:03.484908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485033+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:25:03.485033+0000","last_peered":"2024-08-31T04:25:03.485033+0000","last_clean":"2024-08-31T04:25:03.485033+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:25:03.485033+0000","last_undegraded":"2024-08-31T04:25:03.485033+0000","last_fullsized":"2024-08-31T04:25:03.485033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907541+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:34.907541+0000","last_peered":"2024-08-31T04:24:34.907541+0000","last_clean":"2024-08-31T04:24:34.907541+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:34.907541+0000","last_undegraded":"2024-08-31T04:24:34.907541+0000","last_fullsized":"2024-08-31T04:24:34.907541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902968+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902968+0000","last_peered":"2024-08-31T04:24:34.902968+0000","last_clean":"2024-08-31T04:24:34.902968+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902968+0000","last_undegraded":"2024-08-31T04:24:34.902968+0000","last_fullsized":"2024-08-31T04:24:34.902968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480703+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:25:03.480703+0000","last_peered":"2024-08-31T04:25:03.480703+0000","last_clean":"2024-08-31T04:25:03.480703+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:25:03.480703+0000","last_undegraded":"2024-08-31T04:25:03.480703+0000","last_fullsized":"2024-08-31T04:25:03.480703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903443+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903443+0000","last_peered":"2024-08-31T04:24:34.903443+0000","last_clean":"2024-08-31T04:24:34.903443+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903443+0000","last_undegraded":"2024-08-31T04:24:34.903443+0000","last_fullsized":"2024-08-31T04:24:34.903443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902803+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902803+0000","last_peered":"2024-08-31T04:24:34.902803+0000","last_clean":"2024-08-31T04:24:34.902803+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902803+0000","last_undegraded":"2024-08-31T04:24:34.902803+0000","last_fullsized":"2024-08-31T04:24:34.902803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474064+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:25:03.474064+0000","last_peered":"2024-08-31T04:25:03.474064+0000","last_clean":"2024-08-31T04:25:03.474064+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:25:03.474064+0000","last_undegraded":"2024-08-31T04:25:03.474064+0000","last_fullsized":"2024-08-31T04:25:03.474064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924564+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:34.924564+0000","last_peered":"2024-08-31T04:24:34.924564+0000","last_clean":"2024-08-31T04:24:34.924564+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:34.924564+0000","last_undegraded":"2024-08-31T04:24:34.924564+0000","last_fullsized":"2024-08-31T04:24:34.924564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903374+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903374+0000","last_peered":"2024-08-31T04:24:34.903374+0000","last_clean":"2024-08-31T04:24:34.903374+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903374+0000","last_undegraded":"2024-08-31T04:24:34.903374+0000","last_fullsized":"2024-08-31T04:24:34.903374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474353+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:25:03.474353+0000","last_peered":"2024-08-31T04:25:03.474353+0000","last_clean":"2024-08-31T04:25:03.474353+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:25:03.474353+0000","last_undegraded":"2024-08-31T04:25:03.474353+0000","last_fullsized":"2024-08-31T04:25:03.474353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903947+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903947+0000","last_peered":"2024-08-31T04:24:34.903947+0000","last_clean":"2024-08-31T04:24:34.903947+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903947+0000","last_undegraded":"2024-08-31T04:24:34.903947+0000","last_fullsized":"2024-08-31T04:24:34.903947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902552+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902552+0000","last_peered":"2024-08-31T04:24:34.902552+0000","last_clean":"2024-08-31T04:24:34.902552+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902552+0000","last_undegraded":"2024-08-31T04:24:34.902552+0000","last_fullsized":"2024-08-31T04:24:34.902552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472917+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:25:03.472917+0000","last_peered":"2024-08-31T04:25:03.472917+0000","last_clean":"2024-08-31T04:25:03.472917+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:25:03.472917+0000","last_undegraded":"2024-08-31T04:25:03.472917+0000","last_fullsized":"2024-08-31T04:25:03.472917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903222+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903222+0000","last_peered":"2024-08-31T04:24:34.903222+0000","last_clean":"2024-08-31T04:24:34.903222+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903222+0000","last_undegraded":"2024-08-31T04:24:34.903222+0000","last_fullsized":"2024-08-31T04:24:34.903222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903900+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903900+0000","last_peered":"2024-08-31T04:24:34.903900+0000","last_clean":"2024-08-31T04:24:34.903900+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903900+0000","last_undegraded":"2024-08-31T04:24:34.903900+0000","last_fullsized":"2024-08-31T04:24:34.903900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477135+0000","last_change":"2024-08-31T04:24:35.164680+0000","last_active":"2024-08-31T04:25:03.477135+0000","last_peered":"2024-08-31T04:25:03.477135+0000","last_clean":"2024-08-31T04:25:03.477135+0000","last_became_active":"2024-08-31T04:24:35.164257+0000","last_became_peered":"2024-08-31T04:24:35.164257+0000","last_unstale":"2024-08-31T04:25:03.477135+0000","last_undegraded":"2024-08-31T04:25:03.477135+0000","last_fullsized":"2024-08-31T04:25:03.477135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:26.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:05.131639+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:25:05.131639+0000","last_peered":"2024-08-31T04:25:05.131639+0000","last_clean":"2024-08-31T04:25:05.131639+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:25:05.131639+0000","last_undegraded":"2024-08-31T04:25:05.131639+0000","last_fullsized":"2024-08-31T04:25:05.131639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923635+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:34.923635+0000","last_peered":"2024-08-31T04:24:34.923635+0000","last_clean":"2024-08-31T04:24:34.923635+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:34.923635+0000","last_undegraded":"2024-08-31T04:24:34.923635+0000","last_fullsized":"2024-08-31T04:24:34.923635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459168+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:25:03.459168+0000","last_peered":"2024-08-31T04:25:03.459168+0000","last_clean":"2024-08-31T04:25:03.459168+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:25:03.459168+0000","last_undegraded":"2024-08-31T04:25:03.459168+0000","last_fullsized":"2024-08-31T04:25:03.459168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908166+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:34.908166+0000","last_peered":"2024-08-31T04:24:34.908166+0000","last_clean":"2024-08-31T04:24:34.908166+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:34.908166+0000","last_undegraded":"2024-08-31T04:24:34.908166+0000","last_fullsized":"2024-08-31T04:24:34.908166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065415+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065415+0000","last_peered":"2024-08-31T04:24:35.065415+0000","last_clean":"2024-08-31T04:24:35.065415+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065415+0000","last_undegraded":"2024-08-31T04:24:35.065415+0000","last_fullsized":"2024-08-31T04:24:35.065415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479172+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:25:03.479172+0000","last_peered":"2024-08-31T04:25:03.479172+0000","last_clean":"2024-08-31T04:25:03.479172+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:25:03.479172+0000","last_undegraded":"2024-08-31T04:25:03.479172+0000","last_fullsized":"2024-08-31T04:25:03.479172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903257+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903257+0000","last_peered":"2024-08-31T04:24:34.903257+0000","last_clean":"2024-08-31T04:24:34.903257+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903257+0000","last_undegraded":"2024-08-31T04:24:34.903257+0000","last_fullsized":"2024-08-31T04:24:34.903257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907840+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:34.907840+0000","last_peered":"2024-08-31T04:24:34.907840+0000","last_clean":"2024-08-31T04:24:34.907840+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:34.907840+0000","last_undegraded":"2024-08-31T04:24:34.907840+0000","last_fullsized":"2024-08-31T04:24:34.907840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474555+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:25:03.474555+0000","last_peered":"2024-08-31T04:25:03.474555+0000","last_clean":"2024-08-31T04:25:03.474555+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:25:03.474555+0000","last_undegraded":"2024-08-31T04:25:03.474555+0000","last_fullsized":"2024-08-31T04:25:03.474555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163392+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163392+0000","last_peered":"2024-08-31T04:24:35.163392+0000","last_clean":"2024-08-31T04:24:35.163392+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163392+0000","last_undegraded":"2024-08-31T04:24:35.163392+0000","last_fullsized":"2024-08-31T04:24:35.163392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899521+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899521+0000","last_peered":"2024-08-31T04:24:34.899521+0000","last_clean":"2024-08-31T04:24:34.899521+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899521+0000","last_undegraded":"2024-08-31T04:24:34.899521+0000","last_fullsized":"2024-08-31T04:24:34.899521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461723+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:25:03.461723+0000","last_peered":"2024-08-31T04:25:03.461723+0000","last_clean":"2024-08-31T04:25:03.461723+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:25:03.461723+0000","last_undegraded":"2024-08-31T04:25:03.461723+0000","last_fullsized":"2024-08-31T04:25:03.461723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:24.593821+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:25:24.593821+0000","last_peered":"2024-08-31T04:25:24.593821+0000","last_clean":"2024-08-31T04:25:24.593821+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:25:24.593821+0000","last_undegraded":"2024-08-31T04:25:24.593821+0000","last_fullsized":"2024-08-31T04:25:24.593821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899870+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899870+0000","last_peered":"2024-08-31T04:24:34.899870+0000","last_clean":"2024-08-31T04:24:34.899870+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899870+0000","last_undegraded":"2024-08-31T04:24:34.899870+0000","last_fullsized":"2024-08-31T04:24:34.899870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459548+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:25:03.459548+0000","last_peered":"2024-08-31T04:25:03.459548+0000","last_clean":"2024-08-31T04:25:03.459548+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:25:03.459548+0000","last_undegraded":"2024-08-31T04:25:03.459548+0000","last_fullsized":"2024-08-31T04:25:03.459548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163114+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.163114+0000","last_peered":"2024-08-31T04:24:35.163114+0000","last_clean":"2024-08-31T04:24:35.163114+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.163114+0000","last_undegraded":"2024-08-31T04:24:35.163114+0000","last_fullsized":"2024-08-31T04:24:35.163114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902488+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902488+0000","last_peered":"2024-08-31T04:24:34.902488+0000","last_clean":"2024-08-31T04:24:34.902488+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902488+0000","last_undegraded":"2024-08-31T04:24:34.902488+0000","last_fullsized":"2024-08-31T04:24:34.902488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473210+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:25:03.473210+0000","last_peered":"2024-08-31T04:25:03.473210+0000","last_clean":"2024-08-31T04:25:03.473210+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:25:03.473210+0000","last_undegraded":"2024-08-31T04:25:03.473210+0000","last_fullsized":"2024-08-31T04:25:03.473210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902666+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902666+0000","last_peered":"2024-08-31T04:24:34.902666+0000","last_clean":"2024-08-31T04:24:34.902666+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902666+0000","last_undegraded":"2024-08-31T04:24:34.902666+0000","last_fullsized":"2024-08-31T04:24:34.902666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163170+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.163170+0000","last_peered":"2024-08-31T04:24:35.163170+0000","last_clean":"2024-08-31T04:24:35.163170+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.163170+0000","last_undegraded":"2024-08-31T04:24:35.163170+0000","last_fullsized":"2024-08-31T04:24:35.163170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485120+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:25:03.485120+0000","last_peered":"2024-08-31T04:25:03.485120+0000","last_clean":"2024-08-31T04:25:03.485120+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:25:03.485120+0000","last_undegraded":"2024-08-31T04:25:03.485120+0000","last_fullsized":"2024-08-31T04:25:03.485120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904255+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904255+0000","last_peered":"2024-08-31T04:24:34.904255+0000","last_clean":"2024-08-31T04:24:34.904255+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904255+0000","last_undegraded":"2024-08-31T04:24:34.904255+0000","last_fullsized":"2024-08-31T04:24:34.904255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481332+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:25:03.481332+0000","last_peered":"2024-08-31T04:25:03.481332+0000","last_clean":"2024-08-31T04:25:03.481332+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:25:03.481332+0000","last_undegraded":"2024-08-31T04:25:03.481332+0000","last_fullsized":"2024-08-31T04:25:03.481332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902533+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902533+0000","last_peered":"2024-08-31T04:24:34.902533+0000","last_clean":"2024-08-31T04:24:34.902533+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902533+0000","last_undegraded":"2024-08-31T04:24:34.902533+0000","last_fullsized":"2024-08-31T04:24:34.902533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175167+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175167+0000","last_peered":"2024-08-31T04:24:35.175167+0000","last_clean":"2024-08-31T04:24:35.175167+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175167+0000","last_undegraded":"2024-08-31T04:24:35.175167+0000","last_fullsized":"2024-08-31T04:24:35.175167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479384+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:25:03.479384+0000","last_peered":"2024-08-31T04:25:03.479384+0000","last_clean":"2024-08-31T04:25:03.479384+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:25:03.479384+0000","last_undegraded":"2024-08-31T04:25:03.479384+0000","last_fullsized":"2024-08-31T04:25:03.479384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899828+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899828+0000","last_peered":"2024-08-31T04:24:34.899828+0000","last_clean":"2024-08-31T04:24:34.899828+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899828+0000","last_undegraded":"2024-08-31T04:24:34.899828+0000","last_fullsized":"2024-08-31T04:24:34.899828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900651+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900651+0000","last_peered":"2024-08-31T04:24:34.900651+0000","last_clean":"2024-08-31T04:24:34.900651+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900651+0000","last_undegraded":"2024-08-31T04:24:34.900651+0000","last_fullsized":"2024-08-31T04:24:34.900651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463870+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:25:03.463870+0000","last_peered":"2024-08-31T04:25:03.463870+0000","last_clean":"2024-08-31T04:25:03.463870+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:25:03.463870+0000","last_undegraded":"2024-08-31T04:25:03.463870+0000","last_fullsized":"2024-08-31T04:25:03.463870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:14.103200+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:25:14.103200+0000","last_peered":"2024-08-31T04:25:14.103200+0000","last_clean":"2024-08-31T04:25:14.103200+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:25:14.103200+0000","last_undegraded":"2024-08-31T04:25:14.103200+0000","last_fullsized":"2024-08-31T04:25:14.103200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900799+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900799+0000","last_peered":"2024-08-31T04:24:34.900799+0000","last_clean":"2024-08-31T04:24:34.900799+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900799+0000","last_undegraded":"2024-08-31T04:24:34.900799+0000","last_fullsized":"2024-08-31T04:24:34.900799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484382+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:25:03.484382+0000","last_peered":"2024-08-31T04:25:03.484382+0000","last_clean":"2024-08-31T04:25:03.484382+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:25:03.484382+0000","last_undegraded":"2024-08-31T04:25:03.484382+0000","last_fullsized":"2024-08-31T04:25:03.484382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907149+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:34.907149+0000","last_peered":"2024-08-31T04:24:34.907149+0000","last_clean":"2024-08-31T04:24:34.907149+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:34.907149+0000","last_undegraded":"2024-08-31T04:24:34.907149+0000","last_fullsized":"2024-08-31T04:24:34.907149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899664+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899664+0000","last_peered":"2024-08-31T04:24:34.899664+0000","last_clean":"2024-08-31T04:24:34.899664+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899664+0000","last_undegraded":"2024-08-31T04:24:34.899664+0000","last_fullsized":"2024-08-31T04:24:34.899664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479625+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:25:03.479625+0000","last_peered":"2024-08-31T04:25:03.479625+0000","last_clean":"2024-08-31T04:25:03.479625+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:25:03.479625+0000","last_undegraded":"2024-08-31T04:25:03.479625+0000","last_fullsized":"2024-08-31T04:25:03.479625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:25.595843+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:25:25.595843+0000","last_peered":"2024-08-31T04:25:25.595843+0000","last_clean":"2024-08-31T04:25:25.595843+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:25:25.595843+0000","last_undegraded":"2024-08-31T04:25:25.595843+0000","last_fullsized":"2024-08-31T04:25:25.595843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176861+0000","last_change":"2024-08-31T04:24:35.176740+0000","last_active":"2024-08-31T04:24:35.176861+0000","last_peered":"2024-08-31T04:24:35.176861+0000","last_clean":"2024-08-31T04:24:35.176861+0000","last_became_active":"2024-08-31T04:24:35.176138+0000","last_became_peered":"2024-08-31T04:24:35.176138+0000","last_unstale":"2024-08-31T04:24:35.176861+0000","last_undegraded":"2024-08-31T04:24:35.176861+0000","last_fullsized":"2024-08-31T04:24:35.176861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:42:51.558180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480238+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:25:03.480238+0000","last_peered":"2024-08-31T04:25:03.480238+0000","last_clean":"2024-08-31T04:25:03.480238+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:25:03.480238+0000","last_undegraded":"2024-08-31T04:25:03.480238+0000","last_fullsized":"2024-08-31T04:25:03.480238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901364+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901364+0000","last_peered":"2024-08-31T04:24:34.901364+0000","last_clean":"2024-08-31T04:24:34.901364+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901364+0000","last_undegraded":"2024-08-31T04:24:34.901364+0000","last_fullsized":"2024-08-31T04:24:34.901364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065414+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065414+0000","last_peered":"2024-08-31T04:24:35.065414+0000","last_clean":"2024-08-31T04:24:35.065414+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065414+0000","last_undegraded":"2024-08-31T04:24:35.065414+0000","last_fullsized":"2024-08-31T04:24:35.065414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461236+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:25:03.461236+0000","last_peered":"2024-08-31T04:25:03.461236+0000","last_clean":"2024-08-31T04:25:03.461236+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:25:03.461236+0000","last_undegraded":"2024-08-31T04:25:03.461236+0000","last_fullsized":"2024-08-31T04:25:03.461236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903777+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903777+0000","last_peered":"2024-08-31T04:24:34.903777+0000","last_clean":"2024-08-31T04:24:34.903777+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903777+0000","last_undegraded":"2024-08-31T04:24:34.903777+0000","last_fullsized":"2024-08-31T04:24:34.903777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901998+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.901998+0000","last_peered":"2024-08-31T04:24:34.901998+0000","last_clean":"2024-08-31T04:24:34.901998+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.901998+0000","last_undegraded":"2024-08-31T04:24:34.901998+0000","last_fullsized":"2024-08-31T04:24:34.901998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.464574+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:25:03.464574+0000","last_peered":"2024-08-31T04:25:03.464574+0000","last_clean":"2024-08-31T04:25:03.464574+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:25:03.464574+0000","last_undegraded":"2024-08-31T04:25:03.464574+0000","last_fullsized":"2024-08-31T04:25:03.464574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'40","reported_seq":315,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.603977+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:25:30.603977+0000","last_peered":"2024-08-31T04:25:30.603977+0000","last_clean":"2024-08-31T04:25:30.603977+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:25:30.603977+0000","last_undegraded":"2024-08-31T04:25:30.603977+0000","last_fullsized":"2024-08-31T04:25:30.603977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69880,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":186,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903027+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.903027+0000","last_peered":"2024-08-31T04:24:34.903027+0000","last_clean":"2024-08-31T04:24:34.903027+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.903027+0000","last_undegraded":"2024-08-31T04:24:34.903027+0000","last_fullsized":"2024-08-31T04:24:34.903027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484812+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:25:03.484812+0000","last_peered":"2024-08-31T04:25:03.484812+0000","last_clean":"2024-08-31T04:25:03.484812+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:25:03.484812+0000","last_undegraded":"2024-08-31T04:25:03.484812+0000","last_fullsized":"2024-08-31T04:25:03.484812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902401+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902401+0000","last_peered":"2024-08-31T04:24:34.902401+0000","last_clean":"2024-08-31T04:24:34.902401+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902401+0000","last_undegraded":"2024-08-31T04:24:34.902401+0000","last_fullsized":"2024-08-31T04:24:34.902401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.178064+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.178064+0000","last_peered":"2024-08-31T04:24:35.178064+0000","last_clean":"2024-08-31T04:24:35.178064+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.178064+0000","last_undegraded":"2024-08-31T04:24:35.178064+0000","last_fullsized":"2024-08-31T04:24:35.178064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472597+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:25:03.472597+0000","last_peered":"2024-08-31T04:25:03.472597+0000","last_clean":"2024-08-31T04:25:03.472597+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:25:03.472597+0000","last_undegraded":"2024-08-31T04:25:03.472597+0000","last_fullsized":"2024-08-31T04:25:03.472597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163475+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163475+0000","last_peered":"2024-08-31T04:24:35.163475+0000","last_clean":"2024-08-31T04:24:35.163475+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163475+0000","last_undegraded":"2024-08-31T04:24:35.163475+0000","last_fullsized":"2024-08-31T04:24:35.163475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902756+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902756+0000","last_peered":"2024-08-31T04:24:34.902756+0000","last_clean":"2024-08-31T04:24:34.902756+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902756+0000","last_undegraded":"2024-08-31T04:24:34.902756+0000","last_fullsized":"2024-08-31T04:24:34.902756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483202+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:25:03.483202+0000","last_peered":"2024-08-31T04:25:03.483202+0000","last_clean":"2024-08-31T04:25:03.483202+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:25:03.483202+0000","last_undegraded":"2024-08-31T04:25:03.483202+0000","last_fullsized":"2024-08-31T04:25:03.483202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:29.601596+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:25:29.601596+0000","last_peered":"2024-08-31T04:25:29.601596+0000","last_clean":"2024-08-31T04:25:29.601596+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:25:29.601596+0000","last_undegraded":"2024-08-31T04:25:29.601596+0000","last_fullsized":"2024-08-31T04:25:29.601596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924327+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:34.924327+0000","last_peered":"2024-08-31T04:24:34.924327+0000","last_clean":"2024-08-31T04:24:34.924327+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:34.924327+0000","last_undegraded":"2024-08-31T04:24:34.924327+0000","last_fullsized":"2024-08-31T04:24:34.924327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175135+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175135+0000","last_peered":"2024-08-31T04:24:35.175135+0000","last_clean":"2024-08-31T04:24:35.175135+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175135+0000","last_undegraded":"2024-08-31T04:24:35.175135+0000","last_fullsized":"2024-08-31T04:24:35.175135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479015+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:25:03.479015+0000","last_peered":"2024-08-31T04:25:03.479015+0000","last_clean":"2024-08-31T04:25:03.479015+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:25:03.479015+0000","last_undegraded":"2024-08-31T04:25:03.479015+0000","last_fullsized":"2024-08-31T04:25:03.479015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901205+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901205+0000","last_peered":"2024-08-31T04:24:34.901205+0000","last_clean":"2024-08-31T04:24:34.901205+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901205+0000","last_undegraded":"2024-08-31T04:24:34.901205+0000","last_fullsized":"2024-08-31T04:24:34.901205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065887+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065887+0000","last_peered":"2024-08-31T04:24:35.065887+0000","last_clean":"2024-08-31T04:24:35.065887+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065887+0000","last_undegraded":"2024-08-31T04:24:35.065887+0000","last_fullsized":"2024-08-31T04:24:35.065887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468686+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:25:03.468686+0000","last_peered":"2024-08-31T04:25:03.468686+0000","last_clean":"2024-08-31T04:25:03.468686+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:25:03.468686+0000","last_undegraded":"2024-08-31T04:25:03.468686+0000","last_fullsized":"2024-08-31T04:25:03.468686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899205+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899205+0000","last_peered":"2024-08-31T04:24:34.899205+0000","last_clean":"2024-08-31T04:24:34.899205+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899205+0000","last_undegraded":"2024-08-31T04:24:34.899205+0000","last_fullsized":"2024-08-31T04:24:34.899205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175651+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175651+0000","last_peered":"2024-08-31T04:24:35.175651+0000","last_clean":"2024-08-31T04:24:35.175651+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175651+0000","last_undegraded":"2024-08-31T04:24:35.175651+0000","last_fullsized":"2024-08-31T04:24:35.175651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.475038+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:25:03.475038+0000","last_peered":"2024-08-31T04:25:03.475038+0000","last_clean":"2024-08-31T04:25:03.475038+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:25:03.475038+0000","last_undegraded":"2024-08-31T04:25:03.475038+0000","last_fullsized":"2024-08-31T04:25:03.475038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:26.597394+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:25:26.597394+0000","last_peered":"2024-08-31T04:25:26.597394+0000","last_clean":"2024-08-31T04:25:26.597394+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:25:26.597394+0000","last_undegraded":"2024-08-31T04:25:26.597394+0000","last_fullsized":"2024-08-31T04:25:26.597394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458136+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:25:03.458136+0000","last_peered":"2024-08-31T04:25:03.458136+0000","last_clean":"2024-08-31T04:25:03.458136+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:25:03.458136+0000","last_undegraded":"2024-08-31T04:25:03.458136+0000","last_fullsized":"2024-08-31T04:25:03.458136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473928+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:25:03.473928+0000","last_peered":"2024-08-31T04:25:03.473928+0000","last_clean":"2024-08-31T04:25:03.473928+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:25:03.473928+0000","last_undegraded":"2024-08-31T04:25:03.473928+0000","last_fullsized":"2024-08-31T04:25:03.473928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465376+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:25:03.465376+0000","last_peered":"2024-08-31T04:25:03.465376+0000","last_clean":"2024-08-31T04:25:03.465376+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:25:03.465376+0000","last_undegraded":"2024-08-31T04:25:03.465376+0000","last_fullsized":"2024-08-31T04:25:03.465376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467147+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:25:03.467147+0000","last_peered":"2024-08-31T04:25:03.467147+0000","last_clean":"2024-08-31T04:25:03.467147+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:25:03.467147+0000","last_undegraded":"2024-08-31T04:25:03.467147+0000","last_fullsized":"2024-08-31T04:25:03.467147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472966+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:25:03.472966+0000","last_peered":"2024-08-31T04:25:03.472966+0000","last_clean":"2024-08-31T04:25:03.472966+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:25:03.472966+0000","last_undegraded":"2024-08-31T04:25:03.472966+0000","last_fullsized":"2024-08-31T04:25:03.472966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465415+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:25:03.465415+0000","last_peered":"2024-08-31T04:25:03.465415+0000","last_clean":"2024-08-31T04:25:03.465415+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:25:03.465415+0000","last_undegraded":"2024-08-31T04:25:03.465415+0000","last_fullsized":"2024-08-31T04:25:03.465415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.469722+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:25:03.469722+0000","last_peered":"2024-08-31T04:25:03.469722+0000","last_clean":"2024-08-31T04:25:03.469722+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:25:03.469722+0000","last_undegraded":"2024-08-31T04:25:03.469722+0000","last_fullsized":"2024-08-31T04:25:03.469722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466083+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:25:03.466083+0000","last_peered":"2024-08-31T04:25:03.466083+0000","last_clean":"2024-08-31T04:25:03.466083+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:25:03.466083+0000","last_undegraded":"2024-08-31T04:25:03.466083+0000","last_fullsized":"2024-08-31T04:25:03.466083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462176+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:25:03.462176+0000","last_peered":"2024-08-31T04:25:03.462176+0000","last_clean":"2024-08-31T04:25:03.462176+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:25:03.462176+0000","last_undegraded":"2024-08-31T04:25:03.462176+0000","last_fullsized":"2024-08-31T04:25:03.462176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474651+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:25:03.474651+0000","last_peered":"2024-08-31T04:25:03.474651+0000","last_clean":"2024-08-31T04:25:03.474651+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:25:03.474651+0000","last_undegraded":"2024-08-31T04:25:03.474651+0000","last_fullsized":"2024-08-31T04:25:03.474651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471604+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:25:03.471604+0000","last_peered":"2024-08-31T04:25:03.471604+0000","last_clean":"2024-08-31T04:25:03.471604+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:25:03.471604+0000","last_undegraded":"2024-08-31T04:25:03.471604+0000","last_fullsized":"2024-08-31T04:25:03.471604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484840+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:25:03.484840+0000","last_peered":"2024-08-31T04:25:03.484840+0000","last_clean":"2024-08-31T04:25:03.484840+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:25:03.484840+0000","last_undegraded":"2024-08-31T04:25:03.484840+0000","last_fullsized":"2024-08-31T04:25:03.484840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466933+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:25:03.466933+0000","last_peered":"2024-08-31T04:25:03.466933+0000","last_clean":"2024-08-31T04:25:03.466933+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:25:03.466933+0000","last_undegraded":"2024-08-31T04:25:03.466933+0000","last_fullsized":"2024-08-31T04:25:03.466933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471944+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:25:03.471944+0000","last_peered":"2024-08-31T04:25:03.471944+0000","last_clean":"2024-08-31T04:25:03.471944+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:25:03.471944+0000","last_undegraded":"2024-08-31T04:25:03.471944+0000","last_fullsized":"2024-08-31T04:25:03.471944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461114+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:25:03.461114+0000","last_peered":"2024-08-31T04:25:03.461114+0000","last_clean":"2024-08-31T04:25:03.461114+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:25:03.461114+0000","last_undegraded":"2024-08-31T04:25:03.461114+0000","last_fullsized":"2024-08-31T04:25:03.461114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477404+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:25:03.477404+0000","last_peered":"2024-08-31T04:25:03.477404+0000","last_clean":"2024-08-31T04:25:03.477404+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:25:03.477404+0000","last_undegraded":"2024-08-31T04:25:03.477404+0000","last_fullsized":"2024-08-31T04:25:03.477404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485429+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:25:03.485429+0000","last_peered":"2024-08-31T04:25:03.485429+0000","last_clean":"2024-08-31T04:25:03.485429+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:25:03.485429+0000","last_undegraded":"2024-08-31T04:25:03.485429+0000","last_fullsized":"2024-08-31T04:25:03.485429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483639+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:25:03.483639+0000","last_peered":"2024-08-31T04:25:03.483639+0000","last_clean":"2024-08-31T04:25:03.483639+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:25:03.483639+0000","last_undegraded":"2024-08-31T04:25:03.483639+0000","last_fullsized":"2024-08-31T04:25:03.483639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467964+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:25:03.467964+0000","last_peered":"2024-08-31T04:25:03.467964+0000","last_clean":"2024-08-31T04:25:03.467964+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:25:03.467964+0000","last_undegraded":"2024-08-31T04:25:03.467964+0000","last_fullsized":"2024-08-31T04:25:03.467964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474975+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:25:03.474975+0000","last_peered":"2024-08-31T04:25:03.474975+0000","last_clean":"2024-08-31T04:25:03.474975+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:25:03.474975+0000","last_undegraded":"2024-08-31T04:25:03.474975+0000","last_fullsized":"2024-08-31T04:25:03.474975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473599+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:25:03.473599+0000","last_peered":"2024-08-31T04:25:03.473599+0000","last_clean":"2024-08-31T04:25:03.473599+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:25:03.473599+0000","last_undegraded":"2024-08-31T04:25:03.473599+0000","last_fullsized":"2024-08-31T04:25:03.473599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462005+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:25:03.462005+0000","last_peered":"2024-08-31T04:25:03.462005+0000","last_clean":"2024-08-31T04:25:03.462005+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:25:03.462005+0000","last_undegraded":"2024-08-31T04:25:03.462005+0000","last_fullsized":"2024-08-31T04:25:03.462005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484966+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:25:03.484966+0000","last_peered":"2024-08-31T04:25:03.484966+0000","last_clean":"2024-08-31T04:25:03.484966+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:25:03.484966+0000","last_undegraded":"2024-08-31T04:25:03.484966+0000","last_fullsized":"2024-08-31T04:25:03.484966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477868+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:25:03.477868+0000","last_peered":"2024-08-31T04:25:03.477868+0000","last_clean":"2024-08-31T04:25:03.477868+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:25:03.477868+0000","last_undegraded":"2024-08-31T04:25:03.477868+0000","last_fullsized":"2024-08-31T04:25:03.477868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484644+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:25:03.484644+0000","last_peered":"2024-08-31T04:25:03.484644+0000","last_clean":"2024-08-31T04:25:03.484644+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:25:03.484644+0000","last_undegraded":"2024-08-31T04:25:03.484644+0000","last_fullsized":"2024-08-31T04:25:03.484644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480788+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:25:03.480788+0000","last_peered":"2024-08-31T04:25:03.480788+0000","last_clean":"2024-08-31T04:25:03.480788+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:25:03.480788+0000","last_undegraded":"2024-08-31T04:25:03.480788+0000","last_fullsized":"2024-08-31T04:25:03.480788+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481754+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:25:03.481754+0000","last_peered":"2024-08-31T04:25:03.481754+0000","last_clean":"2024-08-31T04:25:03.481754+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:25:03.481754+0000","last_undegraded":"2024-08-31T04:25:03.481754+0000","last_fullsized":"2024-08-31T04:25:03.481754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480512+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:25:03.480512+0000","last_peered":"2024-08-31T04:25:03.480512+0000","last_clean":"2024-08-31T04:25:03.480512+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:25:03.480512+0000","last_undegraded":"2024-08-31T04:25:03.480512+0000","last_fullsized":"2024-08-31T04:25:03.480512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458917+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:25:03.458917+0000","last_peered":"2024-08-31T04:25:03.458917+0000","last_clean":"2024-08-31T04:25:03.458917+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:25:03.458917+0000","last_undegraded":"2024-08-31T04:25:03.458917+0000","last_fullsized":"2024-08-31T04:25:03.458917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463529+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:25:03.463529+0000","last_peered":"2024-08-31T04:25:03.463529+0000","last_clean":"2024-08-31T04:25:03.463529+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:25:03.463529+0000","last_undegraded":"2024-08-31T04:25:03.463529+0000","last_fullsized":"2024-08-31T04:25:03.463529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479776+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:25:03.479776+0000","last_peered":"2024-08-31T04:25:03.479776+0000","last_clean":"2024-08-31T04:25:03.479776+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:25:03.479776+0000","last_undegraded":"2024-08-31T04:25:03.479776+0000","last_fullsized":"2024-08-31T04:25:03.479776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471757+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:25:03.471757+0000","last_peered":"2024-08-31T04:25:03.471757+0000","last_clean":"2024-08-31T04:25:03.471757+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:25:03.471757+0000","last_undegraded":"2024-08-31T04:25:03.471757+0000","last_fullsized":"2024-08-31T04:25:03.471757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485086+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:25:03.485086+0000","last_peered":"2024-08-31T04:25:03.485086+0000","last_clean":"2024-08-31T04:25:03.485086+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:25:03.485086+0000","last_undegraded":"2024-08-31T04:25:03.485086+0000","last_fullsized":"2024-08-31T04:25:03.485086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74554,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":688,"num_read_kb":425,"num_write":188,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":214335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":501783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1671168,"data_stored":1158583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495681,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1585152,"data_stored":1096638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822730,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36904,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708248,"statfs":{"total":95995035648,"available":95957245952,"internally_reserved":0,"allocated":1597440,"data_stored":1092423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":502959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":496235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378713,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":560964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542237,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":561400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:25:33.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 -- 172.21.15.2:0/1105273403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4103860 msgr2=0x7effa4103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 --2- 172.21.15.2:0/1105273403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4103860 0x7effa4103c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009900 tx=0x7eff8c02a410 comp rx=0 tx=0).stop 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 -- 172.21.15.2:0/1105273403 shutdown_connections 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 --2- 172.21.15.2:0/1105273403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109ae0 0x7effa4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 --2- 172.21.15.2:0/1105273403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4109190 0x7effa41095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 --2- 172.21.15.2:0/1105273403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4103860 0x7effa4103c70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 -- 172.21.15.2:0/1105273403 >> 172.21.15.2:0/1105273403 conn(0x7effa40ff2e0 msgr2=0x7effa4101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 -- 172.21.15.2:0/1105273403 shutdown_connections 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.153+0000 7effa99cc640 1 -- 172.21.15.2:0/1105273403 wait complete. 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 Processor -- start 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 -- start start 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 0x7effa419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109190 0x7effa419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113790 con 0x7effa4109ae0 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113610 con 0x7effa4103860 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.154+0000 7effa99cc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113910 con 0x7effa4109190 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44588/0 (socket says 172.21.15.2:44588) 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 -- 172.21.15.2:0/1069830294 learned_addr learned my addr 172.21.15.2:0/1069830294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa27fc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109190 0x7effa419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 0x7effa419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 -- 172.21.15.2:0/1069830294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109190 msgr2=0x7effa419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109190 0x7effa419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 -- 172.21.15.2:0/1069830294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 msgr2=0x7effa419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 0x7effa419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 -- 172.21.15.2:0/1069830294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa41a0120 con 0x7effa4109ae0 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 0x7effa419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa37fe640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00cad0 tx=0x7eff9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00ae20 con 0x7effa4109ae0 2024-08-31T04:25:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9c005020 con 0x7effa4109ae0 2024-08-31T04:25:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa41a0410 con 0x7effa4109ae0 2024-08-31T04:25:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00f6b0 con 0x7effa4109ae0 2024-08-31T04:25:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.155+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa41a6ba0 con 0x7effa4109ae0 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.156+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa4103c70 con 0x7effa4109ae0 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.158+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7eff9c0051d0 con 0x7effa4109ae0 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.159+0000 7effa89ca640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 0x7eff900b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.159+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7eff9c0e5ce0 con 0x7effa4109ae0 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.159+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 0x7eff900b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.160+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 0x7eff900b7120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0096c0 tx=0x7eff8c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.162+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7eff9c014030 con 0x7effa4109ae0 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:32 smithi064 ceph-mon[22007]: pgmap v342: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:32 smithi064 ceph-mon[22007]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:32 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3925598157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:32 smithi132 ceph-mon[22335]: pgmap v342: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:32 smithi132 ceph-mon[22335]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T04:25:33.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:32 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3925598157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.343+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effa40635a0 con 0x7eff900b4c10 2024-08-31T04:25:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.349+0000 7effa89ca640 1 -- 172.21.15.2:0/1069830294 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340447 (secure 0 0 0) 0x7effa40635a0 con 0x7eff900b4c10 2024-08-31T04:25:33.354 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:25:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 msgr2=0x7eff900b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 0x7eff900b7120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0096c0 tx=0x7eff8c031400 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 msgr2=0x7effa419fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00cad0 tx=0x7eff9c00cf90 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 shutdown_connections 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7eff900b4c10 0x7eff900b7120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa4109ae0 0x7effa419fa20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effa4109190 0x7effa419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 --2- 172.21.15.2:0/1069830294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effa4103860 0x7effa419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 >> 172.21.15.2:0/1069830294 conn(0x7effa40ff2e0 msgr2=0x7effa4101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 shutdown_connections 2024-08-31T04:25:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.353+0000 7effa99cc640 1 -- 172.21.15.2:0/1069830294 wait complete. 2024-08-31T04:25:33.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:32 smithi002 ceph-mon[18656]: pgmap v342: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:25:33.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:32 smithi002 ceph-mon[18656]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T04:25:33.365 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:32 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3925598157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:33.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-08-31T04:25:33.115644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665855,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":786,"num_read_kb":501,"num_write":316,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404428,"kb_used_data":13580,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537396,"statfs":{"total":1151940427776,"available":1151526293504,"internally_reserved":0,"allocated":13905920,"data_stored":7981043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5712,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003289"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903785+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903785+0000","last_peered":"2024-08-31T04:24:34.903785+0000","last_clean":"2024-08-31T04:24:34.903785+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903785+0000","last_undegraded":"2024-08-31T04:24:34.903785+0000","last_fullsized":"2024-08-31T04:24:34.903785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468842+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:25:03.468842+0000","last_peered":"2024-08-31T04:25:03.468842+0000","last_clean":"2024-08-31T04:25:03.468842+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:25:03.468842+0000","last_undegraded":"2024-08-31T04:25:03.468842+0000","last_fullsized":"2024-08-31T04:25:03.468842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177304+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.177304+0000","last_peered":"2024-08-31T04:24:35.177304+0000","last_clean":"2024-08-31T04:24:35.177304+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.177304+0000","last_undegraded":"2024-08-31T04:24:35.177304+0000","last_fullsized":"2024-08-31T04:24:35.177304+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924339+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:34.924339+0000","last_peered":"2024-08-31T04:24:34.924339+0000","last_clean":"2024-08-31T04:24:34.924339+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:34.924339+0000","last_undegraded":"2024-08-31T04:24:34.924339+0000","last_fullsized":"2024-08-31T04:24:34.924339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479409+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:25:03.479409+0000","last_peered":"2024-08-31T04:25:03.479409+0000","last_clean":"2024-08-31T04:25:03.479409+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:25:03.479409+0000","last_undegraded":"2024-08-31T04:25:03.479409+0000","last_fullsized":"2024-08-31T04:25:03.479409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901802+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901802+0000","last_peered":"2024-08-31T04:24:34.901802+0000","last_clean":"2024-08-31T04:24:34.901802+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901802+0000","last_undegraded":"2024-08-31T04:24:34.901802+0000","last_fullsized":"2024-08-31T04:24:34.901802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908022+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:34.908022+0000","last_peered":"2024-08-31T04:24:34.908022+0000","last_clean":"2024-08-31T04:24:34.908022+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:34.908022+0000","last_undegraded":"2024-08-31T04:24:34.908022+0000","last_fullsized":"2024-08-31T04:24:34.908022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.482868+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:25:03.482868+0000","last_peered":"2024-08-31T04:25:03.482868+0000","last_clean":"2024-08-31T04:25:03.482868+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:25:03.482868+0000","last_undegraded":"2024-08-31T04:25:03.482868+0000","last_fullsized":"2024-08-31T04:25:03.482868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907899+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:34.907899+0000","last_peered":"2024-08-31T04:24:34.907899+0000","last_clean":"2024-08-31T04:24:34.907899+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:34.907899+0000","last_undegraded":"2024-08-31T04:24:34.907899+0000","last_fullsized":"2024-08-31T04:24:34.907899+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484908+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:25:03.484908+0000","last_peered":"2024-08-31T04:25:03.484908+0000","last_clean":"2024-08-31T04:25:03.484908+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:25:03.484908+0000","last_undegraded":"2024-08-31T04:25:03.484908+0000","last_fullsized":"2024-08-31T04:25:03.484908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485033+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:25:03.485033+0000","last_peered":"2024-08-31T04:25:03.485033+0000","last_clean":"2024-08-31T04:25:03.485033+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:25:03.485033+0000","last_undegraded":"2024-08-31T04:25:03.485033+0000","last_fullsized":"2024-08-31T04:25:03.485033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907541+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:34.907541+0000","last_peered":"2024-08-31T04:24:34.907541+0000","last_clean":"2024-08-31T04:24:34.907541+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:34.907541+0000","last_undegraded":"2024-08-31T04:24:34.907541+0000","last_fullsized":"2024-08-31T04:24:34.907541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902968+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902968+0000","last_peered":"2024-08-31T04:24:34.902968+0000","last_clean":"2024-08-31T04:24:34.902968+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902968+0000","last_undegraded":"2024-08-31T04:24:34.902968+0000","last_fullsized":"2024-08-31T04:24:34.902968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480703+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:25:03.480703+0000","last_peered":"2024-08-31T04:25:03.480703+0000","last_clean":"2024-08-31T04:25:03.480703+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:25:03.480703+0000","last_undegraded":"2024-08-31T04:25:03.480703+0000","last_fullsized":"2024-08-31T04:25:03.480703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903443+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903443+0000","last_peered":"2024-08-31T04:24:34.903443+0000","last_clean":"2024-08-31T04:24:34.903443+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903443+0000","last_undegraded":"2024-08-31T04:24:34.903443+0000","last_fullsized":"2024-08-31T04:24:34.903443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902803+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902803+0000","last_peered":"2024-08-31T04:24:34.902803+0000","last_clean":"2024-08-31T04:24:34.902803+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902803+0000","last_undegraded":"2024-08-31T04:24:34.902803+0000","last_fullsized":"2024-08-31T04:24:34.902803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474064+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:25:03.474064+0000","last_peered":"2024-08-31T04:25:03.474064+0000","last_clean":"2024-08-31T04:25:03.474064+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:25:03.474064+0000","last_undegraded":"2024-08-31T04:25:03.474064+0000","last_fullsized":"2024-08-31T04:25:03.474064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924564+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:34.924564+0000","last_peered":"2024-08-31T04:24:34.924564+0000","last_clean":"2024-08-31T04:24:34.924564+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:34.924564+0000","last_undegraded":"2024-08-31T04:24:34.924564+0000","last_fullsized":"2024-08-31T04:24:34.924564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903374+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903374+0000","last_peered":"2024-08-31T04:24:34.903374+0000","last_clean":"2024-08-31T04:24:34.903374+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903374+0000","last_undegraded":"2024-08-31T04:24:34.903374+0000","last_fullsized":"2024-08-31T04:24:34.903374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474353+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:25:03.474353+0000","last_peered":"2024-08-31T04:25:03.474353+0000","last_clean":"2024-08-31T04:25:03.474353+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:25:03.474353+0000","last_undegraded":"2024-08-31T04:25:03.474353+0000","last_fullsized":"2024-08-31T04:25:03.474353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903947+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903947+0000","last_peered":"2024-08-31T04:24:34.903947+0000","last_clean":"2024-08-31T04:24:34.903947+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903947+0000","last_undegraded":"2024-08-31T04:24:34.903947+0000","last_fullsized":"2024-08-31T04:24:34.903947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902552+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902552+0000","last_peered":"2024-08-31T04:24:34.902552+0000","last_clean":"2024-08-31T04:24:34.902552+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902552+0000","last_undegraded":"2024-08-31T04:24:34.902552+0000","last_fullsized":"2024-08-31T04:24:34.902552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472917+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:25:03.472917+0000","last_peered":"2024-08-31T04:25:03.472917+0000","last_clean":"2024-08-31T04:25:03.472917+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:25:03.472917+0000","last_undegraded":"2024-08-31T04:25:03.472917+0000","last_fullsized":"2024-08-31T04:25:03.472917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903222+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903222+0000","last_peered":"2024-08-31T04:24:34.903222+0000","last_clean":"2024-08-31T04:24:34.903222+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903222+0000","last_undegraded":"2024-08-31T04:24:34.903222+0000","last_fullsized":"2024-08-31T04:24:34.903222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903900+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903900+0000","last_peered":"2024-08-31T04:24:34.903900+0000","last_clean":"2024-08-31T04:24:34.903900+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903900+0000","last_undegraded":"2024-08-31T04:24:34.903900+0000","last_fullsized":"2024-08-31T04:24:34.903900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477135+0000","last_change":"2024-08-31T04:24:35.164680+0000","last_active":"2024-08-31T04:25:03.477135+0000","last_peered":"2024-08-31T04:25:03.477135+0000","last_clean":"2024-08-31T04:25:03.477135+0000","last_became_active":"2024-08-31T04:24:35.164257+0000","last_became_peered":"2024-08-31T04:24:35.164257+0000","last_unstale":"2024-08-31T04:25:03.477135+0000","last_undegraded":"2024-08-31T04:25:03.477135+0000","last_fullsized":"2024-08-31T04:25:03.477135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:26.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:05.131639+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:25:05.131639+0000","last_peered":"2024-08-31T04:25:05.131639+0000","last_clean":"2024-08-31T04:25:05.131639+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:25:05.131639+0000","last_undegraded":"2024-08-31T04:25:05.131639+0000","last_fullsized":"2024-08-31T04:25:05.131639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923635+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:34.923635+0000","last_peered":"2024-08-31T04:24:34.923635+0000","last_clean":"2024-08-31T04:24:34.923635+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:34.923635+0000","last_undegraded":"2024-08-31T04:24:34.923635+0000","last_fullsized":"2024-08-31T04:24:34.923635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459168+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:25:03.459168+0000","last_peered":"2024-08-31T04:25:03.459168+0000","last_clean":"2024-08-31T04:25:03.459168+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:25:03.459168+0000","last_undegraded":"2024-08-31T04:25:03.459168+0000","last_fullsized":"2024-08-31T04:25:03.459168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908166+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:34.908166+0000","last_peered":"2024-08-31T04:24:34.908166+0000","last_clean":"2024-08-31T04:24:34.908166+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:34.908166+0000","last_undegraded":"2024-08-31T04:24:34.908166+0000","last_fullsized":"2024-08-31T04:24:34.908166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065415+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065415+0000","last_peered":"2024-08-31T04:24:35.065415+0000","last_clean":"2024-08-31T04:24:35.065415+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065415+0000","last_undegraded":"2024-08-31T04:24:35.065415+0000","last_fullsized":"2024-08-31T04:24:35.065415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479172+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:25:03.479172+0000","last_peered":"2024-08-31T04:25:03.479172+0000","last_clean":"2024-08-31T04:25:03.479172+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:25:03.479172+0000","last_undegraded":"2024-08-31T04:25:03.479172+0000","last_fullsized":"2024-08-31T04:25:03.479172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903257+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903257+0000","last_peered":"2024-08-31T04:24:34.903257+0000","last_clean":"2024-08-31T04:24:34.903257+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903257+0000","last_undegraded":"2024-08-31T04:24:34.903257+0000","last_fullsized":"2024-08-31T04:24:34.903257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907840+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:34.907840+0000","last_peered":"2024-08-31T04:24:34.907840+0000","last_clean":"2024-08-31T04:24:34.907840+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:34.907840+0000","last_undegraded":"2024-08-31T04:24:34.907840+0000","last_fullsized":"2024-08-31T04:24:34.907840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474555+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:25:03.474555+0000","last_peered":"2024-08-31T04:25:03.474555+0000","last_clean":"2024-08-31T04:25:03.474555+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:25:03.474555+0000","last_undegraded":"2024-08-31T04:25:03.474555+0000","last_fullsized":"2024-08-31T04:25:03.474555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163392+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163392+0000","last_peered":"2024-08-31T04:24:35.163392+0000","last_clean":"2024-08-31T04:24:35.163392+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163392+0000","last_undegraded":"2024-08-31T04:24:35.163392+0000","last_fullsized":"2024-08-31T04:24:35.163392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899521+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899521+0000","last_peered":"2024-08-31T04:24:34.899521+0000","last_clean":"2024-08-31T04:24:34.899521+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899521+0000","last_undegraded":"2024-08-31T04:24:34.899521+0000","last_fullsized":"2024-08-31T04:24:34.899521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461723+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:25:03.461723+0000","last_peered":"2024-08-31T04:25:03.461723+0000","last_clean":"2024-08-31T04:25:03.461723+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:25:03.461723+0000","last_undegraded":"2024-08-31T04:25:03.461723+0000","last_fullsized":"2024-08-31T04:25:03.461723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:29.602089+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:25:29.602089+0000","last_peered":"2024-08-31T04:25:29.602089+0000","last_clean":"2024-08-31T04:25:29.602089+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:25:29.602089+0000","last_undegraded":"2024-08-31T04:25:29.602089+0000","last_fullsized":"2024-08-31T04:25:29.602089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899870+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899870+0000","last_peered":"2024-08-31T04:24:34.899870+0000","last_clean":"2024-08-31T04:24:34.899870+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899870+0000","last_undegraded":"2024-08-31T04:24:34.899870+0000","last_fullsized":"2024-08-31T04:24:34.899870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459548+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:25:03.459548+0000","last_peered":"2024-08-31T04:25:03.459548+0000","last_clean":"2024-08-31T04:25:03.459548+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:25:03.459548+0000","last_undegraded":"2024-08-31T04:25:03.459548+0000","last_fullsized":"2024-08-31T04:25:03.459548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163114+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.163114+0000","last_peered":"2024-08-31T04:24:35.163114+0000","last_clean":"2024-08-31T04:24:35.163114+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.163114+0000","last_undegraded":"2024-08-31T04:24:35.163114+0000","last_fullsized":"2024-08-31T04:24:35.163114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902488+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902488+0000","last_peered":"2024-08-31T04:24:34.902488+0000","last_clean":"2024-08-31T04:24:34.902488+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902488+0000","last_undegraded":"2024-08-31T04:24:34.902488+0000","last_fullsized":"2024-08-31T04:24:34.902488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473210+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:25:03.473210+0000","last_peered":"2024-08-31T04:25:03.473210+0000","last_clean":"2024-08-31T04:25:03.473210+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:25:03.473210+0000","last_undegraded":"2024-08-31T04:25:03.473210+0000","last_fullsized":"2024-08-31T04:25:03.473210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902666+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902666+0000","last_peered":"2024-08-31T04:24:34.902666+0000","last_clean":"2024-08-31T04:24:34.902666+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902666+0000","last_undegraded":"2024-08-31T04:24:34.902666+0000","last_fullsized":"2024-08-31T04:24:34.902666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163170+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.163170+0000","last_peered":"2024-08-31T04:24:35.163170+0000","last_clean":"2024-08-31T04:24:35.163170+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.163170+0000","last_undegraded":"2024-08-31T04:24:35.163170+0000","last_fullsized":"2024-08-31T04:24:35.163170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485120+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:25:03.485120+0000","last_peered":"2024-08-31T04:25:03.485120+0000","last_clean":"2024-08-31T04:25:03.485120+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:25:03.485120+0000","last_undegraded":"2024-08-31T04:25:03.485120+0000","last_fullsized":"2024-08-31T04:25:03.485120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904255+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904255+0000","last_peered":"2024-08-31T04:24:34.904255+0000","last_clean":"2024-08-31T04:24:34.904255+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904255+0000","last_undegraded":"2024-08-31T04:24:34.904255+0000","last_fullsized":"2024-08-31T04:24:34.904255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481332+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:25:03.481332+0000","last_peered":"2024-08-31T04:25:03.481332+0000","last_clean":"2024-08-31T04:25:03.481332+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:25:03.481332+0000","last_undegraded":"2024-08-31T04:25:03.481332+0000","last_fullsized":"2024-08-31T04:25:03.481332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902533+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902533+0000","last_peered":"2024-08-31T04:24:34.902533+0000","last_clean":"2024-08-31T04:24:34.902533+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902533+0000","last_undegraded":"2024-08-31T04:24:34.902533+0000","last_fullsized":"2024-08-31T04:24:34.902533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175167+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175167+0000","last_peered":"2024-08-31T04:24:35.175167+0000","last_clean":"2024-08-31T04:24:35.175167+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175167+0000","last_undegraded":"2024-08-31T04:24:35.175167+0000","last_fullsized":"2024-08-31T04:24:35.175167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479384+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:25:03.479384+0000","last_peered":"2024-08-31T04:25:03.479384+0000","last_clean":"2024-08-31T04:25:03.479384+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:25:03.479384+0000","last_undegraded":"2024-08-31T04:25:03.479384+0000","last_fullsized":"2024-08-31T04:25:03.479384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899828+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899828+0000","last_peered":"2024-08-31T04:24:34.899828+0000","last_clean":"2024-08-31T04:24:34.899828+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899828+0000","last_undegraded":"2024-08-31T04:24:34.899828+0000","last_fullsized":"2024-08-31T04:24:34.899828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900651+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900651+0000","last_peered":"2024-08-31T04:24:34.900651+0000","last_clean":"2024-08-31T04:24:34.900651+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900651+0000","last_undegraded":"2024-08-31T04:24:34.900651+0000","last_fullsized":"2024-08-31T04:24:34.900651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463870+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:25:03.463870+0000","last_peered":"2024-08-31T04:25:03.463870+0000","last_clean":"2024-08-31T04:25:03.463870+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:25:03.463870+0000","last_undegraded":"2024-08-31T04:25:03.463870+0000","last_fullsized":"2024-08-31T04:25:03.463870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:14.103200+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:25:14.103200+0000","last_peered":"2024-08-31T04:25:14.103200+0000","last_clean":"2024-08-31T04:25:14.103200+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:25:14.103200+0000","last_undegraded":"2024-08-31T04:25:14.103200+0000","last_fullsized":"2024-08-31T04:25:14.103200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900799+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900799+0000","last_peered":"2024-08-31T04:24:34.900799+0000","last_clean":"2024-08-31T04:24:34.900799+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900799+0000","last_undegraded":"2024-08-31T04:24:34.900799+0000","last_fullsized":"2024-08-31T04:24:34.900799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484382+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:25:03.484382+0000","last_peered":"2024-08-31T04:25:03.484382+0000","last_clean":"2024-08-31T04:25:03.484382+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:25:03.484382+0000","last_undegraded":"2024-08-31T04:25:03.484382+0000","last_fullsized":"2024-08-31T04:25:03.484382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907149+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:34.907149+0000","last_peered":"2024-08-31T04:24:34.907149+0000","last_clean":"2024-08-31T04:24:34.907149+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:34.907149+0000","last_undegraded":"2024-08-31T04:24:34.907149+0000","last_fullsized":"2024-08-31T04:24:34.907149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899738+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899738+0000","last_peered":"2024-08-31T04:24:34.899738+0000","last_clean":"2024-08-31T04:24:34.899738+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899738+0000","last_undegraded":"2024-08-31T04:24:34.899738+0000","last_fullsized":"2024-08-31T04:24:34.899738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479625+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:25:03.479625+0000","last_peered":"2024-08-31T04:25:03.479625+0000","last_clean":"2024-08-31T04:25:03.479625+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:25:03.479625+0000","last_undegraded":"2024-08-31T04:25:03.479625+0000","last_fullsized":"2024-08-31T04:25:03.479625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.604326+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:25:30.604326+0000","last_peered":"2024-08-31T04:25:30.604326+0000","last_clean":"2024-08-31T04:25:30.604326+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:25:30.604326+0000","last_undegraded":"2024-08-31T04:25:30.604326+0000","last_fullsized":"2024-08-31T04:25:30.604326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176861+0000","last_change":"2024-08-31T04:24:35.176740+0000","last_active":"2024-08-31T04:24:35.176861+0000","last_peered":"2024-08-31T04:24:35.176861+0000","last_clean":"2024-08-31T04:24:35.176861+0000","last_became_active":"2024-08-31T04:24:35.176138+0000","last_became_peered":"2024-08-31T04:24:35.176138+0000","last_unstale":"2024-08-31T04:24:35.176861+0000","last_undegraded":"2024-08-31T04:24:35.176861+0000","last_fullsized":"2024-08-31T04:24:35.176861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:42:51.558180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480238+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:25:03.480238+0000","last_peered":"2024-08-31T04:25:03.480238+0000","last_clean":"2024-08-31T04:25:03.480238+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:25:03.480238+0000","last_undegraded":"2024-08-31T04:25:03.480238+0000","last_fullsized":"2024-08-31T04:25:03.480238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901364+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901364+0000","last_peered":"2024-08-31T04:24:34.901364+0000","last_clean":"2024-08-31T04:24:34.901364+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901364+0000","last_undegraded":"2024-08-31T04:24:34.901364+0000","last_fullsized":"2024-08-31T04:24:34.901364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065414+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065414+0000","last_peered":"2024-08-31T04:24:35.065414+0000","last_clean":"2024-08-31T04:24:35.065414+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065414+0000","last_undegraded":"2024-08-31T04:24:35.065414+0000","last_fullsized":"2024-08-31T04:24:35.065414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461236+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:25:03.461236+0000","last_peered":"2024-08-31T04:25:03.461236+0000","last_clean":"2024-08-31T04:25:03.461236+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:25:03.461236+0000","last_undegraded":"2024-08-31T04:25:03.461236+0000","last_fullsized":"2024-08-31T04:25:03.461236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903777+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903777+0000","last_peered":"2024-08-31T04:24:34.903777+0000","last_clean":"2024-08-31T04:24:34.903777+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903777+0000","last_undegraded":"2024-08-31T04:24:34.903777+0000","last_fullsized":"2024-08-31T04:24:34.903777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902055+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.902055+0000","last_peered":"2024-08-31T04:24:34.902055+0000","last_clean":"2024-08-31T04:24:34.902055+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.902055+0000","last_undegraded":"2024-08-31T04:24:34.902055+0000","last_fullsized":"2024-08-31T04:24:34.902055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.464574+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:25:03.464574+0000","last_peered":"2024-08-31T04:25:03.464574+0000","last_clean":"2024-08-31T04:25:03.464574+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:25:03.464574+0000","last_undegraded":"2024-08-31T04:25:03.464574+0000","last_fullsized":"2024-08-31T04:25:03.464574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'40","reported_seq":315,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.603977+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:25:30.603977+0000","last_peered":"2024-08-31T04:25:30.603977+0000","last_clean":"2024-08-31T04:25:30.603977+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:25:30.603977+0000","last_undegraded":"2024-08-31T04:25:30.603977+0000","last_fullsized":"2024-08-31T04:25:30.603977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69880,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":186,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903027+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.903027+0000","last_peered":"2024-08-31T04:24:34.903027+0000","last_clean":"2024-08-31T04:24:34.903027+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.903027+0000","last_undegraded":"2024-08-31T04:24:34.903027+0000","last_fullsized":"2024-08-31T04:24:34.903027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484812+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:25:03.484812+0000","last_peered":"2024-08-31T04:25:03.484812+0000","last_clean":"2024-08-31T04:25:03.484812+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:25:03.484812+0000","last_undegraded":"2024-08-31T04:25:03.484812+0000","last_fullsized":"2024-08-31T04:25:03.484812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902401+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902401+0000","last_peered":"2024-08-31T04:24:34.902401+0000","last_clean":"2024-08-31T04:24:34.902401+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902401+0000","last_undegraded":"2024-08-31T04:24:34.902401+0000","last_fullsized":"2024-08-31T04:24:34.902401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.178064+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.178064+0000","last_peered":"2024-08-31T04:24:35.178064+0000","last_clean":"2024-08-31T04:24:35.178064+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.178064+0000","last_undegraded":"2024-08-31T04:24:35.178064+0000","last_fullsized":"2024-08-31T04:24:35.178064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472597+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:25:03.472597+0000","last_peered":"2024-08-31T04:25:03.472597+0000","last_clean":"2024-08-31T04:25:03.472597+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:25:03.472597+0000","last_undegraded":"2024-08-31T04:25:03.472597+0000","last_fullsized":"2024-08-31T04:25:03.472597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163475+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163475+0000","last_peered":"2024-08-31T04:24:35.163475+0000","last_clean":"2024-08-31T04:24:35.163475+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163475+0000","last_undegraded":"2024-08-31T04:24:35.163475+0000","last_fullsized":"2024-08-31T04:24:35.163475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902756+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902756+0000","last_peered":"2024-08-31T04:24:34.902756+0000","last_clean":"2024-08-31T04:24:34.902756+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902756+0000","last_undegraded":"2024-08-31T04:24:34.902756+0000","last_fullsized":"2024-08-31T04:24:34.902756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483202+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:25:03.483202+0000","last_peered":"2024-08-31T04:25:03.483202+0000","last_clean":"2024-08-31T04:25:03.483202+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:25:03.483202+0000","last_undegraded":"2024-08-31T04:25:03.483202+0000","last_fullsized":"2024-08-31T04:25:03.483202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:29.601596+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:25:29.601596+0000","last_peered":"2024-08-31T04:25:29.601596+0000","last_clean":"2024-08-31T04:25:29.601596+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:25:29.601596+0000","last_undegraded":"2024-08-31T04:25:29.601596+0000","last_fullsized":"2024-08-31T04:25:29.601596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924327+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:34.924327+0000","last_peered":"2024-08-31T04:24:34.924327+0000","last_clean":"2024-08-31T04:24:34.924327+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:34.924327+0000","last_undegraded":"2024-08-31T04:24:34.924327+0000","last_fullsized":"2024-08-31T04:24:34.924327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175135+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175135+0000","last_peered":"2024-08-31T04:24:35.175135+0000","last_clean":"2024-08-31T04:24:35.175135+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175135+0000","last_undegraded":"2024-08-31T04:24:35.175135+0000","last_fullsized":"2024-08-31T04:24:35.175135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479015+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:25:03.479015+0000","last_peered":"2024-08-31T04:25:03.479015+0000","last_clean":"2024-08-31T04:25:03.479015+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:25:03.479015+0000","last_undegraded":"2024-08-31T04:25:03.479015+0000","last_fullsized":"2024-08-31T04:25:03.479015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901205+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901205+0000","last_peered":"2024-08-31T04:24:34.901205+0000","last_clean":"2024-08-31T04:24:34.901205+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901205+0000","last_undegraded":"2024-08-31T04:24:34.901205+0000","last_fullsized":"2024-08-31T04:24:34.901205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065887+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065887+0000","last_peered":"2024-08-31T04:24:35.065887+0000","last_clean":"2024-08-31T04:24:35.065887+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065887+0000","last_undegraded":"2024-08-31T04:24:35.065887+0000","last_fullsized":"2024-08-31T04:24:35.065887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468686+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:25:03.468686+0000","last_peered":"2024-08-31T04:25:03.468686+0000","last_clean":"2024-08-31T04:25:03.468686+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:25:03.468686+0000","last_undegraded":"2024-08-31T04:25:03.468686+0000","last_fullsized":"2024-08-31T04:25:03.468686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899205+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899205+0000","last_peered":"2024-08-31T04:24:34.899205+0000","last_clean":"2024-08-31T04:24:34.899205+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899205+0000","last_undegraded":"2024-08-31T04:24:34.899205+0000","last_fullsized":"2024-08-31T04:24:34.899205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175651+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175651+0000","last_peered":"2024-08-31T04:24:35.175651+0000","last_clean":"2024-08-31T04:24:35.175651+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175651+0000","last_undegraded":"2024-08-31T04:24:35.175651+0000","last_fullsized":"2024-08-31T04:24:35.175651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.475038+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:25:03.475038+0000","last_peered":"2024-08-31T04:25:03.475038+0000","last_clean":"2024-08-31T04:25:03.475038+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:25:03.475038+0000","last_undegraded":"2024-08-31T04:25:03.475038+0000","last_fullsized":"2024-08-31T04:25:03.475038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'8","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.604322+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:25:30.604322+0000","last_peered":"2024-08-31T04:25:30.604322+0000","last_clean":"2024-08-31T04:25:30.604322+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:25:30.604322+0000","last_undegraded":"2024-08-31T04:25:30.604322+0000","last_fullsized":"2024-08-31T04:25:30.604322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458136+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:25:03.458136+0000","last_peered":"2024-08-31T04:25:03.458136+0000","last_clean":"2024-08-31T04:25:03.458136+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:25:03.458136+0000","last_undegraded":"2024-08-31T04:25:03.458136+0000","last_fullsized":"2024-08-31T04:25:03.458136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473928+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:25:03.473928+0000","last_peered":"2024-08-31T04:25:03.473928+0000","last_clean":"2024-08-31T04:25:03.473928+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:25:03.473928+0000","last_undegraded":"2024-08-31T04:25:03.473928+0000","last_fullsized":"2024-08-31T04:25:03.473928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465376+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:25:03.465376+0000","last_peered":"2024-08-31T04:25:03.465376+0000","last_clean":"2024-08-31T04:25:03.465376+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:25:03.465376+0000","last_undegraded":"2024-08-31T04:25:03.465376+0000","last_fullsized":"2024-08-31T04:25:03.465376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467147+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:25:03.467147+0000","last_peered":"2024-08-31T04:25:03.467147+0000","last_clean":"2024-08-31T04:25:03.467147+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:25:03.467147+0000","last_undegraded":"2024-08-31T04:25:03.467147+0000","last_fullsized":"2024-08-31T04:25:03.467147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472966+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:25:03.472966+0000","last_peered":"2024-08-31T04:25:03.472966+0000","last_clean":"2024-08-31T04:25:03.472966+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:25:03.472966+0000","last_undegraded":"2024-08-31T04:25:03.472966+0000","last_fullsized":"2024-08-31T04:25:03.472966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465415+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:25:03.465415+0000","last_peered":"2024-08-31T04:25:03.465415+0000","last_clean":"2024-08-31T04:25:03.465415+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:25:03.465415+0000","last_undegraded":"2024-08-31T04:25:03.465415+0000","last_fullsized":"2024-08-31T04:25:03.465415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.469722+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:25:03.469722+0000","last_peered":"2024-08-31T04:25:03.469722+0000","last_clean":"2024-08-31T04:25:03.469722+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:25:03.469722+0000","last_undegraded":"2024-08-31T04:25:03.469722+0000","last_fullsized":"2024-08-31T04:25:03.469722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466083+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:25:03.466083+0000","last_peered":"2024-08-31T04:25:03.466083+0000","last_clean":"2024-08-31T04:25:03.466083+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:25:03.466083+0000","last_undegraded":"2024-08-31T04:25:03.466083+0000","last_fullsized":"2024-08-31T04:25:03.466083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462176+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:25:03.462176+0000","last_peered":"2024-08-31T04:25:03.462176+0000","last_clean":"2024-08-31T04:25:03.462176+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:25:03.462176+0000","last_undegraded":"2024-08-31T04:25:03.462176+0000","last_fullsized":"2024-08-31T04:25:03.462176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474651+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:25:03.474651+0000","last_peered":"2024-08-31T04:25:03.474651+0000","last_clean":"2024-08-31T04:25:03.474651+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:25:03.474651+0000","last_undegraded":"2024-08-31T04:25:03.474651+0000","last_fullsized":"2024-08-31T04:25:03.474651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471604+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:25:03.471604+0000","last_peered":"2024-08-31T04:25:03.471604+0000","last_clean":"2024-08-31T04:25:03.471604+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:25:03.471604+0000","last_undegraded":"2024-08-31T04:25:03.471604+0000","last_fullsized":"2024-08-31T04:25:03.471604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484840+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:25:03.484840+0000","last_peered":"2024-08-31T04:25:03.484840+0000","last_clean":"2024-08-31T04:25:03.484840+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:25:03.484840+0000","last_undegraded":"2024-08-31T04:25:03.484840+0000","last_fullsized":"2024-08-31T04:25:03.484840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466933+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:25:03.466933+0000","last_peered":"2024-08-31T04:25:03.466933+0000","last_clean":"2024-08-31T04:25:03.466933+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:25:03.466933+0000","last_undegraded":"2024-08-31T04:25:03.466933+0000","last_fullsized":"2024-08-31T04:25:03.466933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471944+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:25:03.471944+0000","last_peered":"2024-08-31T04:25:03.471944+0000","last_clean":"2024-08-31T04:25:03.471944+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:25:03.471944+0000","last_undegraded":"2024-08-31T04:25:03.471944+0000","last_fullsized":"2024-08-31T04:25:03.471944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461114+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:25:03.461114+0000","last_peered":"2024-08-31T04:25:03.461114+0000","last_clean":"2024-08-31T04:25:03.461114+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:25:03.461114+0000","last_undegraded":"2024-08-31T04:25:03.461114+0000","last_fullsized":"2024-08-31T04:25:03.461114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477404+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:25:03.477404+0000","last_peered":"2024-08-31T04:25:03.477404+0000","last_clean":"2024-08-31T04:25:03.477404+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:25:03.477404+0000","last_undegraded":"2024-08-31T04:25:03.477404+0000","last_fullsized":"2024-08-31T04:25:03.477404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485429+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:25:03.485429+0000","last_peered":"2024-08-31T04:25:03.485429+0000","last_clean":"2024-08-31T04:25:03.485429+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:25:03.485429+0000","last_undegraded":"2024-08-31T04:25:03.485429+0000","last_fullsized":"2024-08-31T04:25:03.485429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483639+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:25:03.483639+0000","last_peered":"2024-08-31T04:25:03.483639+0000","last_clean":"2024-08-31T04:25:03.483639+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:25:03.483639+0000","last_undegraded":"2024-08-31T04:25:03.483639+0000","last_fullsized":"2024-08-31T04:25:03.483639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467964+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:25:03.467964+0000","last_peered":"2024-08-31T04:25:03.467964+0000","last_clean":"2024-08-31T04:25:03.467964+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:25:03.467964+0000","last_undegraded":"2024-08-31T04:25:03.467964+0000","last_fullsized":"2024-08-31T04:25:03.467964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474975+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:25:03.474975+0000","last_peered":"2024-08-31T04:25:03.474975+0000","last_clean":"2024-08-31T04:25:03.474975+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:25:03.474975+0000","last_undegraded":"2024-08-31T04:25:03.474975+0000","last_fullsized":"2024-08-31T04:25:03.474975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473599+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:25:03.473599+0000","last_peered":"2024-08-31T04:25:03.473599+0000","last_clean":"2024-08-31T04:25:03.473599+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:25:03.473599+0000","last_undegraded":"2024-08-31T04:25:03.473599+0000","last_fullsized":"2024-08-31T04:25:03.473599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462005+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:25:03.462005+0000","last_peered":"2024-08-31T04:25:03.462005+0000","last_clean":"2024-08-31T04:25:03.462005+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:25:03.462005+0000","last_undegraded":"2024-08-31T04:25:03.462005+0000","last_fullsized":"2024-08-31T04:25:03.462005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484966+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:25:03.484966+0000","last_peered":"2024-08-31T04:25:03.484966+0000","last_clean":"2024-08-31T04:25:03.484966+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:25:03.484966+0000","last_undegraded":"2024-08-31T04:25:03.484966+0000","last_fullsized":"2024-08-31T04:25:03.484966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477868+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:25:03.477868+0000","last_peered":"2024-08-31T04:25:03.477868+0000","last_clean":"2024-08-31T04:25:03.477868+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:25:03.477868+0000","last_undegraded":"2024-08-31T04:25:03.477868+0000","last_fullsized":"2024-08-31T04:25:03.477868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484644+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:25:03.484644+0000","last_peered":"2024-08-31T04:25:03.484644+0000","last_clean":"2024-08-31T04:25:03.484644+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:25:03.484644+0000","last_undegraded":"2024-08-31T04:25:03.484644+0000","last_fullsized":"2024-08-31T04:25:03.484644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480788+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:25:03.480788+0000","last_peered":"2024-08-31T04:25:03.480788+0000","last_clean":"2024-08-31T04:25:03.480788+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:25:03.480788+0000","last_undegraded":"2024-08-31T04:25:03.480788+0000","last_fullsized":"2024-08-31T04:25:03.480788+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481754+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:25:03.481754+0000","last_peered":"2024-08-31T04:25:03.481754+0000","last_clean":"2024-08-31T04:25:03.481754+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:25:03.481754+0000","last_undegraded":"2024-08-31T04:25:03.481754+0000","last_fullsized":"2024-08-31T04:25:03.481754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480512+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:25:03.480512+0000","last_peered":"2024-08-31T04:25:03.480512+0000","last_clean":"2024-08-31T04:25:03.480512+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:25:03.480512+0000","last_undegraded":"2024-08-31T04:25:03.480512+0000","last_fullsized":"2024-08-31T04:25:03.480512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458917+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:25:03.458917+0000","last_peered":"2024-08-31T04:25:03.458917+0000","last_clean":"2024-08-31T04:25:03.458917+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:25:03.458917+0000","last_undegraded":"2024-08-31T04:25:03.458917+0000","last_fullsized":"2024-08-31T04:25:03.458917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463529+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:25:03.463529+0000","last_peered":"2024-08-31T04:25:03.463529+0000","last_clean":"2024-08-31T04:25:03.463529+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:25:03.463529+0000","last_undegraded":"2024-08-31T04:25:03.463529+0000","last_fullsized":"2024-08-31T04:25:03.463529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479776+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:25:03.479776+0000","last_peered":"2024-08-31T04:25:03.479776+0000","last_clean":"2024-08-31T04:25:03.479776+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:25:03.479776+0000","last_undegraded":"2024-08-31T04:25:03.479776+0000","last_fullsized":"2024-08-31T04:25:03.479776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471757+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:25:03.471757+0000","last_peered":"2024-08-31T04:25:03.471757+0000","last_clean":"2024-08-31T04:25:03.471757+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:25:03.471757+0000","last_undegraded":"2024-08-31T04:25:03.471757+0000","last_fullsized":"2024-08-31T04:25:03.471757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485086+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:25:03.485086+0000","last_peered":"2024-08-31T04:25:03.485086+0000","last_clean":"2024-08-31T04:25:03.485086+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:25:03.485086+0000","last_undegraded":"2024-08-31T04:25:03.485086+0000","last_fullsized":"2024-08-31T04:25:03.485086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75253,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":705,"num_read_kb":432,"num_write":191,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":225759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743469,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":502091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1671168,"data_stored":1158583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495681,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1585152,"data_stored":1096638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36904,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708248,"statfs":{"total":95995035648,"available":95957245952,"internally_reserved":0,"allocated":1597440,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":503658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":496235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":565977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542238,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:25:33.371 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-31T04:25:33.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/3283802162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104580 msgr2=0x7f4f38104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/3283802162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104580 0x7f4f38104990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009900 tx=0x7f4f2802a410 comp rx=0 tx=0).stop 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/3283802162 shutdown_connections 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/3283802162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 0x7f4f38110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/3283802162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104fb0 0x7f4f3810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/3283802162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104580 0x7f4f38104990 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/3283802162 >> 172.21.15.2:0/3283802162 conn(0x7f4f380fe150 msgr2=0x7f4f381005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/3283802162 shutdown_connections 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.516+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/3283802162 wait complete. 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 Processor -- start 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 -- start start 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104580 0x7f4f3819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 0x7f4f3819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f381137f0 con 0x7f4f38104fb0 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f38113670 con 0x7f4f3810db30 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f3e0ac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4f38113970 con 0x7f4f38104580 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44614/0 (socket says 172.21.15.2:44614) 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f36ffd640 1 -- 172.21.15.2:0/2810362167 learned_addr learned my addr 172.21.15.2:0/2810362167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.517+0000 7f4f37fff640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 0x7f4f3819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f377fe640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104580 0x7f4f3819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 -- 172.21.15.2:0/2810362167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104580 msgr2=0x7f4f3819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104580 0x7f4f3819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 -- 172.21.15.2:0/2810362167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 msgr2=0x7f4f3819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 0x7f4f3819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 -- 172.21.15.2:0/2810362167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f381a0140 con 0x7f4f38104fb0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f36ffd640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006fd0 tx=0x7f4f2c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011830 con 0x7f4f38104fb0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f2c016070 con 0x7f4f38104fb0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f381a0430 con 0x7f4f38104fb0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c010e00 con 0x7f4f38104fb0 2024-08-31T04:25:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.518+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f381a6bc0 con 0x7f4f38104fb0 2024-08-31T04:25:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.519+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f38104990 con 0x7f4f38104fb0 2024-08-31T04:25:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.521+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f4f2c01b460 con 0x7f4f38104fb0 2024-08-31T04:25:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.522+0000 7f4f34ff9640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 0x7f4f200b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.522+0000 7f4f377fe640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 0x7f4f200b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.522+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4f2c0e53a0 con 0x7f4f38104fb0 2024-08-31T04:25:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.523+0000 7f4f377fe640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 0x7f4f200b7120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4f28031440 tx=0x7f4f28009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:33.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.525+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f2c0abe10 con 0x7f4f38104fb0 2024-08-31T04:25:33.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.708+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f38107dc0 con 0x7f4f200b4c10 2024-08-31T04:25:33.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.714+0000 7f4f34ff9640 1 -- 172.21.15.2:0/2810362167 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340447 (secure 0 0 0) 0x7f4f38107dc0 con 0x7f4f200b4c10 2024-08-31T04:25:33.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:33.720 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 msgr2=0x7f4f200b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 0x7f4f200b7120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4f28031440 tx=0x7f4f28009560 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 msgr2=0x7f4f3819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006fd0 tx=0x7f4f2c00b8e0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 shutdown_connections 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f200b4c10 0x7f4f200b7120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38104fb0 0x7f4f3819a7b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f3810db30 0x7f4f3819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 --2- 172.21.15.2:0/2810362167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f38104580 0x7f4f3819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 >> 172.21.15.2:0/2810362167 conn(0x7f4f380fe150 msgr2=0x7f4f381076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 shutdown_connections 2024-08-31T04:25:33.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:33.718+0000 7f4f3e0ac640 1 -- 172.21.15.2:0/2810362167 wait complete. 2024-08-31T04:25:33.731 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-08-31T04:25:33.115644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665855,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":786,"num_read_kb":501,"num_write":316,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404428,"kb_used_data":13580,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537396,"statfs":{"total":1151940427776,"available":1151526293504,"internally_reserved":0,"allocated":13905920,"data_stored":7981043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":400012605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5712,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003289"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903785+0000","last_change":"2024-08-31T04:23:34.501474+0000","last_active":"2024-08-31T04:24:34.903785+0000","last_peered":"2024-08-31T04:24:34.903785+0000","last_clean":"2024-08-31T04:24:34.903785+0000","last_became_active":"2024-08-31T04:23:34.496955+0000","last_became_peered":"2024-08-31T04:23:34.496955+0000","last_unstale":"2024-08-31T04:24:34.903785+0000","last_undegraded":"2024-08-31T04:24:34.903785+0000","last_fullsized":"2024-08-31T04:24:34.903785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:21.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468842+0000","last_change":"2024-08-31T04:22:57.255838+0000","last_active":"2024-08-31T04:25:03.468842+0000","last_peered":"2024-08-31T04:25:03.468842+0000","last_clean":"2024-08-31T04:25:03.468842+0000","last_became_active":"2024-08-31T04:22:57.255521+0000","last_became_peered":"2024-08-31T04:22:57.255521+0000","last_unstale":"2024-08-31T04:25:03.468842+0000","last_undegraded":"2024-08-31T04:25:03.468842+0000","last_fullsized":"2024-08-31T04:25:03.468842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:36.587062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.177304+0000","last_change":"2024-08-31T04:24:35.176635+0000","last_active":"2024-08-31T04:24:35.177304+0000","last_peered":"2024-08-31T04:24:35.177304+0000","last_clean":"2024-08-31T04:24:35.177304+0000","last_became_active":"2024-08-31T04:24:35.176080+0000","last_became_peered":"2024-08-31T04:24:35.176080+0000","last_unstale":"2024-08-31T04:24:35.177304+0000","last_undegraded":"2024-08-31T04:24:35.177304+0000","last_fullsized":"2024-08-31T04:24:35.177304+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:15.399808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924339+0000","last_change":"2024-08-31T04:22:55.315200+0000","last_active":"2024-08-31T04:24:34.924339+0000","last_peered":"2024-08-31T04:24:34.924339+0000","last_clean":"2024-08-31T04:24:34.924339+0000","last_became_active":"2024-08-31T04:22:55.314831+0000","last_became_peered":"2024-08-31T04:22:55.314831+0000","last_unstale":"2024-08-31T04:24:34.924339+0000","last_undegraded":"2024-08-31T04:24:34.924339+0000","last_fullsized":"2024-08-31T04:24:34.924339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:50:51.184812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479409+0000","last_change":"2024-08-31T04:22:57.253447+0000","last_active":"2024-08-31T04:25:03.479409+0000","last_peered":"2024-08-31T04:25:03.479409+0000","last_clean":"2024-08-31T04:25:03.479409+0000","last_became_active":"2024-08-31T04:22:57.253086+0000","last_became_peered":"2024-08-31T04:22:57.253086+0000","last_unstale":"2024-08-31T04:25:03.479409+0000","last_undegraded":"2024-08-31T04:25:03.479409+0000","last_fullsized":"2024-08-31T04:25:03.479409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:55.378534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901802+0000","last_change":"2024-08-31T04:23:04.280117+0000","last_active":"2024-08-31T04:24:34.901802+0000","last_peered":"2024-08-31T04:24:34.901802+0000","last_clean":"2024-08-31T04:24:34.901802+0000","last_became_active":"2024-08-31T04:23:04.278954+0000","last_became_peered":"2024-08-31T04:23:04.278954+0000","last_unstale":"2024-08-31T04:24:34.901802+0000","last_undegraded":"2024-08-31T04:24:34.901802+0000","last_fullsized":"2024-08-31T04:24:34.901802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:47:52.556120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908022+0000","last_change":"2024-08-31T04:22:55.231813+0000","last_active":"2024-08-31T04:24:34.908022+0000","last_peered":"2024-08-31T04:24:34.908022+0000","last_clean":"2024-08-31T04:24:34.908022+0000","last_became_active":"2024-08-31T04:22:55.231448+0000","last_became_peered":"2024-08-31T04:22:55.231448+0000","last_unstale":"2024-08-31T04:24:34.908022+0000","last_undegraded":"2024-08-31T04:24:34.908022+0000","last_fullsized":"2024-08-31T04:24:34.908022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:53:06.870347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.482868+0000","last_change":"2024-08-31T04:22:57.249199+0000","last_active":"2024-08-31T04:25:03.482868+0000","last_peered":"2024-08-31T04:25:03.482868+0000","last_clean":"2024-08-31T04:25:03.482868+0000","last_became_active":"2024-08-31T04:22:57.248385+0000","last_became_peered":"2024-08-31T04:22:57.248385+0000","last_unstale":"2024-08-31T04:25:03.482868+0000","last_undegraded":"2024-08-31T04:25:03.482868+0000","last_fullsized":"2024-08-31T04:25:03.482868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:16.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902050+0000","last_change":"2024-08-31T04:23:04.281037+0000","last_active":"2024-08-31T04:24:34.902050+0000","last_peered":"2024-08-31T04:24:34.902050+0000","last_clean":"2024-08-31T04:24:34.902050+0000","last_became_active":"2024-08-31T04:23:04.280137+0000","last_became_peered":"2024-08-31T04:23:04.280137+0000","last_unstale":"2024-08-31T04:24:34.902050+0000","last_undegraded":"2024-08-31T04:24:34.902050+0000","last_fullsized":"2024-08-31T04:24:34.902050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:17.314485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907899+0000","last_change":"2024-08-31T04:22:55.230265+0000","last_active":"2024-08-31T04:24:34.907899+0000","last_peered":"2024-08-31T04:24:34.907899+0000","last_clean":"2024-08-31T04:24:34.907899+0000","last_became_active":"2024-08-31T04:22:55.229899+0000","last_became_peered":"2024-08-31T04:22:55.229899+0000","last_unstale":"2024-08-31T04:24:34.907899+0000","last_undegraded":"2024-08-31T04:24:34.907899+0000","last_fullsized":"2024-08-31T04:24:34.907899+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:20.324039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484908+0000","last_change":"2024-08-31T04:22:57.248507+0000","last_active":"2024-08-31T04:25:03.484908+0000","last_peered":"2024-08-31T04:25:03.484908+0000","last_clean":"2024-08-31T04:25:03.484908+0000","last_became_active":"2024-08-31T04:22:57.248113+0000","last_became_peered":"2024-08-31T04:22:57.248113+0000","last_unstale":"2024-08-31T04:25:03.484908+0000","last_undegraded":"2024-08-31T04:25:03.484908+0000","last_fullsized":"2024-08-31T04:25:03.484908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:46:09.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.926170+0000","last_change":"2024-08-31T04:24:34.926081+0000","last_active":"2024-08-31T04:24:34.926170+0000","last_peered":"2024-08-31T04:24:34.926170+0000","last_clean":"2024-08-31T04:24:34.926170+0000","last_became_active":"2024-08-31T04:24:34.925430+0000","last_became_peered":"2024-08-31T04:24:34.925430+0000","last_unstale":"2024-08-31T04:24:34.926170+0000","last_undegraded":"2024-08-31T04:24:34.926170+0000","last_fullsized":"2024-08-31T04:24:34.926170+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:29.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485033+0000","last_change":"2024-08-31T04:22:57.259634+0000","last_active":"2024-08-31T04:25:03.485033+0000","last_peered":"2024-08-31T04:25:03.485033+0000","last_clean":"2024-08-31T04:25:03.485033+0000","last_became_active":"2024-08-31T04:22:57.258062+0000","last_became_peered":"2024-08-31T04:22:57.258062+0000","last_unstale":"2024-08-31T04:25:03.485033+0000","last_undegraded":"2024-08-31T04:25:03.485033+0000","last_fullsized":"2024-08-31T04:25:03.485033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:36.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907541+0000","last_change":"2024-08-31T04:23:34.382766+0000","last_active":"2024-08-31T04:24:34.907541+0000","last_peered":"2024-08-31T04:24:34.907541+0000","last_clean":"2024-08-31T04:24:34.907541+0000","last_became_active":"2024-08-31T04:23:34.378659+0000","last_became_peered":"2024-08-31T04:23:34.378659+0000","last_unstale":"2024-08-31T04:24:34.907541+0000","last_undegraded":"2024-08-31T04:24:34.907541+0000","last_fullsized":"2024-08-31T04:24:34.907541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:29.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902968+0000","last_change":"2024-08-31T04:23:04.361795+0000","last_active":"2024-08-31T04:24:34.902968+0000","last_peered":"2024-08-31T04:24:34.902968+0000","last_clean":"2024-08-31T04:24:34.902968+0000","last_became_active":"2024-08-31T04:23:04.360951+0000","last_became_peered":"2024-08-31T04:23:04.360951+0000","last_unstale":"2024-08-31T04:24:34.902968+0000","last_undegraded":"2024-08-31T04:24:34.902968+0000","last_fullsized":"2024-08-31T04:24:34.902968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:10.642449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480703+0000","last_change":"2024-08-31T04:22:57.243803+0000","last_active":"2024-08-31T04:25:03.480703+0000","last_peered":"2024-08-31T04:25:03.480703+0000","last_clean":"2024-08-31T04:25:03.480703+0000","last_became_active":"2024-08-31T04:22:57.243482+0000","last_became_peered":"2024-08-31T04:22:57.243482+0000","last_unstale":"2024-08-31T04:25:03.480703+0000","last_undegraded":"2024-08-31T04:25:03.480703+0000","last_fullsized":"2024-08-31T04:25:03.480703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:30.735368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903443+0000","last_change":"2024-08-31T04:22:55.229194+0000","last_active":"2024-08-31T04:24:34.903443+0000","last_peered":"2024-08-31T04:24:34.903443+0000","last_clean":"2024-08-31T04:24:34.903443+0000","last_became_active":"2024-08-31T04:22:55.226502+0000","last_became_peered":"2024-08-31T04:22:55.226502+0000","last_unstale":"2024-08-31T04:24:34.903443+0000","last_undegraded":"2024-08-31T04:24:34.903443+0000","last_fullsized":"2024-08-31T04:24:34.903443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:16.499966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902803+0000","last_change":"2024-08-31T04:23:04.280347+0000","last_active":"2024-08-31T04:24:34.902803+0000","last_peered":"2024-08-31T04:24:34.902803+0000","last_clean":"2024-08-31T04:24:34.902803+0000","last_became_active":"2024-08-31T04:23:04.279617+0000","last_became_peered":"2024-08-31T04:23:04.279617+0000","last_unstale":"2024-08-31T04:24:34.902803+0000","last_undegraded":"2024-08-31T04:24:34.902803+0000","last_fullsized":"2024-08-31T04:24:34.902803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.455291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474064+0000","last_change":"2024-08-31T04:22:57.256594+0000","last_active":"2024-08-31T04:25:03.474064+0000","last_peered":"2024-08-31T04:25:03.474064+0000","last_clean":"2024-08-31T04:25:03.474064+0000","last_became_active":"2024-08-31T04:22:57.256198+0000","last_became_peered":"2024-08-31T04:22:57.256198+0000","last_unstale":"2024-08-31T04:25:03.474064+0000","last_undegraded":"2024-08-31T04:25:03.474064+0000","last_fullsized":"2024-08-31T04:25:03.474064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:47.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924564+0000","last_change":"2024-08-31T04:22:55.224615+0000","last_active":"2024-08-31T04:24:34.924564+0000","last_peered":"2024-08-31T04:24:34.924564+0000","last_clean":"2024-08-31T04:24:34.924564+0000","last_became_active":"2024-08-31T04:22:55.224212+0000","last_became_peered":"2024-08-31T04:22:55.224212+0000","last_unstale":"2024-08-31T04:24:34.924564+0000","last_undegraded":"2024-08-31T04:24:34.924564+0000","last_fullsized":"2024-08-31T04:24:34.924564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:02.713183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903374+0000","last_change":"2024-08-31T04:23:04.286750+0000","last_active":"2024-08-31T04:24:34.903374+0000","last_peered":"2024-08-31T04:24:34.903374+0000","last_clean":"2024-08-31T04:24:34.903374+0000","last_became_active":"2024-08-31T04:23:04.286305+0000","last_became_peered":"2024-08-31T04:23:04.286305+0000","last_unstale":"2024-08-31T04:24:34.903374+0000","last_undegraded":"2024-08-31T04:24:34.903374+0000","last_fullsized":"2024-08-31T04:24:34.903374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:30.093085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474353+0000","last_change":"2024-08-31T04:22:57.246377+0000","last_active":"2024-08-31T04:25:03.474353+0000","last_peered":"2024-08-31T04:25:03.474353+0000","last_clean":"2024-08-31T04:25:03.474353+0000","last_became_active":"2024-08-31T04:22:57.245961+0000","last_became_peered":"2024-08-31T04:22:57.245961+0000","last_unstale":"2024-08-31T04:25:03.474353+0000","last_undegraded":"2024-08-31T04:25:03.474353+0000","last_fullsized":"2024-08-31T04:25:03.474353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:02.793068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903947+0000","last_change":"2024-08-31T04:22:55.315942+0000","last_active":"2024-08-31T04:24:34.903947+0000","last_peered":"2024-08-31T04:24:34.903947+0000","last_clean":"2024-08-31T04:24:34.903947+0000","last_became_active":"2024-08-31T04:22:55.315528+0000","last_became_peered":"2024-08-31T04:22:55.315528+0000","last_unstale":"2024-08-31T04:24:34.903947+0000","last_undegraded":"2024-08-31T04:24:34.903947+0000","last_fullsized":"2024-08-31T04:24:34.903947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:10.037970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902552+0000","last_change":"2024-08-31T04:23:04.361757+0000","last_active":"2024-08-31T04:24:34.902552+0000","last_peered":"2024-08-31T04:24:34.902552+0000","last_clean":"2024-08-31T04:24:34.902552+0000","last_became_active":"2024-08-31T04:23:04.361053+0000","last_became_peered":"2024-08-31T04:23:04.361053+0000","last_unstale":"2024-08-31T04:24:34.902552+0000","last_undegraded":"2024-08-31T04:24:34.902552+0000","last_fullsized":"2024-08-31T04:24:34.902552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:02:08.152502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472917+0000","last_change":"2024-08-31T04:22:57.247540+0000","last_active":"2024-08-31T04:25:03.472917+0000","last_peered":"2024-08-31T04:25:03.472917+0000","last_clean":"2024-08-31T04:25:03.472917+0000","last_became_active":"2024-08-31T04:22:57.247178+0000","last_became_peered":"2024-08-31T04:22:57.247178+0000","last_unstale":"2024-08-31T04:25:03.472917+0000","last_undegraded":"2024-08-31T04:25:03.472917+0000","last_fullsized":"2024-08-31T04:25:03.472917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:39:20.450740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903222+0000","last_change":"2024-08-31T04:22:55.364825+0000","last_active":"2024-08-31T04:24:34.903222+0000","last_peered":"2024-08-31T04:24:34.903222+0000","last_clean":"2024-08-31T04:24:34.903222+0000","last_became_active":"2024-08-31T04:22:55.364396+0000","last_became_peered":"2024-08-31T04:22:55.364396+0000","last_unstale":"2024-08-31T04:24:34.903222+0000","last_undegraded":"2024-08-31T04:24:34.903222+0000","last_fullsized":"2024-08-31T04:24:34.903222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:21.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903900+0000","last_change":"2024-08-31T04:23:04.280939+0000","last_active":"2024-08-31T04:24:34.903900+0000","last_peered":"2024-08-31T04:24:34.903900+0000","last_clean":"2024-08-31T04:24:34.903900+0000","last_became_active":"2024-08-31T04:23:04.280110+0000","last_became_peered":"2024-08-31T04:23:04.280110+0000","last_unstale":"2024-08-31T04:24:34.903900+0000","last_undegraded":"2024-08-31T04:24:34.903900+0000","last_fullsized":"2024-08-31T04:24:34.903900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:25.860675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477135+0000","last_change":"2024-08-31T04:24:35.164680+0000","last_active":"2024-08-31T04:25:03.477135+0000","last_peered":"2024-08-31T04:25:03.477135+0000","last_clean":"2024-08-31T04:25:03.477135+0000","last_became_active":"2024-08-31T04:24:35.164257+0000","last_became_peered":"2024-08-31T04:24:35.164257+0000","last_unstale":"2024-08-31T04:25:03.477135+0000","last_undegraded":"2024-08-31T04:25:03.477135+0000","last_fullsized":"2024-08-31T04:25:03.477135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:26.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:05.131639+0000","last_change":"2024-08-31T04:22:55.226239+0000","last_active":"2024-08-31T04:25:05.131639+0000","last_peered":"2024-08-31T04:25:05.131639+0000","last_clean":"2024-08-31T04:25:05.131639+0000","last_became_active":"2024-08-31T04:22:55.225802+0000","last_became_peered":"2024-08-31T04:22:55.225802+0000","last_unstale":"2024-08-31T04:25:05.131639+0000","last_undegraded":"2024-08-31T04:25:05.131639+0000","last_fullsized":"2024-08-31T04:25:05.131639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:41.072618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.923635+0000","last_change":"2024-08-31T04:23:04.361286+0000","last_active":"2024-08-31T04:24:34.923635+0000","last_peered":"2024-08-31T04:24:34.923635+0000","last_clean":"2024-08-31T04:24:34.923635+0000","last_became_active":"2024-08-31T04:23:04.360797+0000","last_became_peered":"2024-08-31T04:23:04.360797+0000","last_unstale":"2024-08-31T04:24:34.923635+0000","last_undegraded":"2024-08-31T04:24:34.923635+0000","last_fullsized":"2024-08-31T04:24:34.923635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:55.637628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459168+0000","last_change":"2024-08-31T04:22:57.253159+0000","last_active":"2024-08-31T04:25:03.459168+0000","last_peered":"2024-08-31T04:25:03.459168+0000","last_clean":"2024-08-31T04:25:03.459168+0000","last_became_active":"2024-08-31T04:22:57.252824+0000","last_became_peered":"2024-08-31T04:22:57.252824+0000","last_unstale":"2024-08-31T04:25:03.459168+0000","last_undegraded":"2024-08-31T04:25:03.459168+0000","last_fullsized":"2024-08-31T04:25:03.459168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:19.247113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.908166+0000","last_change":"2024-08-31T04:22:55.315198+0000","last_active":"2024-08-31T04:24:34.908166+0000","last_peered":"2024-08-31T04:24:34.908166+0000","last_clean":"2024-08-31T04:24:34.908166+0000","last_became_active":"2024-08-31T04:22:55.314724+0000","last_became_peered":"2024-08-31T04:22:55.314724+0000","last_unstale":"2024-08-31T04:24:34.908166+0000","last_undegraded":"2024-08-31T04:24:34.908166+0000","last_fullsized":"2024-08-31T04:24:34.908166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:46.455622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065415+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:35.065415+0000","last_peered":"2024-08-31T04:24:35.065415+0000","last_clean":"2024-08-31T04:24:35.065415+0000","last_became_active":"2024-08-31T04:23:04.281350+0000","last_became_peered":"2024-08-31T04:23:04.281350+0000","last_unstale":"2024-08-31T04:24:35.065415+0000","last_undegraded":"2024-08-31T04:24:35.065415+0000","last_fullsized":"2024-08-31T04:24:35.065415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:41.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479172+0000","last_change":"2024-08-31T04:22:57.247189+0000","last_active":"2024-08-31T04:25:03.479172+0000","last_peered":"2024-08-31T04:25:03.479172+0000","last_clean":"2024-08-31T04:25:03.479172+0000","last_became_active":"2024-08-31T04:22:57.246755+0000","last_became_peered":"2024-08-31T04:22:57.246755+0000","last_unstale":"2024-08-31T04:25:03.479172+0000","last_undegraded":"2024-08-31T04:25:03.479172+0000","last_fullsized":"2024-08-31T04:25:03.479172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:39.073246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903257+0000","last_change":"2024-08-31T04:22:55.315195+0000","last_active":"2024-08-31T04:24:34.903257+0000","last_peered":"2024-08-31T04:24:34.903257+0000","last_clean":"2024-08-31T04:24:34.903257+0000","last_became_active":"2024-08-31T04:22:55.314807+0000","last_became_peered":"2024-08-31T04:22:55.314807+0000","last_unstale":"2024-08-31T04:24:34.903257+0000","last_undegraded":"2024-08-31T04:24:34.903257+0000","last_fullsized":"2024-08-31T04:24:34.903257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:01.142598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907840+0000","last_change":"2024-08-31T04:23:04.361305+0000","last_active":"2024-08-31T04:24:34.907840+0000","last_peered":"2024-08-31T04:24:34.907840+0000","last_clean":"2024-08-31T04:24:34.907840+0000","last_became_active":"2024-08-31T04:23:04.360784+0000","last_became_peered":"2024-08-31T04:23:04.360784+0000","last_unstale":"2024-08-31T04:24:34.907840+0000","last_undegraded":"2024-08-31T04:24:34.907840+0000","last_fullsized":"2024-08-31T04:24:34.907840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:57.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474555+0000","last_change":"2024-08-31T04:22:57.247428+0000","last_active":"2024-08-31T04:25:03.474555+0000","last_peered":"2024-08-31T04:25:03.474555+0000","last_clean":"2024-08-31T04:25:03.474555+0000","last_became_active":"2024-08-31T04:22:57.247015+0000","last_became_peered":"2024-08-31T04:22:57.247015+0000","last_unstale":"2024-08-31T04:25:03.474555+0000","last_undegraded":"2024-08-31T04:25:03.474555+0000","last_fullsized":"2024-08-31T04:25:03.474555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:27:08.701206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163392+0000","last_change":"2024-08-31T04:22:55.231307+0000","last_active":"2024-08-31T04:24:35.163392+0000","last_peered":"2024-08-31T04:24:35.163392+0000","last_clean":"2024-08-31T04:24:35.163392+0000","last_became_active":"2024-08-31T04:22:55.229664+0000","last_became_peered":"2024-08-31T04:22:55.229664+0000","last_unstale":"2024-08-31T04:24:35.163392+0000","last_undegraded":"2024-08-31T04:24:35.163392+0000","last_fullsized":"2024-08-31T04:24:35.163392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:52.984097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899521+0000","last_change":"2024-08-31T04:23:04.279040+0000","last_active":"2024-08-31T04:24:34.899521+0000","last_peered":"2024-08-31T04:24:34.899521+0000","last_clean":"2024-08-31T04:24:34.899521+0000","last_became_active":"2024-08-31T04:23:04.278615+0000","last_became_peered":"2024-08-31T04:23:04.278615+0000","last_unstale":"2024-08-31T04:24:34.899521+0000","last_undegraded":"2024-08-31T04:24:34.899521+0000","last_fullsized":"2024-08-31T04:24:34.899521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:58:32.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461723+0000","last_change":"2024-08-31T04:24:34.909095+0000","last_active":"2024-08-31T04:25:03.461723+0000","last_peered":"2024-08-31T04:25:03.461723+0000","last_clean":"2024-08-31T04:25:03.461723+0000","last_became_active":"2024-08-31T04:24:34.908640+0000","last_became_peered":"2024-08-31T04:24:34.908640+0000","last_unstale":"2024-08-31T04:25:03.461723+0000","last_undegraded":"2024-08-31T04:25:03.461723+0000","last_fullsized":"2024-08-31T04:25:03.461723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:58.001822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:29.602089+0000","last_change":"2024-08-31T04:22:55.315040+0000","last_active":"2024-08-31T04:25:29.602089+0000","last_peered":"2024-08-31T04:25:29.602089+0000","last_clean":"2024-08-31T04:25:29.602089+0000","last_became_active":"2024-08-31T04:22:55.314643+0000","last_became_peered":"2024-08-31T04:22:55.314643+0000","last_unstale":"2024-08-31T04:25:29.602089+0000","last_undegraded":"2024-08-31T04:25:29.602089+0000","last_fullsized":"2024-08-31T04:25:29.602089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:08.952908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899870+0000","last_change":"2024-08-31T04:23:04.362074+0000","last_active":"2024-08-31T04:24:34.899870+0000","last_peered":"2024-08-31T04:24:34.899870+0000","last_clean":"2024-08-31T04:24:34.899870+0000","last_became_active":"2024-08-31T04:23:04.361490+0000","last_became_peered":"2024-08-31T04:23:04.361490+0000","last_unstale":"2024-08-31T04:24:34.899870+0000","last_undegraded":"2024-08-31T04:24:34.899870+0000","last_fullsized":"2024-08-31T04:24:34.899870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:14.956431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.459548+0000","last_change":"2024-08-31T04:22:57.252124+0000","last_active":"2024-08-31T04:25:03.459548+0000","last_peered":"2024-08-31T04:25:03.459548+0000","last_clean":"2024-08-31T04:25:03.459548+0000","last_became_active":"2024-08-31T04:22:57.251702+0000","last_became_peered":"2024-08-31T04:22:57.251702+0000","last_unstale":"2024-08-31T04:25:03.459548+0000","last_undegraded":"2024-08-31T04:25:03.459548+0000","last_fullsized":"2024-08-31T04:25:03.459548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:02:09.726377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163114+0000","last_change":"2024-08-31T04:23:34.377932+0000","last_active":"2024-08-31T04:24:35.163114+0000","last_peered":"2024-08-31T04:24:35.163114+0000","last_clean":"2024-08-31T04:24:35.163114+0000","last_became_active":"2024-08-31T04:23:34.377420+0000","last_became_peered":"2024-08-31T04:23:34.377420+0000","last_unstale":"2024-08-31T04:24:35.163114+0000","last_undegraded":"2024-08-31T04:24:35.163114+0000","last_fullsized":"2024-08-31T04:24:35.163114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:10.547519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,8],"acting":[7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902488+0000","last_change":"2024-08-31T04:23:04.361713+0000","last_active":"2024-08-31T04:24:34.902488+0000","last_peered":"2024-08-31T04:24:34.902488+0000","last_clean":"2024-08-31T04:24:34.902488+0000","last_became_active":"2024-08-31T04:23:04.360989+0000","last_became_peered":"2024-08-31T04:23:04.360989+0000","last_unstale":"2024-08-31T04:24:34.902488+0000","last_undegraded":"2024-08-31T04:24:34.902488+0000","last_fullsized":"2024-08-31T04:24:34.902488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:04.341760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473210+0000","last_change":"2024-08-31T04:22:57.257349+0000","last_active":"2024-08-31T04:25:03.473210+0000","last_peered":"2024-08-31T04:25:03.473210+0000","last_clean":"2024-08-31T04:25:03.473210+0000","last_became_active":"2024-08-31T04:22:57.257003+0000","last_became_peered":"2024-08-31T04:22:57.257003+0000","last_unstale":"2024-08-31T04:25:03.473210+0000","last_undegraded":"2024-08-31T04:25:03.473210+0000","last_fullsized":"2024-08-31T04:25:03.473210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:26:12.855616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902666+0000","last_change":"2024-08-31T04:23:34.373417+0000","last_active":"2024-08-31T04:24:34.902666+0000","last_peered":"2024-08-31T04:24:34.902666+0000","last_clean":"2024-08-31T04:24:34.902666+0000","last_became_active":"2024-08-31T04:23:34.372986+0000","last_became_peered":"2024-08-31T04:23:34.372986+0000","last_unstale":"2024-08-31T04:24:34.902666+0000","last_undegraded":"2024-08-31T04:24:34.902666+0000","last_fullsized":"2024-08-31T04:24:34.902666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:18:05.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9],"acting":[4,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163078+0000","last_change":"2024-08-31T04:21:42.829085+0000","last_active":"2024-08-31T04:24:35.163078+0000","last_peered":"2024-08-31T04:24:35.163078+0000","last_clean":"2024-08-31T04:24:35.163078+0000","last_became_active":"2024-08-31T04:21:42.686624+0000","last_became_peered":"2024-08-31T04:21:42.686624+0000","last_unstale":"2024-08-31T04:24:35.163078+0000","last_undegraded":"2024-08-31T04:24:35.163078+0000","last_fullsized":"2024-08-31T04:24:35.163078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:18:21.874239+0000","last_clean_scrub_stamp":"2024-08-31T04:18:21.874239+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:29:36.178439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163170+0000","last_change":"2024-08-31T04:23:04.287436+0000","last_active":"2024-08-31T04:24:35.163170+0000","last_peered":"2024-08-31T04:24:35.163170+0000","last_clean":"2024-08-31T04:24:35.163170+0000","last_became_active":"2024-08-31T04:23:04.286903+0000","last_became_peered":"2024-08-31T04:23:04.286903+0000","last_unstale":"2024-08-31T04:24:35.163170+0000","last_undegraded":"2024-08-31T04:24:35.163170+0000","last_fullsized":"2024-08-31T04:24:35.163170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:39:48.824235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485120+0000","last_change":"2024-08-31T04:22:57.260173+0000","last_active":"2024-08-31T04:25:03.485120+0000","last_peered":"2024-08-31T04:25:03.485120+0000","last_clean":"2024-08-31T04:25:03.485120+0000","last_became_active":"2024-08-31T04:22:57.258018+0000","last_became_peered":"2024-08-31T04:22:57.258018+0000","last_unstale":"2024-08-31T04:25:03.485120+0000","last_undegraded":"2024-08-31T04:25:03.485120+0000","last_fullsized":"2024-08-31T04:25:03.485120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:03.817487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902502+0000","last_change":"2024-08-31T04:23:34.372172+0000","last_active":"2024-08-31T04:24:34.902502+0000","last_peered":"2024-08-31T04:24:34.902502+0000","last_clean":"2024-08-31T04:24:34.902502+0000","last_became_active":"2024-08-31T04:23:34.371773+0000","last_became_peered":"2024-08-31T04:23:34.371773+0000","last_unstale":"2024-08-31T04:24:34.902502+0000","last_undegraded":"2024-08-31T04:24:34.902502+0000","last_fullsized":"2024-08-31T04:24:34.902502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:02.651474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.904255+0000","last_change":"2024-08-31T04:23:04.285067+0000","last_active":"2024-08-31T04:24:34.904255+0000","last_peered":"2024-08-31T04:24:34.904255+0000","last_clean":"2024-08-31T04:24:34.904255+0000","last_became_active":"2024-08-31T04:23:04.284516+0000","last_became_peered":"2024-08-31T04:23:04.284516+0000","last_unstale":"2024-08-31T04:24:34.904255+0000","last_undegraded":"2024-08-31T04:24:34.904255+0000","last_fullsized":"2024-08-31T04:24:34.904255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:02.827381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481332+0000","last_change":"2024-08-31T04:22:57.257730+0000","last_active":"2024-08-31T04:25:03.481332+0000","last_peered":"2024-08-31T04:25:03.481332+0000","last_clean":"2024-08-31T04:25:03.481332+0000","last_became_active":"2024-08-31T04:22:57.257083+0000","last_became_peered":"2024-08-31T04:22:57.257083+0000","last_unstale":"2024-08-31T04:25:03.481332+0000","last_undegraded":"2024-08-31T04:25:03.481332+0000","last_fullsized":"2024-08-31T04:25:03.481332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:55.150370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902533+0000","last_change":"2024-08-31T04:22:55.230449+0000","last_active":"2024-08-31T04:24:34.902533+0000","last_peered":"2024-08-31T04:24:34.902533+0000","last_clean":"2024-08-31T04:24:34.902533+0000","last_became_active":"2024-08-31T04:22:55.230033+0000","last_became_peered":"2024-08-31T04:22:55.230033+0000","last_unstale":"2024-08-31T04:24:34.902533+0000","last_undegraded":"2024-08-31T04:24:34.902533+0000","last_fullsized":"2024-08-31T04:24:34.902533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:02.826503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175167+0000","last_change":"2024-08-31T04:23:04.278184+0000","last_active":"2024-08-31T04:24:35.175167+0000","last_peered":"2024-08-31T04:24:35.175167+0000","last_clean":"2024-08-31T04:24:35.175167+0000","last_became_active":"2024-08-31T04:23:04.277752+0000","last_became_peered":"2024-08-31T04:23:04.277752+0000","last_unstale":"2024-08-31T04:24:35.175167+0000","last_undegraded":"2024-08-31T04:24:35.175167+0000","last_fullsized":"2024-08-31T04:24:35.175167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:11.798984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479384+0000","last_change":"2024-08-31T04:22:57.259289+0000","last_active":"2024-08-31T04:25:03.479384+0000","last_peered":"2024-08-31T04:25:03.479384+0000","last_clean":"2024-08-31T04:25:03.479384+0000","last_became_active":"2024-08-31T04:22:57.258904+0000","last_became_peered":"2024-08-31T04:22:57.258904+0000","last_unstale":"2024-08-31T04:25:03.479384+0000","last_undegraded":"2024-08-31T04:25:03.479384+0000","last_fullsized":"2024-08-31T04:25:03.479384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:24.229076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899828+0000","last_change":"2024-08-31T04:22:55.223518+0000","last_active":"2024-08-31T04:24:34.899828+0000","last_peered":"2024-08-31T04:24:34.899828+0000","last_clean":"2024-08-31T04:24:34.899828+0000","last_became_active":"2024-08-31T04:22:55.223122+0000","last_became_peered":"2024-08-31T04:22:55.223122+0000","last_unstale":"2024-08-31T04:24:34.899828+0000","last_undegraded":"2024-08-31T04:24:34.899828+0000","last_fullsized":"2024-08-31T04:24:34.899828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:26.432000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900651+0000","last_change":"2024-08-31T04:23:04.282088+0000","last_active":"2024-08-31T04:24:34.900651+0000","last_peered":"2024-08-31T04:24:34.900651+0000","last_clean":"2024-08-31T04:24:34.900651+0000","last_became_active":"2024-08-31T04:23:04.281393+0000","last_became_peered":"2024-08-31T04:23:04.281393+0000","last_unstale":"2024-08-31T04:24:34.900651+0000","last_undegraded":"2024-08-31T04:24:34.900651+0000","last_fullsized":"2024-08-31T04:24:34.900651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:34.473497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463870+0000","last_change":"2024-08-31T04:22:57.259923+0000","last_active":"2024-08-31T04:25:03.463870+0000","last_peered":"2024-08-31T04:25:03.463870+0000","last_clean":"2024-08-31T04:25:03.463870+0000","last_became_active":"2024-08-31T04:22:57.259542+0000","last_became_peered":"2024-08-31T04:22:57.259542+0000","last_unstale":"2024-08-31T04:25:03.463870+0000","last_undegraded":"2024-08-31T04:25:03.463870+0000","last_fullsized":"2024-08-31T04:25:03.463870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:33.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:14.103200+0000","last_change":"2024-08-31T04:22:55.228209+0000","last_active":"2024-08-31T04:25:14.103200+0000","last_peered":"2024-08-31T04:25:14.103200+0000","last_clean":"2024-08-31T04:25:14.103200+0000","last_became_active":"2024-08-31T04:22:55.227794+0000","last_became_peered":"2024-08-31T04:22:55.227794+0000","last_unstale":"2024-08-31T04:25:14.103200+0000","last_undegraded":"2024-08-31T04:25:14.103200+0000","last_fullsized":"2024-08-31T04:25:14.103200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:14.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.900799+0000","last_change":"2024-08-31T04:23:04.278128+0000","last_active":"2024-08-31T04:24:34.900799+0000","last_peered":"2024-08-31T04:24:34.900799+0000","last_clean":"2024-08-31T04:24:34.900799+0000","last_became_active":"2024-08-31T04:23:04.277549+0000","last_became_peered":"2024-08-31T04:23:04.277549+0000","last_unstale":"2024-08-31T04:24:34.900799+0000","last_undegraded":"2024-08-31T04:24:34.900799+0000","last_fullsized":"2024-08-31T04:24:34.900799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:27.692936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484382+0000","last_change":"2024-08-31T04:22:57.249135+0000","last_active":"2024-08-31T04:25:03.484382+0000","last_peered":"2024-08-31T04:25:03.484382+0000","last_clean":"2024-08-31T04:25:03.484382+0000","last_became_active":"2024-08-31T04:22:57.248781+0000","last_became_peered":"2024-08-31T04:22:57.248781+0000","last_unstale":"2024-08-31T04:25:03.484382+0000","last_undegraded":"2024-08-31T04:25:03.484382+0000","last_fullsized":"2024-08-31T04:25:03.484382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:45:05.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.907149+0000","last_change":"2024-08-31T04:22:55.315422+0000","last_active":"2024-08-31T04:24:34.907149+0000","last_peered":"2024-08-31T04:24:34.907149+0000","last_clean":"2024-08-31T04:24:34.907149+0000","last_became_active":"2024-08-31T04:22:55.315036+0000","last_became_peered":"2024-08-31T04:22:55.315036+0000","last_unstale":"2024-08-31T04:24:34.907149+0000","last_undegraded":"2024-08-31T04:24:34.907149+0000","last_fullsized":"2024-08-31T04:24:34.907149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:15.779247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899738+0000","last_change":"2024-08-31T04:23:04.277508+0000","last_active":"2024-08-31T04:24:34.899738+0000","last_peered":"2024-08-31T04:24:34.899738+0000","last_clean":"2024-08-31T04:24:34.899738+0000","last_became_active":"2024-08-31T04:23:04.277030+0000","last_became_peered":"2024-08-31T04:23:04.277030+0000","last_unstale":"2024-08-31T04:24:34.899738+0000","last_undegraded":"2024-08-31T04:24:34.899738+0000","last_fullsized":"2024-08-31T04:24:34.899738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:42.832518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479625+0000","last_change":"2024-08-31T04:22:57.252115+0000","last_active":"2024-08-31T04:25:03.479625+0000","last_peered":"2024-08-31T04:25:03.479625+0000","last_clean":"2024-08-31T04:25:03.479625+0000","last_became_active":"2024-08-31T04:22:57.251736+0000","last_became_peered":"2024-08-31T04:22:57.251736+0000","last_unstale":"2024-08-31T04:25:03.479625+0000","last_undegraded":"2024-08-31T04:25:03.479625+0000","last_fullsized":"2024-08-31T04:25:03.479625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:04.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.604326+0000","last_change":"2024-08-31T04:23:34.372856+0000","last_active":"2024-08-31T04:25:30.604326+0000","last_peered":"2024-08-31T04:25:30.604326+0000","last_clean":"2024-08-31T04:25:30.604326+0000","last_became_active":"2024-08-31T04:23:34.372401+0000","last_became_peered":"2024-08-31T04:23:34.372401+0000","last_unstale":"2024-08-31T04:25:30.604326+0000","last_undegraded":"2024-08-31T04:25:30.604326+0000","last_fullsized":"2024-08-31T04:25:30.604326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:56.884427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.176861+0000","last_change":"2024-08-31T04:24:35.176740+0000","last_active":"2024-08-31T04:24:35.176861+0000","last_peered":"2024-08-31T04:24:35.176861+0000","last_clean":"2024-08-31T04:24:35.176861+0000","last_became_active":"2024-08-31T04:24:35.176138+0000","last_became_peered":"2024-08-31T04:24:35.176138+0000","last_unstale":"2024-08-31T04:24:35.176861+0000","last_undegraded":"2024-08-31T04:24:35.176861+0000","last_fullsized":"2024-08-31T04:24:35.176861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:42:51.558180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480238+0000","last_change":"2024-08-31T04:22:57.259513+0000","last_active":"2024-08-31T04:25:03.480238+0000","last_peered":"2024-08-31T04:25:03.480238+0000","last_clean":"2024-08-31T04:25:03.480238+0000","last_became_active":"2024-08-31T04:22:57.259128+0000","last_became_peered":"2024-08-31T04:22:57.259128+0000","last_unstale":"2024-08-31T04:25:03.480238+0000","last_undegraded":"2024-08-31T04:25:03.480238+0000","last_fullsized":"2024-08-31T04:25:03.480238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:20:16.148887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901364+0000","last_change":"2024-08-31T04:22:55.233888+0000","last_active":"2024-08-31T04:24:34.901364+0000","last_peered":"2024-08-31T04:24:34.901364+0000","last_clean":"2024-08-31T04:24:34.901364+0000","last_became_active":"2024-08-31T04:22:55.233442+0000","last_became_peered":"2024-08-31T04:22:55.233442+0000","last_unstale":"2024-08-31T04:24:34.901364+0000","last_undegraded":"2024-08-31T04:24:34.901364+0000","last_fullsized":"2024-08-31T04:24:34.901364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:52.995283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065414+0000","last_change":"2024-08-31T04:23:04.286469+0000","last_active":"2024-08-31T04:24:35.065414+0000","last_peered":"2024-08-31T04:24:35.065414+0000","last_clean":"2024-08-31T04:24:35.065414+0000","last_became_active":"2024-08-31T04:23:04.285995+0000","last_became_peered":"2024-08-31T04:23:04.285995+0000","last_unstale":"2024-08-31T04:24:35.065414+0000","last_undegraded":"2024-08-31T04:24:35.065414+0000","last_fullsized":"2024-08-31T04:24:35.065414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:09.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461236+0000","last_change":"2024-08-31T04:24:35.164497+0000","last_active":"2024-08-31T04:25:03.461236+0000","last_peered":"2024-08-31T04:25:03.461236+0000","last_clean":"2024-08-31T04:25:03.461236+0000","last_became_active":"2024-08-31T04:24:35.164098+0000","last_became_peered":"2024-08-31T04:24:35.164098+0000","last_unstale":"2024-08-31T04:25:03.461236+0000","last_undegraded":"2024-08-31T04:25:03.461236+0000","last_fullsized":"2024-08-31T04:25:03.461236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:15:24.395819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903777+0000","last_change":"2024-08-31T04:22:55.229252+0000","last_active":"2024-08-31T04:24:34.903777+0000","last_peered":"2024-08-31T04:24:34.903777+0000","last_clean":"2024-08-31T04:24:34.903777+0000","last_became_active":"2024-08-31T04:22:55.225226+0000","last_became_peered":"2024-08-31T04:22:55.225226+0000","last_unstale":"2024-08-31T04:24:34.903777+0000","last_undegraded":"2024-08-31T04:24:34.903777+0000","last_fullsized":"2024-08-31T04:24:34.903777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:12:42.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902055+0000","last_change":"2024-08-31T04:23:04.278779+0000","last_active":"2024-08-31T04:24:34.902055+0000","last_peered":"2024-08-31T04:24:34.902055+0000","last_clean":"2024-08-31T04:24:34.902055+0000","last_became_active":"2024-08-31T04:23:04.278180+0000","last_became_peered":"2024-08-31T04:23:04.278180+0000","last_unstale":"2024-08-31T04:24:34.902055+0000","last_undegraded":"2024-08-31T04:24:34.902055+0000","last_fullsized":"2024-08-31T04:24:34.902055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:42.794541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.464574+0000","last_change":"2024-08-31T04:22:57.260396+0000","last_active":"2024-08-31T04:25:03.464574+0000","last_peered":"2024-08-31T04:25:03.464574+0000","last_clean":"2024-08-31T04:25:03.464574+0000","last_became_active":"2024-08-31T04:22:57.259968+0000","last_became_peered":"2024-08-31T04:22:57.259968+0000","last_unstale":"2024-08-31T04:25:03.464574+0000","last_undegraded":"2024-08-31T04:25:03.464574+0000","last_fullsized":"2024-08-31T04:25:03.464574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:37:34.661482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'40","reported_seq":315,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.603977+0000","last_change":"2024-08-31T04:22:55.229560+0000","last_active":"2024-08-31T04:25:30.603977+0000","last_peered":"2024-08-31T04:25:30.603977+0000","last_clean":"2024-08-31T04:25:30.603977+0000","last_became_active":"2024-08-31T04:22:55.229099+0000","last_became_peered":"2024-08-31T04:22:55.229099+0000","last_unstale":"2024-08-31T04:25:30.603977+0000","last_undegraded":"2024-08-31T04:25:30.603977+0000","last_fullsized":"2024-08-31T04:25:30.603977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:27.647271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69880,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":186,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903027+0000","last_change":"2024-08-31T04:23:04.283661+0000","last_active":"2024-08-31T04:24:34.903027+0000","last_peered":"2024-08-31T04:24:34.903027+0000","last_clean":"2024-08-31T04:24:34.903027+0000","last_became_active":"2024-08-31T04:23:04.282971+0000","last_became_peered":"2024-08-31T04:23:04.282971+0000","last_unstale":"2024-08-31T04:24:34.903027+0000","last_undegraded":"2024-08-31T04:24:34.903027+0000","last_fullsized":"2024-08-31T04:24:34.903027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:30.453595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484812+0000","last_change":"2024-08-31T04:22:57.248778+0000","last_active":"2024-08-31T04:25:03.484812+0000","last_peered":"2024-08-31T04:25:03.484812+0000","last_clean":"2024-08-31T04:25:03.484812+0000","last_became_active":"2024-08-31T04:22:57.247847+0000","last_became_peered":"2024-08-31T04:22:57.247847+0000","last_unstale":"2024-08-31T04:25:03.484812+0000","last_undegraded":"2024-08-31T04:25:03.484812+0000","last_fullsized":"2024-08-31T04:25:03.484812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:23:57.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902401+0000","last_change":"2024-08-31T04:22:55.316307+0000","last_active":"2024-08-31T04:24:34.902401+0000","last_peered":"2024-08-31T04:24:34.902401+0000","last_clean":"2024-08-31T04:24:34.902401+0000","last_became_active":"2024-08-31T04:22:55.315856+0000","last_became_peered":"2024-08-31T04:22:55.315856+0000","last_unstale":"2024-08-31T04:24:34.902401+0000","last_undegraded":"2024-08-31T04:24:34.902401+0000","last_fullsized":"2024-08-31T04:24:34.902401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:36:29.997984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.178064+0000","last_change":"2024-08-31T04:24:35.177476+0000","last_active":"2024-08-31T04:24:35.178064+0000","last_peered":"2024-08-31T04:24:35.178064+0000","last_clean":"2024-08-31T04:24:35.178064+0000","last_became_active":"2024-08-31T04:24:35.176766+0000","last_became_peered":"2024-08-31T04:24:35.176766+0000","last_unstale":"2024-08-31T04:24:35.178064+0000","last_undegraded":"2024-08-31T04:24:35.178064+0000","last_fullsized":"2024-08-31T04:24:35.178064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:41.448820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472597+0000","last_change":"2024-08-31T04:22:57.243938+0000","last_active":"2024-08-31T04:25:03.472597+0000","last_peered":"2024-08-31T04:25:03.472597+0000","last_clean":"2024-08-31T04:25:03.472597+0000","last_became_active":"2024-08-31T04:22:57.243578+0000","last_became_peered":"2024-08-31T04:22:57.243578+0000","last_unstale":"2024-08-31T04:25:03.472597+0000","last_undegraded":"2024-08-31T04:25:03.472597+0000","last_fullsized":"2024-08-31T04:25:03.472597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:51.420373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.163475+0000","last_change":"2024-08-31T04:22:55.231601+0000","last_active":"2024-08-31T04:24:35.163475+0000","last_peered":"2024-08-31T04:24:35.163475+0000","last_clean":"2024-08-31T04:24:35.163475+0000","last_became_active":"2024-08-31T04:22:55.229629+0000","last_became_peered":"2024-08-31T04:22:55.229629+0000","last_unstale":"2024-08-31T04:24:35.163475+0000","last_undegraded":"2024-08-31T04:24:35.163475+0000","last_fullsized":"2024-08-31T04:24:35.163475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:46.520466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.902756+0000","last_change":"2024-08-31T04:23:04.281963+0000","last_active":"2024-08-31T04:24:34.902756+0000","last_peered":"2024-08-31T04:24:34.902756+0000","last_clean":"2024-08-31T04:24:34.902756+0000","last_became_active":"2024-08-31T04:23:04.281492+0000","last_became_peered":"2024-08-31T04:23:04.281492+0000","last_unstale":"2024-08-31T04:24:34.902756+0000","last_undegraded":"2024-08-31T04:24:34.902756+0000","last_fullsized":"2024-08-31T04:24:34.902756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:17.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483202+0000","last_change":"2024-08-31T04:22:57.251141+0000","last_active":"2024-08-31T04:25:03.483202+0000","last_peered":"2024-08-31T04:25:03.483202+0000","last_clean":"2024-08-31T04:25:03.483202+0000","last_became_active":"2024-08-31T04:22:57.250555+0000","last_became_peered":"2024-08-31T04:22:57.250555+0000","last_unstale":"2024-08-31T04:25:03.483202+0000","last_undegraded":"2024-08-31T04:25:03.483202+0000","last_fullsized":"2024-08-31T04:25:03.483202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:14.350386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:29.601596+0000","last_change":"2024-08-31T04:22:55.230591+0000","last_active":"2024-08-31T04:25:29.601596+0000","last_peered":"2024-08-31T04:25:29.601596+0000","last_clean":"2024-08-31T04:25:29.601596+0000","last_became_active":"2024-08-31T04:22:55.230061+0000","last_became_peered":"2024-08-31T04:22:55.230061+0000","last_unstale":"2024-08-31T04:25:29.601596+0000","last_undegraded":"2024-08-31T04:25:29.601596+0000","last_fullsized":"2024-08-31T04:25:29.601596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:22.903222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.924327+0000","last_change":"2024-08-31T04:23:04.284083+0000","last_active":"2024-08-31T04:24:34.924327+0000","last_peered":"2024-08-31T04:24:34.924327+0000","last_clean":"2024-08-31T04:24:34.924327+0000","last_became_active":"2024-08-31T04:23:04.283555+0000","last_became_peered":"2024-08-31T04:23:04.283555+0000","last_unstale":"2024-08-31T04:24:34.924327+0000","last_undegraded":"2024-08-31T04:24:34.924327+0000","last_fullsized":"2024-08-31T04:24:34.924327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:17.727160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175135+0000","last_change":"2024-08-31T04:23:04.280954+0000","last_active":"2024-08-31T04:24:35.175135+0000","last_peered":"2024-08-31T04:24:35.175135+0000","last_clean":"2024-08-31T04:24:35.175135+0000","last_became_active":"2024-08-31T04:23:04.279302+0000","last_became_peered":"2024-08-31T04:23:04.279302+0000","last_unstale":"2024-08-31T04:24:35.175135+0000","last_undegraded":"2024-08-31T04:24:35.175135+0000","last_fullsized":"2024-08-31T04:24:35.175135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:44.159073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479015+0000","last_change":"2024-08-31T04:22:57.249201+0000","last_active":"2024-08-31T04:25:03.479015+0000","last_peered":"2024-08-31T04:25:03.479015+0000","last_clean":"2024-08-31T04:25:03.479015+0000","last_became_active":"2024-08-31T04:22:57.248844+0000","last_became_peered":"2024-08-31T04:22:57.248844+0000","last_unstale":"2024-08-31T04:25:03.479015+0000","last_undegraded":"2024-08-31T04:25:03.479015+0000","last_fullsized":"2024-08-31T04:25:03.479015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:06.955086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.901205+0000","last_change":"2024-08-31T04:22:55.233846+0000","last_active":"2024-08-31T04:24:34.901205+0000","last_peered":"2024-08-31T04:24:34.901205+0000","last_clean":"2024-08-31T04:24:34.901205+0000","last_became_active":"2024-08-31T04:22:55.233290+0000","last_became_peered":"2024-08-31T04:22:55.233290+0000","last_unstale":"2024-08-31T04:24:34.901205+0000","last_undegraded":"2024-08-31T04:24:34.901205+0000","last_fullsized":"2024-08-31T04:24:34.901205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:01.030467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.065887+0000","last_change":"2024-08-31T04:23:04.287058+0000","last_active":"2024-08-31T04:24:35.065887+0000","last_peered":"2024-08-31T04:24:35.065887+0000","last_clean":"2024-08-31T04:24:35.065887+0000","last_became_active":"2024-08-31T04:23:04.286384+0000","last_became_peered":"2024-08-31T04:23:04.286384+0000","last_unstale":"2024-08-31T04:24:35.065887+0000","last_undegraded":"2024-08-31T04:24:35.065887+0000","last_fullsized":"2024-08-31T04:24:35.065887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:41.299480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.468686+0000","last_change":"2024-08-31T04:22:57.245323+0000","last_active":"2024-08-31T04:25:03.468686+0000","last_peered":"2024-08-31T04:25:03.468686+0000","last_clean":"2024-08-31T04:25:03.468686+0000","last_became_active":"2024-08-31T04:22:57.244992+0000","last_became_peered":"2024-08-31T04:22:57.244992+0000","last_unstale":"2024-08-31T04:25:03.468686+0000","last_undegraded":"2024-08-31T04:25:03.468686+0000","last_fullsized":"2024-08-31T04:25:03.468686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:48.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.899205+0000","last_change":"2024-08-31T04:22:55.223564+0000","last_active":"2024-08-31T04:24:34.899205+0000","last_peered":"2024-08-31T04:24:34.899205+0000","last_clean":"2024-08-31T04:24:34.899205+0000","last_became_active":"2024-08-31T04:22:55.223232+0000","last_became_peered":"2024-08-31T04:22:55.223232+0000","last_unstale":"2024-08-31T04:24:34.899205+0000","last_undegraded":"2024-08-31T04:24:34.899205+0000","last_fullsized":"2024-08-31T04:24:34.899205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:02:17.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:35.175651+0000","last_change":"2024-08-31T04:23:34.497700+0000","last_active":"2024-08-31T04:24:35.175651+0000","last_peered":"2024-08-31T04:24:35.175651+0000","last_clean":"2024-08-31T04:24:35.175651+0000","last_became_active":"2024-08-31T04:23:34.497071+0000","last_became_peered":"2024-08-31T04:23:34.497071+0000","last_unstale":"2024-08-31T04:24:35.175651+0000","last_undegraded":"2024-08-31T04:24:35.175651+0000","last_fullsized":"2024-08-31T04:24:35.175651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:33.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.475038+0000","last_change":"2024-08-31T04:24:34.925568+0000","last_active":"2024-08-31T04:25:03.475038+0000","last_peered":"2024-08-31T04:25:03.475038+0000","last_clean":"2024-08-31T04:25:03.475038+0000","last_became_active":"2024-08-31T04:24:34.925006+0000","last_became_peered":"2024-08-31T04:24:34.925006+0000","last_unstale":"2024-08-31T04:25:03.475038+0000","last_undegraded":"2024-08-31T04:25:03.475038+0000","last_fullsized":"2024-08-31T04:25:03.475038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:36:48.348887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903878+0000","last_change":"2024-08-31T04:23:04.284071+0000","last_active":"2024-08-31T04:24:34.903878+0000","last_peered":"2024-08-31T04:24:34.903878+0000","last_clean":"2024-08-31T04:24:34.903878+0000","last_became_active":"2024-08-31T04:23:04.283508+0000","last_became_peered":"2024-08-31T04:23:04.283508+0000","last_unstale":"2024-08-31T04:24:34.903878+0000","last_undegraded":"2024-08-31T04:24:34.903878+0000","last_fullsized":"2024-08-31T04:24:34.903878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:04:58.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'8","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:30.604322+0000","last_change":"2024-08-31T04:23:34.379043+0000","last_active":"2024-08-31T04:25:30.604322+0000","last_peered":"2024-08-31T04:25:30.604322+0000","last_clean":"2024-08-31T04:25:30.604322+0000","last_became_active":"2024-08-31T04:23:34.378323+0000","last_became_peered":"2024-08-31T04:23:34.378323+0000","last_unstale":"2024-08-31T04:25:30.604322+0000","last_undegraded":"2024-08-31T04:25:30.604322+0000","last_fullsized":"2024-08-31T04:25:30.604322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:54.201894+0000","last_clean_scrub_stamp":"2024-08-31T04:22:54.201894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:57.723332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458136+0000","last_change":"2024-08-31T04:22:57.247163+0000","last_active":"2024-08-31T04:25:03.458136+0000","last_peered":"2024-08-31T04:25:03.458136+0000","last_clean":"2024-08-31T04:25:03.458136+0000","last_became_active":"2024-08-31T04:22:57.246788+0000","last_became_peered":"2024-08-31T04:22:57.246788+0000","last_unstale":"2024-08-31T04:25:03.458136+0000","last_undegraded":"2024-08-31T04:25:03.458136+0000","last_fullsized":"2024-08-31T04:25:03.458136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:00.508557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:24:34.903617+0000","last_change":"2024-08-31T04:23:04.280761+0000","last_active":"2024-08-31T04:24:34.903617+0000","last_peered":"2024-08-31T04:24:34.903617+0000","last_clean":"2024-08-31T04:24:34.903617+0000","last_became_active":"2024-08-31T04:23:04.280261+0000","last_became_peered":"2024-08-31T04:23:04.280261+0000","last_unstale":"2024-08-31T04:24:34.903617+0000","last_undegraded":"2024-08-31T04:24:34.903617+0000","last_fullsized":"2024-08-31T04:24:34.903617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:23:03.258282+0000","last_clean_scrub_stamp":"2024-08-31T04:23:03.258282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:12.584751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473928+0000","last_change":"2024-08-31T04:22:57.255226+0000","last_active":"2024-08-31T04:25:03.473928+0000","last_peered":"2024-08-31T04:25:03.473928+0000","last_clean":"2024-08-31T04:25:03.473928+0000","last_became_active":"2024-08-31T04:22:57.254859+0000","last_became_peered":"2024-08-31T04:22:57.254859+0000","last_unstale":"2024-08-31T04:25:03.473928+0000","last_undegraded":"2024-08-31T04:25:03.473928+0000","last_fullsized":"2024-08-31T04:25:03.473928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:37:27.000803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465376+0000","last_change":"2024-08-31T04:24:34.911575+0000","last_active":"2024-08-31T04:25:03.465376+0000","last_peered":"2024-08-31T04:25:03.465376+0000","last_clean":"2024-08-31T04:25:03.465376+0000","last_became_active":"2024-08-31T04:24:34.911169+0000","last_became_peered":"2024-08-31T04:24:34.911169+0000","last_unstale":"2024-08-31T04:25:03.465376+0000","last_undegraded":"2024-08-31T04:25:03.465376+0000","last_fullsized":"2024-08-31T04:25:03.465376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:33:52.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467147+0000","last_change":"2024-08-31T04:22:57.255214+0000","last_active":"2024-08-31T04:25:03.467147+0000","last_peered":"2024-08-31T04:25:03.467147+0000","last_clean":"2024-08-31T04:25:03.467147+0000","last_became_active":"2024-08-31T04:22:57.254802+0000","last_became_peered":"2024-08-31T04:22:57.254802+0000","last_unstale":"2024-08-31T04:25:03.467147+0000","last_undegraded":"2024-08-31T04:25:03.467147+0000","last_fullsized":"2024-08-31T04:25:03.467147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:13:40.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.472966+0000","last_change":"2024-08-31T04:22:57.243901+0000","last_active":"2024-08-31T04:25:03.472966+0000","last_peered":"2024-08-31T04:25:03.472966+0000","last_clean":"2024-08-31T04:25:03.472966+0000","last_became_active":"2024-08-31T04:22:57.243538+0000","last_became_peered":"2024-08-31T04:22:57.243538+0000","last_unstale":"2024-08-31T04:25:03.472966+0000","last_undegraded":"2024-08-31T04:25:03.472966+0000","last_fullsized":"2024-08-31T04:25:03.472966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:39.697479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.465415+0000","last_change":"2024-08-31T04:22:57.241620+0000","last_active":"2024-08-31T04:25:03.465415+0000","last_peered":"2024-08-31T04:25:03.465415+0000","last_clean":"2024-08-31T04:25:03.465415+0000","last_became_active":"2024-08-31T04:22:57.241236+0000","last_became_peered":"2024-08-31T04:22:57.241236+0000","last_unstale":"2024-08-31T04:25:03.465415+0000","last_undegraded":"2024-08-31T04:25:03.465415+0000","last_fullsized":"2024-08-31T04:25:03.465415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:39:51.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.469722+0000","last_change":"2024-08-31T04:22:57.258812+0000","last_active":"2024-08-31T04:25:03.469722+0000","last_peered":"2024-08-31T04:25:03.469722+0000","last_clean":"2024-08-31T04:25:03.469722+0000","last_became_active":"2024-08-31T04:22:57.255636+0000","last_became_peered":"2024-08-31T04:22:57.255636+0000","last_unstale":"2024-08-31T04:25:03.469722+0000","last_undegraded":"2024-08-31T04:25:03.469722+0000","last_fullsized":"2024-08-31T04:25:03.469722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:35:17.471135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466083+0000","last_change":"2024-08-31T04:22:57.254236+0000","last_active":"2024-08-31T04:25:03.466083+0000","last_peered":"2024-08-31T04:25:03.466083+0000","last_clean":"2024-08-31T04:25:03.466083+0000","last_became_active":"2024-08-31T04:22:57.253866+0000","last_became_peered":"2024-08-31T04:22:57.253866+0000","last_unstale":"2024-08-31T04:25:03.466083+0000","last_undegraded":"2024-08-31T04:25:03.466083+0000","last_fullsized":"2024-08-31T04:25:03.466083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:47.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462176+0000","last_change":"2024-08-31T04:22:57.253856+0000","last_active":"2024-08-31T04:25:03.462176+0000","last_peered":"2024-08-31T04:25:03.462176+0000","last_clean":"2024-08-31T04:25:03.462176+0000","last_became_active":"2024-08-31T04:22:57.253507+0000","last_became_peered":"2024-08-31T04:22:57.253507+0000","last_unstale":"2024-08-31T04:25:03.462176+0000","last_undegraded":"2024-08-31T04:25:03.462176+0000","last_fullsized":"2024-08-31T04:25:03.462176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:36:09.231067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474651+0000","last_change":"2024-08-31T04:22:57.237537+0000","last_active":"2024-08-31T04:25:03.474651+0000","last_peered":"2024-08-31T04:25:03.474651+0000","last_clean":"2024-08-31T04:25:03.474651+0000","last_became_active":"2024-08-31T04:22:57.237171+0000","last_became_peered":"2024-08-31T04:22:57.237171+0000","last_unstale":"2024-08-31T04:25:03.474651+0000","last_undegraded":"2024-08-31T04:25:03.474651+0000","last_fullsized":"2024-08-31T04:25:03.474651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:58.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471604+0000","last_change":"2024-08-31T04:22:57.252938+0000","last_active":"2024-08-31T04:25:03.471604+0000","last_peered":"2024-08-31T04:25:03.471604+0000","last_clean":"2024-08-31T04:25:03.471604+0000","last_became_active":"2024-08-31T04:22:57.252503+0000","last_became_peered":"2024-08-31T04:22:57.252503+0000","last_unstale":"2024-08-31T04:25:03.471604+0000","last_undegraded":"2024-08-31T04:25:03.471604+0000","last_fullsized":"2024-08-31T04:25:03.471604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:53.799358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484840+0000","last_change":"2024-08-31T04:22:57.261989+0000","last_active":"2024-08-31T04:25:03.484840+0000","last_peered":"2024-08-31T04:25:03.484840+0000","last_clean":"2024-08-31T04:25:03.484840+0000","last_became_active":"2024-08-31T04:22:57.260654+0000","last_became_peered":"2024-08-31T04:22:57.260654+0000","last_unstale":"2024-08-31T04:25:03.484840+0000","last_undegraded":"2024-08-31T04:25:03.484840+0000","last_fullsized":"2024-08-31T04:25:03.484840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:01.248574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.466933+0000","last_change":"2024-08-31T04:22:57.257415+0000","last_active":"2024-08-31T04:25:03.466933+0000","last_peered":"2024-08-31T04:25:03.466933+0000","last_clean":"2024-08-31T04:25:03.466933+0000","last_became_active":"2024-08-31T04:22:57.257037+0000","last_became_peered":"2024-08-31T04:22:57.257037+0000","last_unstale":"2024-08-31T04:25:03.466933+0000","last_undegraded":"2024-08-31T04:25:03.466933+0000","last_fullsized":"2024-08-31T04:25:03.466933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:22.101844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471944+0000","last_change":"2024-08-31T04:22:57.254592+0000","last_active":"2024-08-31T04:25:03.471944+0000","last_peered":"2024-08-31T04:25:03.471944+0000","last_clean":"2024-08-31T04:25:03.471944+0000","last_became_active":"2024-08-31T04:22:57.254155+0000","last_became_peered":"2024-08-31T04:22:57.254155+0000","last_unstale":"2024-08-31T04:25:03.471944+0000","last_undegraded":"2024-08-31T04:25:03.471944+0000","last_fullsized":"2024-08-31T04:25:03.471944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:00.308516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.461114+0000","last_change":"2024-08-31T04:22:57.251247+0000","last_active":"2024-08-31T04:25:03.461114+0000","last_peered":"2024-08-31T04:25:03.461114+0000","last_clean":"2024-08-31T04:25:03.461114+0000","last_became_active":"2024-08-31T04:22:57.250890+0000","last_became_peered":"2024-08-31T04:22:57.250890+0000","last_unstale":"2024-08-31T04:25:03.461114+0000","last_undegraded":"2024-08-31T04:25:03.461114+0000","last_fullsized":"2024-08-31T04:25:03.461114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:41.702982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477404+0000","last_change":"2024-08-31T04:22:57.254174+0000","last_active":"2024-08-31T04:25:03.477404+0000","last_peered":"2024-08-31T04:25:03.477404+0000","last_clean":"2024-08-31T04:25:03.477404+0000","last_became_active":"2024-08-31T04:22:57.253781+0000","last_became_peered":"2024-08-31T04:22:57.253781+0000","last_unstale":"2024-08-31T04:25:03.477404+0000","last_undegraded":"2024-08-31T04:25:03.477404+0000","last_fullsized":"2024-08-31T04:25:03.477404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:45:44.614932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485429+0000","last_change":"2024-08-31T04:22:57.259039+0000","last_active":"2024-08-31T04:25:03.485429+0000","last_peered":"2024-08-31T04:25:03.485429+0000","last_clean":"2024-08-31T04:25:03.485429+0000","last_became_active":"2024-08-31T04:22:57.258624+0000","last_became_peered":"2024-08-31T04:22:57.258624+0000","last_unstale":"2024-08-31T04:25:03.485429+0000","last_undegraded":"2024-08-31T04:25:03.485429+0000","last_fullsized":"2024-08-31T04:25:03.485429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:00:57.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.483639+0000","last_change":"2024-08-31T04:22:57.254714+0000","last_active":"2024-08-31T04:25:03.483639+0000","last_peered":"2024-08-31T04:25:03.483639+0000","last_clean":"2024-08-31T04:25:03.483639+0000","last_became_active":"2024-08-31T04:22:57.254293+0000","last_became_peered":"2024-08-31T04:22:57.254293+0000","last_unstale":"2024-08-31T04:25:03.483639+0000","last_undegraded":"2024-08-31T04:25:03.483639+0000","last_fullsized":"2024-08-31T04:25:03.483639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:44.953054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.467964+0000","last_change":"2024-08-31T04:23:34.376830+0000","last_active":"2024-08-31T04:25:03.467964+0000","last_peered":"2024-08-31T04:25:03.467964+0000","last_clean":"2024-08-31T04:25:03.467964+0000","last_became_active":"2024-08-31T04:23:34.376391+0000","last_became_peered":"2024-08-31T04:23:34.376391+0000","last_unstale":"2024-08-31T04:25:03.467964+0000","last_undegraded":"2024-08-31T04:25:03.467964+0000","last_fullsized":"2024-08-31T04:25:03.467964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:12.213462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.474975+0000","last_change":"2024-08-31T04:22:57.250481+0000","last_active":"2024-08-31T04:25:03.474975+0000","last_peered":"2024-08-31T04:25:03.474975+0000","last_clean":"2024-08-31T04:25:03.474975+0000","last_became_active":"2024-08-31T04:22:57.249340+0000","last_became_peered":"2024-08-31T04:22:57.249340+0000","last_unstale":"2024-08-31T04:25:03.474975+0000","last_undegraded":"2024-08-31T04:25:03.474975+0000","last_fullsized":"2024-08-31T04:25:03.474975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:46:11.301559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.473599+0000","last_change":"2024-08-31T04:22:57.246607+0000","last_active":"2024-08-31T04:25:03.473599+0000","last_peered":"2024-08-31T04:25:03.473599+0000","last_clean":"2024-08-31T04:25:03.473599+0000","last_became_active":"2024-08-31T04:22:57.246089+0000","last_became_peered":"2024-08-31T04:22:57.246089+0000","last_unstale":"2024-08-31T04:25:03.473599+0000","last_undegraded":"2024-08-31T04:25:03.473599+0000","last_fullsized":"2024-08-31T04:25:03.473599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:22:48.998855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.462005+0000","last_change":"2024-08-31T04:22:57.248844+0000","last_active":"2024-08-31T04:25:03.462005+0000","last_peered":"2024-08-31T04:25:03.462005+0000","last_clean":"2024-08-31T04:25:03.462005+0000","last_became_active":"2024-08-31T04:22:57.248253+0000","last_became_peered":"2024-08-31T04:22:57.248253+0000","last_unstale":"2024-08-31T04:25:03.462005+0000","last_undegraded":"2024-08-31T04:25:03.462005+0000","last_fullsized":"2024-08-31T04:25:03.462005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:55.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484966+0000","last_change":"2024-08-31T04:22:57.263268+0000","last_active":"2024-08-31T04:25:03.484966+0000","last_peered":"2024-08-31T04:25:03.484966+0000","last_clean":"2024-08-31T04:25:03.484966+0000","last_became_active":"2024-08-31T04:22:57.262906+0000","last_became_peered":"2024-08-31T04:22:57.262906+0000","last_unstale":"2024-08-31T04:25:03.484966+0000","last_undegraded":"2024-08-31T04:25:03.484966+0000","last_fullsized":"2024-08-31T04:25:03.484966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:58.986962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.477868+0000","last_change":"2024-08-31T04:22:57.259088+0000","last_active":"2024-08-31T04:25:03.477868+0000","last_peered":"2024-08-31T04:25:03.477868+0000","last_clean":"2024-08-31T04:25:03.477868+0000","last_became_active":"2024-08-31T04:22:57.258673+0000","last_became_peered":"2024-08-31T04:22:57.258673+0000","last_unstale":"2024-08-31T04:25:03.477868+0000","last_undegraded":"2024-08-31T04:25:03.477868+0000","last_fullsized":"2024-08-31T04:25:03.477868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:40.308151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.484644+0000","last_change":"2024-08-31T04:24:35.165233+0000","last_active":"2024-08-31T04:25:03.484644+0000","last_peered":"2024-08-31T04:25:03.484644+0000","last_clean":"2024-08-31T04:25:03.484644+0000","last_became_active":"2024-08-31T04:24:35.164694+0000","last_became_peered":"2024-08-31T04:24:35.164694+0000","last_unstale":"2024-08-31T04:25:03.484644+0000","last_undegraded":"2024-08-31T04:25:03.484644+0000","last_fullsized":"2024-08-31T04:25:03.484644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:20:04.549787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480788+0000","last_change":"2024-08-31T04:22:57.248427+0000","last_active":"2024-08-31T04:25:03.480788+0000","last_peered":"2024-08-31T04:25:03.480788+0000","last_clean":"2024-08-31T04:25:03.480788+0000","last_became_active":"2024-08-31T04:22:57.248087+0000","last_became_peered":"2024-08-31T04:22:57.248087+0000","last_unstale":"2024-08-31T04:25:03.480788+0000","last_undegraded":"2024-08-31T04:25:03.480788+0000","last_fullsized":"2024-08-31T04:25:03.480788+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:32.593043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.481754+0000","last_change":"2024-08-31T04:22:57.257145+0000","last_active":"2024-08-31T04:25:03.481754+0000","last_peered":"2024-08-31T04:25:03.481754+0000","last_clean":"2024-08-31T04:25:03.481754+0000","last_became_active":"2024-08-31T04:22:57.256708+0000","last_became_peered":"2024-08-31T04:22:57.256708+0000","last_unstale":"2024-08-31T04:25:03.481754+0000","last_undegraded":"2024-08-31T04:25:03.481754+0000","last_fullsized":"2024-08-31T04:25:03.481754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:13:19.931259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.480512+0000","last_change":"2024-08-31T04:22:57.254468+0000","last_active":"2024-08-31T04:25:03.480512+0000","last_peered":"2024-08-31T04:25:03.480512+0000","last_clean":"2024-08-31T04:25:03.480512+0000","last_became_active":"2024-08-31T04:22:57.253970+0000","last_became_peered":"2024-08-31T04:22:57.253970+0000","last_unstale":"2024-08-31T04:25:03.480512+0000","last_undegraded":"2024-08-31T04:25:03.480512+0000","last_fullsized":"2024-08-31T04:25:03.480512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:19.200249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.458917+0000","last_change":"2024-08-31T04:22:57.249875+0000","last_active":"2024-08-31T04:25:03.458917+0000","last_peered":"2024-08-31T04:25:03.458917+0000","last_clean":"2024-08-31T04:25:03.458917+0000","last_became_active":"2024-08-31T04:22:57.249505+0000","last_became_peered":"2024-08-31T04:22:57.249505+0000","last_unstale":"2024-08-31T04:25:03.458917+0000","last_undegraded":"2024-08-31T04:25:03.458917+0000","last_fullsized":"2024-08-31T04:25:03.458917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:36:18.946893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.463529+0000","last_change":"2024-08-31T04:22:57.257159+0000","last_active":"2024-08-31T04:25:03.463529+0000","last_peered":"2024-08-31T04:25:03.463529+0000","last_clean":"2024-08-31T04:25:03.463529+0000","last_became_active":"2024-08-31T04:22:57.256757+0000","last_became_peered":"2024-08-31T04:22:57.256757+0000","last_unstale":"2024-08-31T04:25:03.463529+0000","last_undegraded":"2024-08-31T04:25:03.463529+0000","last_fullsized":"2024-08-31T04:25:03.463529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:36.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.479776+0000","last_change":"2024-08-31T04:22:57.259359+0000","last_active":"2024-08-31T04:25:03.479776+0000","last_peered":"2024-08-31T04:25:03.479776+0000","last_clean":"2024-08-31T04:25:03.479776+0000","last_became_active":"2024-08-31T04:22:57.258996+0000","last_became_peered":"2024-08-31T04:22:57.258996+0000","last_unstale":"2024-08-31T04:25:03.479776+0000","last_undegraded":"2024-08-31T04:25:03.479776+0000","last_fullsized":"2024-08-31T04:25:03.479776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:58.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.471757+0000","last_change":"2024-08-31T04:22:57.252153+0000","last_active":"2024-08-31T04:25:03.471757+0000","last_peered":"2024-08-31T04:25:03.471757+0000","last_clean":"2024-08-31T04:25:03.471757+0000","last_became_active":"2024-08-31T04:22:57.251757+0000","last_became_peered":"2024-08-31T04:22:57.251757+0000","last_unstale":"2024-08-31T04:25:03.471757+0000","last_undegraded":"2024-08-31T04:25:03.471757+0000","last_fullsized":"2024-08-31T04:25:03.471757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:14:51.872922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T04:25:03.485086+0000","last_change":"2024-08-31T04:22:57.257945+0000","last_active":"2024-08-31T04:25:03.485086+0000","last_peered":"2024-08-31T04:25:03.485086+0000","last_clean":"2024-08-31T04:25:03.485086+0000","last_became_active":"2024-08-31T04:22:57.257588+0000","last_became_peered":"2024-08-31T04:22:57.257588+0000","last_unstale":"2024-08-31T04:25:03.485086+0000","last_undegraded":"2024-08-31T04:25:03.485086+0000","last_fullsized":"2024-08-31T04:25:03.485086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:22:56.213782+0000","last_clean_scrub_stamp":"2024-08-31T04:22:56.213782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:33.734593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75253,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":705,"num_read_kb":432,"num_write":191,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":225759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743469,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":502091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1671168,"data_stored":1158583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495681,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1585152,"data_stored":1096638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":496041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36904,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708248,"statfs":{"total":95995035648,"available":95957245952,"internally_reserved":0,"allocated":1597440,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":503658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":496235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":565977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542238,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":497429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:25:33.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:25:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:34.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 -- 172.21.15.2:0/3630584746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 msgr2=0x7f8c6c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 --2- 172.21.15.2:0/3630584746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c109650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009900 tx=0x7f8c5c02a410 comp rx=0 tx=0).stop 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 -- 172.21.15.2:0/3630584746 shutdown_connections 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 --2- 172.21.15.2:0/3630584746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c109650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 --2- 172.21.15.2:0/3630584746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c109b90 0x7f8c6c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 --2- 172.21.15.2:0/3630584746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c103900 0x7f8c6c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 -- 172.21.15.2:0/3630584746 >> 172.21.15.2:0/3630584746 conn(0x7f8c6c07b5f0 msgr2=0x7f8c6c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 -- 172.21.15.2:0/3630584746 shutdown_connections 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.496+0000 7f8c74267640 1 -- 172.21.15.2:0/3630584746 wait complete. 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 Processor -- start 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 -- start start 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c103900 0x7f8c6c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:34.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 0x7f8c6c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1138a0 con 0x7f8c6c109240 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c113720 con 0x7f8c6c109b90 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c74267640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c113a20 con 0x7f8c6c103900 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44632/0 (socket says 172.21.15.2:44632) 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 -- 172.21.15.2:0/3153505907 learned_addr learned my addr 172.21.15.2:0/3153505907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c72804640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 0x7f8c6c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c72003640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c103900 0x7f8c6c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 -- 172.21.15.2:0/3153505907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c103900 msgr2=0x7f8c6c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c103900 0x7f8c6c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 -- 172.21.15.2:0/3153505907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 msgr2=0x7f8c6c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 0x7f8c6c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c71802640 1 -- 172.21.15.2:0/3153505907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c1a02e0 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.497+0000 7f8c72804640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 0x7f8c6c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c71802640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c005ab0 tx=0x7f8c5c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c03f070 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c5c031b50 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c1a0570 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c035030 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.498+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1a6d30 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.499+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c104b80 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.501+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f8c5c042070 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.502+0000 7f8c637fe640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 0x7f8c580b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.502+0000 7f8c72003640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 0x7f8c580b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.502+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8c5c106250 con 0x7f8c6c109240 2024-08-31T04:25:34.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.502+0000 7f8c72003640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 0x7f8c580b7120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009bd0 tx=0x7f8c68005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:34.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.505+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c5c0ccce0 con 0x7f8c6c109240 2024-08-31T04:25:34.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.727+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c6c103d10 con 0x7f8c6c109240 2024-08-31T04:25:34.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.728+0000 7f8c637fe640 1 -- 172.21.15.2:0/3153505907 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11897 (secure 0 0 0) 0x7f8c5c0cc5e0 con 0x7f8c6c109240 2024-08-31T04:25:34.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:34.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-08-31T04:25:28:900170+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:25:28.432300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:25:34.731 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-08-31T04:25:34.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 msgr2=0x7f8c580b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:34.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 0x7f8c580b7120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009bd0 tx=0x7f8c68005f90 comp rx=0 tx=0).stop 2024-08-31T04:25:34.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 msgr2=0x7f8c6c19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:34.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c005ab0 tx=0x7f8c5c003b90 comp rx=0 tx=0).stop 2024-08-31T04:25:34.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 shutdown_connections 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c580b4c10 0x7f8c580b7120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c109240 0x7f8c6c19a910 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c6c109b90 0x7f8c6c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 --2- 172.21.15.2:0/3153505907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c6c103900 0x7f8c6c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 >> 172.21.15.2:0/3153505907 conn(0x7f8c6c07b5f0 msgr2=0x7f8c6c107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 shutdown_connections 2024-08-31T04:25:34.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:34.731+0000 7f8c74267640 1 -- 172.21.15.2:0/3153505907 wait complete. 2024-08-31T04:25:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:34 smithi002 ceph-mon[18656]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:34 smithi002 ceph-mon[18656]: pgmap v343: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T04:25:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:34 smithi002 ceph-mon[18656]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:34 smithi002 ceph-mon[18656]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:34 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3153505907' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:34 smithi064 ceph-mon[22007]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:34 smithi064 ceph-mon[22007]: pgmap v343: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T04:25:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:34 smithi064 ceph-mon[22007]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:34 smithi064 ceph-mon[22007]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:34 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3153505907' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:34 smithi132 ceph-mon[22335]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:34 smithi132 ceph-mon[22335]: pgmap v343: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T04:25:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:34 smithi132 ceph-mon[22335]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:34 smithi132 ceph-mon[22335]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:25:35.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:34 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3153505907' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:25:35.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:25:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:36.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:35 smithi002 ceph-mon[18656]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T04:25:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 -- 172.21.15.2:0/2003895791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 msgr2=0x7f29b01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/2003895791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b01103c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009ca0 tx=0x7f29a802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 -- 172.21.15.2:0/2003895791 shutdown_connections 2024-08-31T04:25:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/2003895791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b01103c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/2003895791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0109240 0x7f29b0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/2003895791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0103900 0x7f29b0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 -- 172.21.15.2:0/2003895791 >> 172.21.15.2:0/2003895791 conn(0x7f29b007b5f0 msgr2=0x7f29b007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 -- 172.21.15.2:0/2003895791 shutdown_connections 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.172+0000 7f29b6fbd640 1 -- 172.21.15.2:0/2003895791 wait complete. 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 Processor -- start 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 -- start start 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0103900 0x7f29b019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0109240 0x7f29b019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0113850 con 0x7f29b0109b90 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01136d0 con 0x7f29b0103900 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.173+0000 7f29b6fbd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01139d0 con 0x7f29b0109240 2024-08-31T04:25:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58810/0 (socket says 172.21.15.2:58810) 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 -- 172.21.15.2:0/1658939756 learned_addr learned my addr 172.21.15.2:0/1658939756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29affff640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0109240 0x7f29b019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b4d59640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0103900 0x7f29b019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 -- 172.21.15.2:0/1658939756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0109240 msgr2=0x7f29b019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0109240 0x7f29b019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 -- 172.21.15.2:0/1658939756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0103900 msgr2=0x7f29b019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0103900 0x7f29b019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 -- 172.21.15.2:0/1658939756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01a0190 con 0x7f29b0109b90 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b555a640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005cc0 tx=0x7f29a802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8003bf0 con 0x7f29b0109b90 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01a0420 con 0x7f29b0109b90 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a8003d90 con 0x7f29b0109b90 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.174+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a802fbc0 con 0x7f29b0109b90 2024-08-31T04:25:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.175+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a6be0 con 0x7f29b0109b90 2024-08-31T04:25:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.176+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b0103d10 con 0x7f29b0109b90 2024-08-31T04:25:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.177+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f29a802fd60 con 0x7f29b0109b90 2024-08-31T04:25:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.178+0000 7f29adffb640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 0x7f299c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.178+0000 7f29b4d59640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 0x7f299c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.178+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f29a8106f00 con 0x7f29b0109b90 2024-08-31T04:25:36.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.179+0000 7f29b4d59640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 0x7f299c0b7120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2998005fd0 tx=0x7f2998005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.181+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29a80cd990 con 0x7f29b0109b90 2024-08-31T04:25:36.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:35 smithi064 ceph-mon[22007]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T04:25:36.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:35 smithi132 ceph-mon[22335]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T04:25:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.371+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b002e430 con 0x7f29b0109b90 2024-08-31T04:25:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.373+0000 7f29adffb640 1 -- 172.21.15.2:0/1658939756 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25348 (secure 0 0 0) 0x7f29a80098b0 con 0x7f29b0109b90 2024-08-31T04:25:36.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:25:36.375 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:24:34.895861+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:25:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 msgr2=0x7f299c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 0x7f299c0b7120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2998005fd0 tx=0x7f2998005850 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 msgr2=0x7f29b019fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005cc0 tx=0x7f29a802f380 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 shutdown_connections 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f299c0b4c10 0x7f299c0b7120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29b0109b90 0x7f29b019fa60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b0109240 0x7f29b019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 --2- 172.21.15.2:0/1658939756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b0103900 0x7f29b019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 >> 172.21.15.2:0/1658939756 conn(0x7f29b007b5f0 msgr2=0x7f29b0105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 shutdown_connections 2024-08-31T04:25:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:36.376+0000 7f29b6fbd640 1 -- 172.21.15.2:0/1658939756 wait complete. 2024-08-31T04:25:36.983 DEBUG:tasks.fwd_scrub:Yielding 2024-08-31T04:25:36.983 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T04:25:36.993 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T04:25:36.993 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:25:36.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-31T04:25:36.993 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-31T04:25:36.994 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:25:36.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:25:37.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 -- 172.21.15.2:0/2458020598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 msgr2=0x7fc8a410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/2458020598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a410f240 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009ca0 tx=0x7fc89c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 -- 172.21.15.2:0/2458020598 shutdown_connections 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/2458020598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a410f240 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/2458020598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 0x7fc8a41084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/2458020598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 0x7fc8a4102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 -- 172.21.15.2:0/2458020598 >> 172.21.15.2:0/2458020598 conn(0x7fc8a40fe1d0 msgr2=0x7fc8a4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 -- 172.21.15.2:0/2458020598 shutdown_connections 2024-08-31T04:25:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.112+0000 7fc8aa62f640 1 -- 172.21.15.2:0/2458020598 wait complete. 2024-08-31T04:25:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 Processor -- start 2024-08-31T04:25:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 -- start start 2024-08-31T04:25:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 0x7fc8a4199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 0x7fc8a4199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a41126e0 con 0x7fc8a4108a10 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4112560 con 0x7fc8a4102790 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8aa62f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4112860 con 0x7fc8a41080c0 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8a8bcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8a8bcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58816/0 (socket says 172.21.15.2:58816) 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.113+0000 7fc8a8bcc640 1 -- 172.21.15.2:0/1341277468 learned_addr learned my addr 172.21.15.2:0/1341277468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a3fff640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 0x7fc8a4199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a37fe640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 0x7fc8a4199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 -- 172.21.15.2:0/1341277468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 msgr2=0x7fc8a4199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 0x7fc8a4199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 -- 172.21.15.2:0/1341277468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 msgr2=0x7fc8a4199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 0x7fc8a4199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 -- 172.21.15.2:0/1341277468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a419efb0 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a8bcc640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc89c005cc0 tx=0x7fc89c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c003bf0 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc89c003d90 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a419f240 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c02fbc0 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.114+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41a5a30 con 0x7fc8a4108a10 2024-08-31T04:25:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.116+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4103a00 con 0x7fc8a4108a10 2024-08-31T04:25:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.117+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7fc89c02fd60 con 0x7fc8a4108a10 2024-08-31T04:25:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.118+0000 7fc8a17fa640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 0x7fc88c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.119+0000 7fc8a3fff640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 0x7fc88c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.119+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc89c106f00 con 0x7fc8a4108a10 2024-08-31T04:25:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.119+0000 7fc8a3fff640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 0x7fc88c0b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc89400bbe0 tx=0x7fc89400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.121+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc89c0cd930 con 0x7fc8a4108a10 2024-08-31T04:25:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:36 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1658939756' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:36 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1658939756' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:37.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.353+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc8a410a830 con 0x7fc88c0b4c10 2024-08-31T04:25:37.389 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:36 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1658939756' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:25:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.515+0000 7fc8a17fa640 1 -- 172.21.15.2:0/1341277468 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc8a410a830 con 0x7fc88c0b4c10 2024-08-31T04:25:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-08-31T04:25:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 msgr2=0x7fc88c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 0x7fc88c0b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc89400bbe0 tx=0x7fc89400b390 comp rx=0 tx=0).stop 2024-08-31T04:25:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 msgr2=0x7fc8a419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc89c005cc0 tx=0x7fc89c02f380 comp rx=0 tx=0).stop 2024-08-31T04:25:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 shutdown_connections 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc88c0b4c10 0x7fc88c0b7120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4108a10 0x7fc8a419e8b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a41080c0 0x7fc8a4199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 --2- 172.21.15.2:0/1341277468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8a4102790 0x7fc8a4199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 >> 172.21.15.2:0/1341277468 conn(0x7fc8a40fe1d0 msgr2=0x7fc8a41076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 shutdown_connections 2024-08-31T04:25:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.517+0000 7fc8aa62f640 1 -- 172.21.15.2:0/1341277468 wait complete. 2024-08-31T04:25:37.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 -- 172.21.15.2:0/1794694739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34102770 msgr2=0x7f4d34102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/1794694739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34102770 0x7f4d34102b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009900 tx=0x7f4d2402a410 comp rx=0 tx=0).stop 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 -- 172.21.15.2:0/1794694739 shutdown_connections 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/1794694739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341089f0 0x7f4d3410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/1794694739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d341080a0 0x7f4d341084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/1794694739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34102770 0x7f4d34102b80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 -- 172.21.15.2:0/1794694739 >> 172.21.15.2:0/1794694739 conn(0x7f4d340fe150 msgr2=0x7f4d341005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 -- 172.21.15.2:0/1794694739 shutdown_connections 2024-08-31T04:25:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.649+0000 7f4d3a62f640 1 -- 172.21.15.2:0/1794694739 wait complete. 2024-08-31T04:25:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 Processor -- start 2024-08-31T04:25:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 -- start start 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d34102770 0x7f4d341990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341080a0 0x7f4d34199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341126c0 con 0x7f4d341089f0 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34112540 con 0x7f4d34102770 2024-08-31T04:25:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d3a62f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34112840 con 0x7f4d341080a0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d38bcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d38bcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58864/0 (socket says 172.21.15.2:58864) 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d38bcc640 1 -- 172.21.15.2:0/63672044 learned_addr learned my addr 172.21.15.2:0/63672044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d33fff640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d34102770 0x7f4d341990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.650+0000 7f4d337fe640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341080a0 0x7f4d34199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 -- 172.21.15.2:0/63672044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341080a0 msgr2=0x7f4d34199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341080a0 0x7f4d34199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 -- 172.21.15.2:0/63672044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d34102770 msgr2=0x7f4d341990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d34102770 0x7f4d341990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 -- 172.21.15.2:0/63672044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3419f010 con 0x7f4d341089f0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d38bcc640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00eaa0 tx=0x7f4d2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00cdb0 con 0x7f4d341089f0 2024-08-31T04:25:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c005020 con 0x7f4d341089f0 2024-08-31T04:25:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0116d0 con 0x7f4d341089f0 2024-08-31T04:25:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3419f300 con 0x7f4d341089f0 2024-08-31T04:25:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.651+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341a5a90 con 0x7f4d341089f0 2024-08-31T04:25:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.652+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d341039e0 con 0x7f4d341089f0 2024-08-31T04:25:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.653+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f4d2c0051d0 con 0x7f4d341089f0 2024-08-31T04:25:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.654+0000 7f4d317fa640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 0x7f4d1c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.655+0000 7f4d33fff640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 0x7f4d1c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.655+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4d2c0e5a10 con 0x7f4d341089f0 2024-08-31T04:25:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.655+0000 7f4d33fff640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 0x7f4d1c0b71a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d24031440 tx=0x7f4d24009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.659+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d2c016030 con 0x7f4d341089f0 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- 172.21.15.2:0/1240065940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4108a90 msgr2=0x7fe7d410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 --2- 172.21.15.2:0/1240065940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4108a90 0x7fe7d410f2c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009ca0 tx=0x7fe7cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- 172.21.15.2:0/1240065940 shutdown_connections 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 --2- 172.21.15.2:0/1240065940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4108a90 0x7fe7d410f2c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 --2- 172.21.15.2:0/1240065940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108140 0x7fe7d4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 --2- 172.21.15.2:0/1240065940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4102800 0x7fe7d4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- 172.21.15.2:0/1240065940 >> 172.21.15.2:0/1240065940 conn(0x7fe7d40794d0 msgr2=0x7fe7d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- 172.21.15.2:0/1240065940 shutdown_connections 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- 172.21.15.2:0/1240065940 wait complete. 2024-08-31T04:25:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 Processor -- start 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.794+0000 7fe7db845640 1 -- start start 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 0x7fe7d419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108a90 0x7fe7d419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4113820 con 0x7fe7d4102800 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41136a0 con 0x7fe7d4108a90 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7db845640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41139a0 con 0x7fe7d4108140 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58884/0 (socket says 172.21.15.2:58884) 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 -- 172.21.15.2:0/674132815 learned_addr learned my addr 172.21.15.2:0/674132815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108a90 0x7fe7d419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 0x7fe7d419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 -- 172.21.15.2:0/674132815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 msgr2=0x7fe7d419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 0x7fe7d419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 -- 172.21.15.2:0/674132815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108a90 msgr2=0x7fe7d419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108a90 0x7fe7d419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 -- 172.21.15.2:0/674132815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d41a0160 con 0x7fe7d4102800 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 0x7fe7d419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.795+0000 7fe7d95e1640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000e9f0 tx=0x7fe7d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.796+0000 7fe7ca7fc640 1 -- 172.21.15.2:0/674132815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000cd80 con 0x7fe7d4102800 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.796+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41a0450 con 0x7fe7d4102800 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.796+0000 7fe7ca7fc640 1 -- 172.21.15.2:0/674132815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7d00054d0 con 0x7fe7d4102800 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.796+0000 7fe7ca7fc640 1 -- 172.21.15.2:0/674132815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0010690 con 0x7fe7d4102800 2024-08-31T04:25:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.796+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d41a6bb0 con 0x7fe7d4102800 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 Processor -- start 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 -- start start 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca91490 0x55af1ce60cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce61200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af1cdd65f0 con 0x55af1caba350 2024-08-31T04:25:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55af1cdc5b80 con 0x55af1ca99670 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55af1cdc9b30 con 0x55af1ca91490 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.799+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58900/0 (socket says 172.21.15.2:58900) 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 -- 172.21.15.2:0/2267496803 learned_addr learned my addr 172.21.15.2:0/2267496803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7ca7fc640 1 -- 172.21.15.2:0/674132815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7fe7d0010830 con 0x7fe7d4102800 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce61200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 -- 172.21.15.2:0/2267496803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca91490 msgr2=0x55af1ce60cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca91490 0x55af1ce60cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 -- 172.21.15.2:0/2267496803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 msgr2=0x55af1ce61200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce61200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 -- 172.21.15.2:0/2267496803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1cb25930 con 0x55af1caba350 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce61200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005cc0 tx=0x7fe7cc02f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea399b33af15f9c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.800+0000 7fe7bf7fe640 1 -- 172.21.15.2:0/2267496803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc031cf0 con 0x55af1caba350 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.801+0000 7fe7bf7fe640 1 -- 172.21.15.2:0/2267496803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7cc036040 con 0x55af1caba350 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.801+0000 7fe7bf7fe640 1 -- 172.21.15.2:0/2267496803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc004040 con 0x55af1caba350 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.801+0000 7fe7ca7fc640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 0x7fe7c00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.801+0000 7fe7d95e1640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 0x7fe7c00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.801+0000 7fe7ca7fc640 1 -- 172.21.15.2:0/674132815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe7d00e5df0 con 0x7fe7d4102800 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- 172.21.15.2:0/2267496803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 msgr2=0x55af1ce60780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7d95e1640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 0x7fe7c00b7120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000e9c0 tx=0x7fe7d00cf040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005cc0 tx=0x7fe7cc02f420 comp rx=0 tx=0).stop 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- 172.21.15.2:0/2267496803 shutdown_connections 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce61200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca91490 0x55af1ce60cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/2267496803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce60780 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- 172.21.15.2:0/2267496803 >> 172.21.15.2:0/2267496803 conn(0x55af1caae740 msgr2=0x55af1ce5e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- 172.21.15.2:0/2267496803 shutdown_connections 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- 172.21.15.2:0/2267496803 wait complete. 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 -- start start 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.802+0000 7fe7e1dba740 1 Processor -- start 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1ce6bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1ce6c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc28890 con 0x55af1caba350 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55af1cd4c790 con 0x55af1ca91490 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55af1ce6ef00 con 0x55af1ca99670 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7e1dba740 10 client.0 _ll_register_callbacks cb 0x55af1cad1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58914/0 (socket says 172.21.15.2:58914) 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3974926880 learned_addr learned my addr 172.21.15.2:0/3974926880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1ce6bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1ce6c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3974926880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 msgr2=0x55af1ce6c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1ce6c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 msgr2=0x55af1ce6bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1ce6bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3974926880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1cd83f30 con 0x55af1caba350 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009620 tx=0x7fe7cc03e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c6f02746681261 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.803+0000 7fe7bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc058060 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7cc036040 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe7cc031450 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7cc031650 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 10 client.15582 fetch_fsmap learned FSMap version 26 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af1ce7ad60 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7cc036040 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe7cc050070 con 0x55af1caba350 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 10 client.15582 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 20 client.15582 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca78cd0 0x55af1ce7e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 4 client.15582 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.804+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af1cdd8540 con 0x55af1ca78cd0 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.805+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca78cd0 0x55af1ce7e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.805+0000 7fe7bcff9640 10 client.15582 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.805+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca78cd0 0x55af1ce7e0c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee41913c6c73c5e server_cookie=d0b1649819c4427e in_seq=0 out_seq=0 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7bcff9640 1 -- 172.21.15.2:0/3974926880 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af1cdd8540 con 0x55af1ca78cd0 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7bcff9640 10 client.15582 handle_command_reply: tid=0 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 client.15582 shutdown 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 msgr2=0x55af1ce781f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009620 tx=0x7fe7cc03e040 comp rx=0 tx=0).stop 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 shutdown_connections 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca78cd0 0x55af1ce7e0c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1ce781f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1ce6c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3974926880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1ce6bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7bcff9640 0 client.15582 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:37.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 >> 172.21.15.2:0/3974926880 conn(0x55af1caae740 msgr2=0x55af1ce63960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 shutdown_connections 2024-08-31T04:25:37.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3974926880 wait complete. 2024-08-31T04:25:37.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.806+0000 7fe7e1dba740 20 client.15582 trim_cache size 0 max 16384 2024-08-31T04:25:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 Processor -- start 2024-08-31T04:25:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 -- start start 2024-08-31T04:25:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce78160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1caba350 0x55af1ce786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b3760 con 0x55af1ca91490 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b1030 con 0x55af1ca99670 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.824+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41aee80 con 0x55af1caba350 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58926/0 (socket says 172.21.15.2:58926) 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3858672307 learned_addr learned my addr 172.21.15.2:0/3858672307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce78160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3858672307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1caba350 msgr2=0x55af1ce786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1caba350 0x55af1ce786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3858672307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 msgr2=0x55af1ce78160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce78160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 -- 172.21.15.2:0/3858672307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1ce635e0 con 0x55af1ca91490 2024-08-31T04:25:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000f80 tx=0x7fe7cc02f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669e07bc87dd4ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7beffd640 1 -- 172.21.15.2:0/3858672307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc058040 con 0x55af1ca91490 2024-08-31T04:25:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7beffd640 1 -- 172.21.15.2:0/3858672307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7cc036040 con 0x55af1ca91490 2024-08-31T04:25:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.825+0000 7fe7beffd640 1 -- 172.21.15.2:0/3858672307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0305c0 con 0x55af1ca91490 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3858672307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 msgr2=0x55af1ce6db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000f80 tx=0x7fe7cc02f950 comp rx=0 tx=0).stop 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3858672307 shutdown_connections 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1caba350 0x55af1ce786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca99670 0x55af1ce78160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/3858672307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1ca91490 0x55af1ce6db20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3858672307 >> 172.21.15.2:0/3858672307 conn(0x55af1caae740 msgr2=0x55af1ce62170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3858672307 shutdown_connections 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- 172.21.15.2:0/3858672307 wait complete. 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 -- start start 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.827+0000 7fe7e1dba740 1 Processor -- start 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1cedc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1cedcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41af4f0 con 0x55af1caba350 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b0960 con 0x55af1ca91490 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41afbc0 con 0x55af1ca99670 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7e1dba740 10 client.0 _ll_register_callbacks cb 0x7fe7cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58942/0 (socket says 172.21.15.2:58942) 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 -- 172.21.15.2:0/1569691567 learned_addr learned my addr 172.21.15.2:0/1569691567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1cedc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1cedcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 -- 172.21.15.2:0/1569691567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 msgr2=0x55af1cedcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1cedcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 -- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 msgr2=0x55af1cedc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1cedc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 -- 172.21.15.2:0/1569691567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1cee2350 con 0x55af1caba350 2024-08-31T04:25:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1cedcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7d9de2640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc003ae0 tx=0x7fe7cc0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae555aa01231b28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.828+0000 7fe7bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc004c00 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe7cc004da0 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7cc036040 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7cc0305c0 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 10 client.15588 fetch_fsmap learned FSMap version 26 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af1cee2350 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7cc04b040 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe7cc050040 con 0x55af1caba350 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 10 client.15588 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 20 client.15588 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca4e080 0x55af1ceebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 4 client.15588 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.829+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fe7cc036040 con 0x55af1ca4e080 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.830+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca4e080 0x55af1ceebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.830+0000 7fe7bcff9640 10 client.15588 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.830+0000 7fe7d8de0640 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca4e080 0x55af1ceebb70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc6d4dd4e67053a2 server_cookie=ffe347f24587bc36 in_seq=0 out_seq=0 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7bcff9640 1 -- 172.21.15.2:0/1569691567 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fe7cc036040 con 0x55af1ca4e080 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7bcff9640 10 client.15588 handle_command_reply: tid=0 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 client.15588 shutdown 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 msgr2=0x55af1cee1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc003ae0 tx=0x7fe7cc0098a0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 shutdown_connections 2024-08-31T04:25:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55af1ca4e080 0x55af1ceebb70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af1caba350 0x55af1cee1ce0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af1ca99670 0x55af1cedcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 --2- 172.21.15.2:0/1569691567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55af1ca91490 0x55af1cedc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 >> 172.21.15.2:0/1569691567 conn(0x55af1caae740 msgr2=0x55af1ce62170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7bcff9640 0 client.15588 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 shutdown_connections 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 1 -- 172.21.15.2:0/1569691567 wait complete. 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.832+0000 7fe7e1dba740 20 client.15588 trim_cache size 0 max 16384 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:37.838 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:25:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7c71db2e-ff2d-4279-a140-18e89b19cf24", 2024-08-31T04:25:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:25:37.839 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 msgr2=0x7fe7c00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 0x7fe7c00b7120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000e9c0 tx=0x7fe7d00cf040 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 msgr2=0x7fe7d419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000e9f0 tx=0x7fe7d000edf0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 shutdown_connections 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4108a90 0x7fe7d419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4108140 0x7fe7d419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7c00b4c10 0x7fe7c00b7120 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 --2- 172.21.15.2:0/674132815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4102800 0x7fe7d419a1f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 >> 172.21.15.2:0/674132815 conn(0x7fe7d40794d0 msgr2=0x7fe7d4104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 shutdown_connections 2024-08-31T04:25:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.833+0000 7fe7db845640 1 -- 172.21.15.2:0/674132815 wait complete. 2024-08-31T04:25:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.880+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4d340635a0 con 0x7f4d1c0b4c90 2024-08-31T04:25:37.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.944+0000 7f4d317fa640 1 -- 172.21.15.2:0/63672044 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4d340635a0 con 0x7f4d1c0b4c90 2024-08-31T04:25:37.946 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-08-31T04:25:37.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 msgr2=0x7f4d1c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 0x7f4d1c0b71a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d24031440 tx=0x7f4d24009560 comp rx=0 tx=0).stop 2024-08-31T04:25:37.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 msgr2=0x7f4d3419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:37.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00eaa0 tx=0x7f4d2c00ef60 comp rx=0 tx=0).stop 2024-08-31T04:25:37.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 shutdown_connections 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4d1c0b4c90 0x7f4d1c0b71a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d341089f0 0x7f4d3419e910 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d341080a0 0x7f4d34199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 --2- 172.21.15.2:0/63672044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d34102770 0x7f4d341990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 >> 172.21.15.2:0/63672044 conn(0x7f4d340fe150 msgr2=0x7f4d34100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 shutdown_connections 2024-08-31T04:25:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:37.947+0000 7f4d3a62f640 1 -- 172.21.15.2:0/63672044 wait complete. 2024-08-31T04:25:37.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T04:25:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.071+0000 7fd9d4647640 1 -- 172.21.15.2:0/669299155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc101cb0 msgr2=0x7fd9cc1020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.071+0000 7fd9d4647640 1 --2- 172.21.15.2:0/669299155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc1020c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009ca0 tx=0x7fd9bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 -- 172.21.15.2:0/669299155 shutdown_connections 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 --2- 172.21.15.2:0/669299155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc109b30 0x7fd9cc110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 --2- 172.21.15.2:0/669299155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 --2- 172.21.15.2:0/669299155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc1020c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 -- 172.21.15.2:0/669299155 >> 172.21.15.2:0/669299155 conn(0x7fd9cc079aa0 msgr2=0x7fd9cc079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 -- 172.21.15.2:0/669299155 shutdown_connections 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 -- 172.21.15.2:0/669299155 wait complete. 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 Processor -- start 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.072+0000 7fd9d4647640 1 -- start start 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc109b30 0x7fd9cc19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc1137f0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc113670 con 0x7fd9cc101cb0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc113970 con 0x7fd9cc109b30 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58974/0 (socket says 172.21.15.2:58974) 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 -- 172.21.15.2:0/3942284545 learned_addr learned my addr 172.21.15.2:0/3942284545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d23e3640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d2be4640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc109b30 0x7fd9cc19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 -- 172.21.15.2:0/3942284545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc109b30 msgr2=0x7fd9cc19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc109b30 0x7fd9cc19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 -- 172.21.15.2:0/3942284545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 msgr2=0x7fd9cc19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 -- 172.21.15.2:0/3942284545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc1a0260 con 0x7fd9cc1091e0 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d23e3640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d1be2640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c970 tx=0x7fd9c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0004220 con 0x7fd9cc1091e0 2024-08-31T04:25:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c00043c0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9cc1a0550 con 0x7fd9cc1091e0 2024-08-31T04:25:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0004a00 con 0x7fd9cc1091e0 2024-08-31T04:25:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.073+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9cc1a6ce0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.075+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9cc1020c0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.076+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7fd9c00079b0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.077+0000 7fd9cb7fe640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 0x7fd9b40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.077+0000 7fd9d23e3640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 0x7fd9b40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.077+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd9c00e56f0 con 0x7fd9cc1091e0 2024-08-31T04:25:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.077+0000 7fd9d23e3640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 0x7fd9b40b7120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0094e0 tx=0x7fd9bc0093f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.081+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd9c0014030 con 0x7fd9cc1091e0 2024-08-31T04:25:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.293+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd9cc0635a0 con 0x7fd9b40b4c10 2024-08-31T04:25:38.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.300+0000 7fd9cb7fe640 1 -- 172.21.15.2:0/3942284545 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fd9cc0635a0 con 0x7fd9b40b4c10 2024-08-31T04:25:38.302 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T04:25:37", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-31T04:25:38.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 msgr2=0x7fd9b40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 0x7fd9b40b7120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0094e0 tx=0x7fd9bc0093f0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 msgr2=0x7fd9cc19a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c970 tx=0x7fd9c000ce30 comp rx=0 tx=0).stop 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 shutdown_connections 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd9b40b4c10 0x7fd9b40b7120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9cc1091e0 0x7fd9cc19a8d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9cc109b30 0x7fd9cc19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 --2- 172.21.15.2:0/3942284545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9cc101cb0 0x7fd9cc19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 >> 172.21.15.2:0/3942284545 conn(0x7fd9cc079aa0 msgr2=0x7fd9cc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 shutdown_connections 2024-08-31T04:25:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.303+0000 7fd9d4647640 1 -- 172.21.15.2:0/3942284545 wait complete. 2024-08-31T04:25:38.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:37 smithi002 ceph-mon[18656]: pgmap v345: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-08-31T04:25:38.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:37 smithi002 ceph-mon[18656]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:37 smithi002 ceph-mon[18656]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:37 smithi064 ceph-mon[22007]: pgmap v345: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:37 smithi064 ceph-mon[22007]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:37 smithi064 ceph-mon[22007]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:37 smithi132 ceph-mon[22335]: pgmap v345: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:37 smithi132 ceph-mon[22335]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:37 smithi132 ceph-mon[22335]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2249924599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e181089e0 msgr2=0x7f7e1810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2249924599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e181089e0 0x7f7e1810f210 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009ca0 tx=0x7f7e1002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2249924599 shutdown_connections 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2249924599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e181089e0 0x7f7e1810f210 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2249924599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18108090 0x7f7e181084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2249924599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e18102760 0x7f7e18102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2249924599 >> 172.21.15.2:0/2249924599 conn(0x7f7e180fe160 msgr2=0x7f7e181005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2249924599 shutdown_connections 2024-08-31T04:25:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.429+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2249924599 wait complete. 2024-08-31T04:25:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 Processor -- start 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 -- start start 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181089e0 0x7f7e1819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181126b0 con 0x7f7e18108090 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18112530 con 0x7f7e181089e0 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1f04d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18112830 con 0x7f7e18102760 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1cde9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59004/0 (socket says 172.21.15.2:59004) 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1cde9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53250/0 (socket says 172.21.15.2:53250) 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e17fff640 1 -- 172.21.15.2:0/2593829759 learned_addr learned my addr 172.21.15.2:0/2593829759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.430+0000 7f7e1d5ea640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181089e0 0x7f7e1819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 -- 172.21.15.2:0/2593829759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181089e0 msgr2=0x7f7e1819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181089e0 0x7f7e1819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 -- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 msgr2=0x7f7e1819b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 -- 172.21.15.2:0/2593829759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e181a62b0 con 0x7f7e18102760 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e17fff640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1cde9640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005fd0 tx=0x7f7e0c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c009c30 con 0x7f7e18102760 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c009dd0 con 0x7f7e18102760 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e181a65a0 con 0x7f7e18102760 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c003e20 con 0x7f7e18102760 2024-08-31T04:25:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.431+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e181a6b40 con 0x7f7e18102760 2024-08-31T04:25:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.433+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e18102b70 con 0x7f7e18102760 2024-08-31T04:25:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.434+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f7e0c004000 con 0x7f7e18102760 2024-08-31T04:25:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.435+0000 7f7e15ffb640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 0x7f7e080b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.435+0000 7f7e17fff640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 0x7f7e080b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:38.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.435+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f7e0c0e5350 con 0x7f7e18102760 2024-08-31T04:25:38.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.435+0000 7f7e17fff640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 0x7f7e080b71a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7e18101860 tx=0x7f7e0400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:38.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.439+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7e0c017020 con 0x7f7e18102760 2024-08-31T04:25:38.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:25:38.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.670+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7e180635a0 con 0x7f7e080b4c90 2024-08-31T04:25:38.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.678+0000 7f7e15ffb640 1 -- 172.21.15.2:0/2593829759 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7e180635a0 con 0x7f7e080b4c90 2024-08-31T04:25:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-08-31T04:25:38.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 msgr2=0x7f7e080b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 0x7f7e080b71a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7e18101860 tx=0x7f7e0400b390 comp rx=0 tx=0).stop 2024-08-31T04:25:38.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 msgr2=0x7f7e1819b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005fd0 tx=0x7f7e0c00dde0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 shutdown_connections 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e080b4c90 0x7f7e080b71a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e18108090 0x7f7e1819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181089e0 0x7f7e1819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 --2- 172.21.15.2:0/2593829759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e18102760 0x7f7e1819b020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 >> 172.21.15.2:0/2593829759 conn(0x7f7e180fe160 msgr2=0x7f7e18107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 shutdown_connections 2024-08-31T04:25:38.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:38.680+0000 7f7e1f04d640 1 -- 172.21.15.2:0/2593829759 wait complete. 2024-08-31T04:25:38.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-31T04:25:38.723 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-31T04:25:38.733 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T04:25:38.760 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:25:38.760 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T04:25:38.760 INFO:tasks.workunit:timeout=3h 2024-08-31T04:25:38.760 INFO:tasks.workunit:cleanup=True 2024-08-31T04:25:38.761 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:25:38.780 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-31 04:23:49.275847731 +0000 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-31 04:23:49.275847731 +0000 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-31 04:25:27.734981627 +0000 2024-08-31T04:25:38.781 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-31 04:23:49.275847731 +0000 2024-08-31T04:25:38.781 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T04:25:38.781 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T04:25:38.857 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:25:38.913 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:38 smithi002 ceph-mon[18656]: from='client.25213 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 -- 172.21.15.2:0/527008936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 msgr2=0x7f8218102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 --2- 172.21.15.2:0/527008936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f8218102780 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8214009900 tx=0x7f821402a480 comp rx=0 tx=0).stop 2024-08-31T04:25:39.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 -- 172.21.15.2:0/527008936 shutdown_connections 2024-08-31T04:25:39.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 --2- 172.21.15.2:0/527008936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 0x7f8218112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 --2- 172.21.15.2:0/527008936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 --2- 172.21.15.2:0/527008936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f8218102780 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 -- 172.21.15.2:0/527008936 >> 172.21.15.2:0/527008936 conn(0x7f82180794d0 msgr2=0x7f82180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 -- 172.21.15.2:0/527008936 shutdown_connections 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.297+0000 7f821fbbf640 1 -- 172.21.15.2:0/527008936 wait complete. 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 Processor -- start 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 -- start start 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 0x7f82181a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8218115a10 con 0x7f8218102370 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8218115890 con 0x7f821810ff20 2024-08-31T04:25:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821fbbf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8218115b90 con 0x7f8218102cc0 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821d95b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821d95b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59020/0 (socket says 172.21.15.2:59020) 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821d95b640 1 -- 172.21.15.2:0/2379229431 learned_addr learned my addr 172.21.15.2:0/2379229431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821e15c640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 0x7f82181a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.298+0000 7f821d15a640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 -- 172.21.15.2:0/2379229431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 msgr2=0x7f821819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 -- 172.21.15.2:0/2379229431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 msgr2=0x7f82181a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 0x7f82181a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 -- 172.21.15.2:0/2379229431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82181a2370 con 0x7f8218102370 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d15a640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821d95b640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8214005940 tx=0x7f82140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f820affd640 1 -- 172.21.15.2:0/2379229431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821403f030 con 0x7f8218102370 2024-08-31T04:25:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82181a2600 con 0x7f8218102370 2024-08-31T04:25:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f820affd640 1 -- 172.21.15.2:0/2379229431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8214003cb0 con 0x7f8218102370 2024-08-31T04:25:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f820affd640 1 -- 172.21.15.2:0/2379229431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214035070 con 0x7f8218102370 2024-08-31T04:25:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.299+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181a8dc0 con 0x7f8218102370 2024-08-31T04:25:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.302+0000 7f8226134740 1 Processor -- start 2024-08-31T04:25:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.302+0000 7f8226134740 1 -- start start 2024-08-31T04:25:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.302+0000 7f820affd640 1 -- 172.21.15.2:0/2379229431 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f8214042030 con 0x7f8218102370 2024-08-31T04:25:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc702d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc679630 con 0x55e0bc3341b0 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc668bc0 con 0x55e0bc35d070 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f8226134740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc66cb70 con 0x55e0bc33c390 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821e15c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821e15c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:50616/0 (socket says 172.21.15.2:50616) 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59030/0 (socket says 172.21.15.2:59030) 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821e15c640 1 -- 172.21.15.2:0/4160161109 learned_addr learned my addr 172.21.15.2:0/4160161109 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d15a640 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc702d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 -- 172.21.15.2:0/4160161109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 msgr2=0x55e0bc702d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc702d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 -- 172.21.15.2:0/4160161109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 msgr2=0x55e0bc7022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821d95b640 1 -- 172.21.15.2:0/4160161109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bc3c8650 con 0x55e0bc3341b0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.303+0000 7f821e15c640 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f821d95b640 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f82141035c0 tx=0x7f821410e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfda458ba6b19074 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f820affd640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 0x7f82040b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f8203fff640 1 -- 172.21.15.2:0/4160161109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140c8b30 con 0x55e0bc3341b0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f821e15c640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 0x7f82040b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f8203fff640 1 -- 172.21.15.2:0/4160161109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8214113030 con 0x55e0bc3341b0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f8203fff640 1 -- 172.21.15.2:0/4160161109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140cbc50 con 0x55e0bc3341b0 2024-08-31T04:25:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.304+0000 7f820affd640 1 -- 172.21.15.2:0/2379229431 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8214106150 con 0x7f8218102370 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 -- 172.21.15.2:0/4160161109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 msgr2=0x55e0bc702820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f82141035c0 tx=0x7f821410e540 comp rx=0 tx=0).stop 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f821e15c640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 0x7f82040b7120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8210005f40 tx=0x7f8210009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 -- 172.21.15.2:0/4160161109 shutdown_connections 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc3341b0 0x55e0bc702820 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc702d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 --2- 172.21.15.2:0/4160161109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc35d070 0x55e0bc7022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 -- 172.21.15.2:0/4160161109 >> 172.21.15.2:0/4160161109 conn(0x55e0bc351460 msgr2=0x55e0bc7001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 -- 172.21.15.2:0/4160161109 shutdown_connections 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.305+0000 7f8226134740 1 -- 172.21.15.2:0/4160161109 wait complete. 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 -- start start 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 Processor -- start 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc70da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc70df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc4cb700 con 0x55e0bc35d070 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc5ef700 con 0x55e0bc3341b0 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e0bc710880 con 0x55e0bc33c390 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.306+0000 7f8226134740 10 client.0 _ll_register_callbacks cb 0x55e0bc61edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59044/0 (socket says 172.21.15.2:59044) 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 -- 172.21.15.2:0/3946072515 learned_addr learned my addr 172.21.15.2:0/3946072515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821d15a640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc70df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821d95b640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc70da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 -- 172.21.15.2:0/3946072515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 msgr2=0x55e0bc70df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc70df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 -- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 msgr2=0x55e0bc70da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc70da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 -- 172.21.15.2:0/3946072515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bc6288b0 con 0x55e0bc35d070 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f821e15c640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8210011f70 tx=0x7f8210004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654b1722b48e919 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f82017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.307+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821001ed30 con 0x55e0bc35d070 2024-08-31T04:25:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f821002a480 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8214113030 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f821002a680 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 10 client.15612 fetch_fsmap learned FSMap version 26 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e0bc71c5b0 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8214113030 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f821000f040 con 0x55e0bc35d070 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 10 client.15612 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 20 client.15612 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc31b9f0 0x55e0bc71fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 4 client.15612 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.308+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0bc67b580 con 0x55e0bc31b9f0 2024-08-31T04:25:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.309+0000 7f821d95b640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc31b9f0 0x55e0bc71fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.309+0000 7f821d95b640 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc31b9f0 0x55e0bc71fad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd24fdd83a9a4b5a server_cookie=cfa447a9162b9754 in_seq=0 out_seq=0 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.309+0000 7f82017fa640 10 client.15612 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f82017fa640 1 -- 172.21.15.2:0/3946072515 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0bc67b580 con 0x55e0bc31b9f0 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f82017fa640 10 client.15612 handle_command_reply: tid=0 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 client.15612 shutdown 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 msgr2=0x55e0bc719b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8210011f70 tx=0x7f8210004a40 comp rx=0 tx=0).stop 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 shutdown_connections 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc31b9f0 0x55e0bc71fad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc35d070 0x55e0bc719b30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc33c390 0x55e0bc70df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f82017fa640 0 client.15612 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 --2- 172.21.15.2:0/3946072515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc70da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 >> 172.21.15.2:0/3946072515 conn(0x55e0bc351460 msgr2=0x55e0bc705470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 shutdown_connections 2024-08-31T04:25:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 1 -- 172.21.15.2:0/3946072515 wait complete. 2024-08-31T04:25:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.310+0000 7f8226134740 20 client.15612 trim_cache size 0 max 16384 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:38 smithi064 ceph-mon[22007]: from='client.25213 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:25:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:25:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:25:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:38 smithi132 ceph-mon[22335]: from='client.25213 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 Processor -- start 2024-08-31T04:25:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 -- start start 2024-08-31T04:25:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc31b9f0 0x55e0bc705af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc3341b0 0x55e0bc719a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b58b0 con 0x55e0bc33c390 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b3180 con 0x55e0bc31b9f0 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f8226134740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b0fd0 con 0x55e0bc3341b0 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59050/0 (socket says 172.21.15.2:59050) 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f821e15c640 1 -- 172.21.15.2:0/25458287 learned_addr learned my addr 172.21.15.2:0/25458287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.328+0000 7f821d95b640 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc31b9f0 0x55e0bc705af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821d15a640 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc3341b0 0x55e0bc719a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 -- 172.21.15.2:0/25458287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc3341b0 msgr2=0x55e0bc719a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc3341b0 0x55e0bc719a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 -- 172.21.15.2:0/25458287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc31b9f0 msgr2=0x55e0bc705af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc31b9f0 0x55e0bc705af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 -- 172.21.15.2:0/25458287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bc70c960 con 0x55e0bc33c390 2024-08-31T04:25:39.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f821e15c640 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8210000f80 tx=0x7f821001e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8158000b6b77f465 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f82037fe640 1 -- 172.21.15.2:0/25458287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821001fd60 con 0x55e0bc33c390 2024-08-31T04:25:39.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f82037fe640 1 -- 172.21.15.2:0/25458287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821001f410 con 0x55e0bc33c390 2024-08-31T04:25:39.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.329+0000 7f82037fe640 1 -- 172.21.15.2:0/25458287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210003b90 con 0x55e0bc33c390 2024-08-31T04:25:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- 172.21.15.2:0/25458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 msgr2=0x55e0bc6ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8210000f80 tx=0x7f821001e7f0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- 172.21.15.2:0/25458287 shutdown_connections 2024-08-31T04:25:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc6ffaf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc3341b0 0x55e0bc719a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 --2- 172.21.15.2:0/25458287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc31b9f0 0x55e0bc705af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- 172.21.15.2:0/25458287 >> 172.21.15.2:0/25458287 conn(0x55e0bc351460 msgr2=0x55e0bc7053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- 172.21.15.2:0/25458287 shutdown_connections 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- 172.21.15.2:0/25458287 wait complete. 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.330+0000 7f8226134740 1 -- start start 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 Processor -- start 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc31b9f0 0x55e0bc712430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc7129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b1640 con 0x55e0bc33c390 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b2ab0 con 0x55e0bc3341b0 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82181b1d10 con 0x55e0bc31b9f0 2024-08-31T04:25:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f8226134740 10 client.0 _ll_register_callbacks cb 0x7f8210011bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f821e15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59066/0 (socket says 172.21.15.2:59066) 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f821e15c640 1 -- 172.21.15.2:0/3377334909 learned_addr learned my addr 172.21.15.2:0/3377334909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.331+0000 7f821d95b640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc31b9f0 0x55e0bc712430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821d15a640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc7129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 -- 172.21.15.2:0/3377334909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc31b9f0 msgr2=0x55e0bc712430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc31b9f0 0x55e0bc712430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 -- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 msgr2=0x55e0bc7129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc7129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 -- 172.21.15.2:0/3377334909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bc783b80 con 0x55e0bc33c390 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f821e15c640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8210005f10 tx=0x7f821001f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7117a272c8f78a7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f82017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:25:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210046060 con 0x55e0bc33c390 2024-08-31T04:25:39.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821001f410 con 0x55e0bc33c390 2024-08-31T04:25:39.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8210003b70 con 0x55e0bc33c390 2024-08-31T04:25:39.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8210003d70 con 0x55e0bc33c390 2024-08-31T04:25:39.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f8226134740 10 client.15618 fetch_fsmap learned FSMap version 26 2024-08-31T04:25:39.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.332+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e0bc78aed0 con 0x55e0bc33c390 2024-08-31T04:25:39.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.333+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821001f410 con 0x55e0bc33c390 2024-08-31T04:25:39.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.333+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f821000f040 con 0x55e0bc33c390 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 10 client.15618 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 20 client.15618 populate_metadata read hostname 'smithi002' 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc35d070 0x55e0bc78d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 4 client.15618 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0bc677020 con 0x55e0bc35d070 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.334+0000 7f821d95b640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc35d070 0x55e0bc78d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f82017fa640 10 client.15618 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f821d95b640 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc35d070 0x55e0bc78d5a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15c534d03533e60 server_cookie=7cb0d5818860c414 in_seq=0 out_seq=0 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f82017fa640 1 -- 172.21.15.2:0/3377334909 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e0bc677020 con 0x55e0bc35d070 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f82017fa640 10 client.15618 handle_command_reply: tid=0 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 client.15618 shutdown 2024-08-31T04:25:39.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 msgr2=0x55e0bc783510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8210005f10 tx=0x7f821001f7f0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 shutdown_connections 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e0bc35d070 0x55e0bc78d5a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bc33c390 0x55e0bc783510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e0bc3341b0 0x55e0bc7129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 --2- 172.21.15.2:0/3377334909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e0bc31b9f0 0x55e0bc712430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f82017fa640 0 client.15618 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 >> 172.21.15.2:0/3377334909 conn(0x55e0bc351460 msgr2=0x55e0bc6ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 shutdown_connections 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 1 -- 172.21.15.2:0/3377334909 wait complete. 2024-08-31T04:25:39.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.335+0000 7f8226134740 20 client.15618 trim_cache size 0 max 16384 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7c71db2e-ff2d-4279-a140-18e89b19cf24", 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:25:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:25:39.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 msgr2=0x7f82040b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 0x7f82040b7120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8210005f40 tx=0x7f8210009600 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 msgr2=0x7f821819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8214005940 tx=0x7f82140042f0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 shutdown_connections 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f821810ff20 0x7f82181a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8218102cc0 0x7f821819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82040b4c10 0x7f82040b7120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 --2- 172.21.15.2:0/2379229431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8218102370 0x7f821819c400 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 >> 172.21.15.2:0/2379229431 conn(0x7f82180794d0 msgr2=0x7f82181113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 shutdown_connections 2024-08-31T04:25:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:25:39.336+0000 7f821fbbf640 1 -- 172.21.15.2:0/2379229431 wait complete. 2024-08-31T04:25:40.026 INFO:tasks.cephfs.filesystem:scrub status for tag:7c71db2e-ff2d-4279-a140-18e89b19cf24 - {'path': '/', 'tag': '7c71db2e-ff2d-4279-a140-18e89b19cf24', 'options': 'recursive,force'} 2024-08-31T04:25:40.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:39 smithi064 ceph-mon[22007]: pgmap v346: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-31T04:25:40.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:39 smithi132 ceph-mon[22335]: pgmap v346: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-31T04:25:40.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:39 smithi002 ceph-mon[18656]: pgmap v346: 129 pgs: 129 active+clean; 653 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-31T04:25:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:40 smithi064 ceph-mon[22007]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T04:25:41.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:40 smithi132 ceph-mon[22335]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T04:25:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:40 smithi002 ceph-mon[18656]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T04:25:42.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:42 smithi064 ceph-mon[22007]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 103 KiB/s wr, 46 op/s 2024-08-31T04:25:42.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:42 smithi132 ceph-mon[22335]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 103 KiB/s wr, 46 op/s 2024-08-31T04:25:42.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:42 smithi002 ceph-mon[18656]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 103 KiB/s wr, 46 op/s 2024-08-31T04:25:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:44 smithi064 ceph-mon[22007]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T04:25:44.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:44 smithi132 ceph-mon[22335]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T04:25:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:44 smithi002 ceph-mon[18656]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T04:25:46.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:46 smithi064 ceph-mon[22007]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:46 smithi132 ceph-mon[22335]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:46 smithi002 ceph-mon[18656]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:48 smithi064 ceph-mon[22007]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T04:25:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:48 smithi132 ceph-mon[22335]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T04:25:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:48 smithi002 ceph-mon[18656]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T04:25:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:50 smithi064 ceph-mon[22007]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:50 smithi132 ceph-mon[22335]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:50 smithi002 ceph-mon[18656]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-08-31T04:25:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:52 smithi064 ceph-mon[22007]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-08-31T04:25:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:52 smithi132 ceph-mon[22335]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-08-31T04:25:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:52 smithi002 ceph-mon[18656]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-08-31T04:25:53.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:53 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:25:53.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:53 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:25:53.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:53 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:25:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:54 smithi064 ceph-mon[22007]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 73 KiB/s wr, 15 op/s 2024-08-31T04:25:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:54 smithi132 ceph-mon[22335]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 73 KiB/s wr, 15 op/s 2024-08-31T04:25:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:54 smithi002 ceph-mon[18656]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 73 KiB/s wr, 15 op/s 2024-08-31T04:25:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:56 smithi064 ceph-mon[22007]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:56 smithi132 ceph-mon[22335]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:56 smithi002 ceph-mon[18656]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T04:25:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:25:58 smithi064 ceph-mon[22007]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:25:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:25:58 smithi132 ceph-mon[22335]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:25:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:25:58 smithi002 ceph-mon[18656]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T04:26:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:26:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:00.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:00.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T04:26:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:00.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:26:01.397 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:26:00.954+0000 7f2845bf1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:26:01.397 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:26:00.954+0000 7f2845bf1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:26:01.397 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:26:00.954+0000 7f2845bf1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:26:01.397 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:26:00.954+0000 7f2845bf1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:26:01.398 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:26:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:26:00.954+0000 7f2845bf1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:26:02.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:02 smithi132 ceph-mon[22335]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:26:02.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:02 smithi132 ceph-mon[22335]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-08-31T04:26:02.570 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:02 smithi064 ceph-mon[22007]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:26:02.570 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:02 smithi064 ceph-mon[22007]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-08-31T04:26:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:02 smithi002 ceph-mon[18656]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T04:26:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:02 smithi002 ceph-mon[18656]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-08-31T04:26:04.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:04 smithi064 ceph-mon[22007]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-31T04:26:04.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:04 smithi132 ceph-mon[22335]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-31T04:26:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:04 smithi002 ceph-mon[18656]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-31T04:26:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:06 smithi064 ceph-mon[22007]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-08-31T04:26:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:06 smithi132 ceph-mon[22335]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-08-31T04:26:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:06 smithi002 ceph-mon[18656]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-08-31T04:26:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:08 smithi064 ceph-mon[22007]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T04:26:08.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:08 smithi132 ceph-mon[22335]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T04:26:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:08 smithi002 ceph-mon[18656]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T04:26:10.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:26:10.349 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:10.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:10 smithi002 ceph-mon[18656]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T04:26:10.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:10 smithi064 ceph-mon[22007]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T04:26:10.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:10 smithi132 ceph-mon[22335]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 -- 172.21.15.2:0/330859642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 msgr2=0x7f7044108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 --2- 172.21.15.2:0/330859642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f7044108590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f703400d910 tx=0x7f703402a170 comp rx=0 tx=0).stop 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 -- 172.21.15.2:0/330859642 shutdown_connections 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 --2- 172.21.15.2:0/330859642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 0x7f704410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 --2- 172.21.15.2:0/330859642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f7044108590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 --2- 172.21.15.2:0/330859642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f7044102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 -- 172.21.15.2:0/330859642 >> 172.21.15.2:0/330859642 conn(0x7f70440794f0 msgr2=0x7f7044079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 -- 172.21.15.2:0/330859642 shutdown_connections 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.913+0000 7f704c1d5640 1 -- 172.21.15.2:0/330859642 wait complete. 2024-08-31T04:26:10.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.914+0000 7f704c1d5640 1 Processor -- start 2024-08-31T04:26:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.914+0000 7f704c1d5640 1 -- start start 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f70441a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 0x7f70441a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70441116d0 con 0x7f7044102840 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7044111550 con 0x7f7044108ad0 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704c1d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7044111850 con 0x7f7044108180 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50580/0 (socket says 172.21.15.2:50580) 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 -- 172.21.15.2:0/1897372042 learned_addr learned my addr 172.21.15.2:0/1897372042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049770640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f70441a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f704a772640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 0x7f70441a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 -- 172.21.15.2:0/1897372042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 msgr2=0x7f70441a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f70441a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 -- 172.21.15.2:0/1897372042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 msgr2=0x7f70441a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 0x7f70441a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.915+0000 7f7049f71640 1 -- 172.21.15.2:0/1897372042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70441a6770 con 0x7f7044102840 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f7049f71640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f704000ea60 tx=0x7f704000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f703affd640 1 -- 172.21.15.2:0/1897372042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704000cde0 con 0x7f7044102840 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70441a6a60 con 0x7f7044102840 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7044197d30 con 0x7f7044102840 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f703affd640 1 -- 172.21.15.2:0/1897372042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70400188e0 con 0x7f7044102840 2024-08-31T04:26:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.916+0000 7f703affd640 1 -- 172.21.15.2:0/1897372042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70400217b0 con 0x7f7044102840 2024-08-31T04:26:10.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 Processor -- start 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 -- start start 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac342052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34205800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac3417c630 con 0x55ac33e371b0 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ac3416bbc0 con 0x55ac33e60070 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.920+0000 7f705274a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ac3416fb70 con 0x55ac33e3f390 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f703affd640 1 -- 172.21.15.2:0/1897372042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f7040021950 con 0x7f7044102840 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f7049770640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f7049770640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53970/0 (socket says 172.21.15.2:53970) 2024-08-31T04:26:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f7049770640 1 -- 172.21.15.2:0/3333695684 learned_addr learned my addr 172.21.15.2:0/3333695684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f704a772640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac342052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.921+0000 7f7049f71640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34205800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 -- 172.21.15.2:0/3333695684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 msgr2=0x55ac34205d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 -- 172.21.15.2:0/3333695684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 msgr2=0x55ac34205800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34205800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 -- 172.21.15.2:0/3333695684 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac33ecb650 con 0x55ac33e60070 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f703affd640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 0x7f70300b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f7049770640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:10.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f704a772640 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac342052c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f703c00c3d0 tx=0x7f703c00d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b601bc79fff5b126 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f703affd640 1 -- 172.21.15.2:0/1897372042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f70400e5bc0 con 0x7f7044102840 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f702ffff640 1 -- 172.21.15.2:0/3333695684 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c01c070 con 0x55ac33e60070 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f702ffff640 1 -- 172.21.15.2:0/3333695684 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c004050 con 0x55ac33e60070 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.922+0000 7f702ffff640 1 -- 172.21.15.2:0/3333695684 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c017630 con 0x55ac33e60070 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.923+0000 7f7049f71640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 0x7f70300b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 -- 172.21.15.2:0/3333695684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 msgr2=0x55ac342052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f7049f71640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 0x7f70300b72c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70400e2e90 tx=0x7f70400e9640 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac342052c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f703c00c3d0 tx=0x7f703c00d910 comp rx=0 tx=0).stop 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 -- 172.21.15.2:0/3333695684 shutdown_connections 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34205800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34205d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 --2- 172.21.15.2:0/3333695684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac342052c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 -- 172.21.15.2:0/3333695684 >> 172.21.15.2:0/3333695684 conn(0x55ac33e54460 msgr2=0x55ac342031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 -- 172.21.15.2:0/3333695684 shutdown_connections 2024-08-31T04:26:10.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.924+0000 7f705274a740 1 -- 172.21.15.2:0/3333695684 wait complete. 2024-08-31T04:26:10.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 -- start start 2024-08-31T04:26:10.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 Processor -- start 2024-08-31T04:26:10.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34210f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3422de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac33fce700 con 0x55ac33e371b0 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ac340f2700 con 0x55ac33e60070 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.925+0000 7f705274a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ac34224ab0 con 0x55ac33e3f390 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f705274a740 10 client.0 _ll_register_callbacks cb 0x55ac34121dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50598/0 (socket says 172.21.15.2:50598) 2024-08-31T04:26:10.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 -- 172.21.15.2:0/2833232142 learned_addr learned my addr 172.21.15.2:0/2833232142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f7049770640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34210f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 -- 172.21.15.2:0/2833232142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 msgr2=0x55ac34210f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34210f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 -- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 msgr2=0x55ac3422de00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3422de00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.926+0000 7f704a772640 1 -- 172.21.15.2:0/2833232142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3412b8b0 con 0x55ac33e371b0 2024-08-31T04:26:10.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f704a772640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f703c004950 tx=0x7f703c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46acaed5cb63194e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f702d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c026020 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f703c022620 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f703c004050 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f703c031050 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f705274a740 10 client.15636 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.927+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ac34230880 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c004050 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f703c016030 con 0x55ac33e371b0 2024-08-31T04:26:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 10 client.15636 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 20 client.15636 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33e1e9f0 0x55ac34233cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 4 client.15636 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac3417e580 con 0x55ac33e1e9f0 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.928+0000 7f7049770640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33e1e9f0 0x55ac34233cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.929+0000 7f702d7fa640 10 client.15636 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.929+0000 7f7049770640 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33e1e9f0 0x55ac34233cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b724a1852f40ca24 server_cookie=9c89cff44542a64a in_seq=0 out_seq=0 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f702d7fa640 1 -- 172.21.15.2:0/2833232142 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac3417e580 con 0x55ac33e1e9f0 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f702d7fa640 10 client.15636 handle_command_reply: tid=0 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 client.15636 shutdown 2024-08-31T04:26:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 msgr2=0x55ac34210a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f703c004950 tx=0x7f703c003f20 comp rx=0 tx=0).stop 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 shutdown_connections 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33e1e9f0 0x55ac34233cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3422de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e3f390 0x55ac34210f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f702d7fa640 0 client.15636 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 --2- 172.21.15.2:0/2833232142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34210a30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.930+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 >> 172.21.15.2:0/2833232142 conn(0x55ac33e54460 msgr2=0x55ac34208450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.931+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 shutdown_connections 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.931+0000 7f705274a740 1 -- 172.21.15.2:0/2833232142 wait complete. 2024-08-31T04:26:10.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.931+0000 7f705274a740 20 client.15636 trim_cache size 0 max 16384 2024-08-31T04:26:10.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.948+0000 7f705274a740 1 Processor -- start 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.948+0000 7f705274a740 1 -- start start 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e371b0 0x55ac34208ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3420e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7028012a30 con 0x55ac33e3f390 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7028010300 con 0x55ac33e60070 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f705274a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f702800e150 con 0x55ac33e371b0 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f704a772640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e371b0 0x55ac34208ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50612/0 (socket says 172.21.15.2:50612) 2024-08-31T04:26:10.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 -- 172.21.15.2:0/1679249356 learned_addr learned my addr 172.21.15.2:0/1679249356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f704a772640 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3420e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 -- 172.21.15.2:0/1679249356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e371b0 msgr2=0x55ac34208ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e371b0 0x55ac34208ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 -- 172.21.15.2:0/1679249356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 msgr2=0x55ac3420e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3420e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.949+0000 7f7049770640 1 -- 172.21.15.2:0/1679249356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac342077e0 con 0x55ac33e3f390 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.950+0000 7f7049770640 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f703402a730 tx=0x7f7034005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1801c81fd9f06c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.950+0000 7f702f7fe640 1 -- 172.21.15.2:0/1679249356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034047070 con 0x55ac33e3f390 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.950+0000 7f702f7fe640 1 -- 172.21.15.2:0/1679249356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703402e050 con 0x55ac33e3f390 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.950+0000 7f702f7fe640 1 -- 172.21.15.2:0/1679249356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034004920 con 0x55ac33e3f390 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- 172.21.15.2:0/1679249356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 msgr2=0x55ac3420dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f703402a730 tx=0x7f7034005a20 comp rx=0 tx=0).stop 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- 172.21.15.2:0/1679249356 shutdown_connections 2024-08-31T04:26:10.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e3f390 0x55ac3420dc20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e60070 0x55ac3420e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 --2- 172.21.15.2:0/1679249356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e371b0 0x55ac34208ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- 172.21.15.2:0/1679249356 >> 172.21.15.2:0/1679249356 conn(0x55ac33e54460 msgr2=0x55ac342083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- 172.21.15.2:0/1679249356 shutdown_connections 2024-08-31T04:26:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- 172.21.15.2:0/1679249356 wait complete. 2024-08-31T04:26:10.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.951+0000 7f705274a740 1 -- start start 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 Processor -- start 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 0x55ac34235360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e60070 0x55ac342358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f702800e7c0 con 0x55ac33e371b0 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f702800fc30 con 0x55ac33e3f390 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f702800ee90 con 0x55ac33e60070 2024-08-31T04:26:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f705274a740 10 client.0 _ll_register_callbacks cb 0x7f703c01a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f704a772640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f704a772640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50624/0 (socket says 172.21.15.2:50624) 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f7049770640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 0x55ac34235360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.952+0000 7f704a772640 1 -- 172.21.15.2:0/852432468 learned_addr learned my addr 172.21.15.2:0/852432468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e60070 0x55ac342358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 -- 172.21.15.2:0/852432468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e60070 msgr2=0x55ac342358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e60070 0x55ac342358a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 -- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 msgr2=0x55ac34235360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 0x55ac34235360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 -- 172.21.15.2:0/852432468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3429d520 con 0x55ac33e371b0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f7049770640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 0x55ac34235360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f704a772640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d550 tx=0x7f703c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9468324937dc8985 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f702d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c026030 con 0x55ac33e371b0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.953+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f703c017a30 con 0x55ac33e371b0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f703402e050 con 0x55ac33e371b0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f703c047050 con 0x55ac33e371b0 2024-08-31T04:26:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f705274a740 10 client.15642 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ac3429e7b0 con 0x55ac33e371b0 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c01d040 con 0x55ac33e371b0 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f703c016070 con 0x55ac33e371b0 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f705274a740 10 client.15642 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.954+0000 7f705274a740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.955+0000 7f705274a740 20 client.15642 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.955+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33df3da0 0x55ac342a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.955+0000 7f705274a740 4 client.15642 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.955+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f703402e050 con 0x55ac33df3da0 2024-08-31T04:26:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.955+0000 7f7049770640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33df3da0 0x55ac342a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:10.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f7049770640 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33df3da0 0x55ac342a0eb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6de226cc7d72766 server_cookie=291be59ba88f9eea in_seq=0 out_seq=0 2024-08-31T04:26:10.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f702d7fa640 10 client.15642 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:10.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f702d7fa640 1 -- 172.21.15.2:0/852432468 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f703402e050 con 0x55ac33df3da0 2024-08-31T04:26:10.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f702d7fa640 10 client.15642 handle_command_reply: tid=0 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f705274a740 1 client.15642 shutdown 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 msgr2=0x55ac34234e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.956+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d550 tx=0x7f703c005fd0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 shutdown_connections 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ac33df3da0 0x55ac342a0eb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ac33e60070 0x55ac342358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f702d7fa640 0 client.15642 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ac33e3f390 0x55ac34235360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 --2- 172.21.15.2:0/852432468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac33e371b0 0x55ac34234e20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 >> 172.21.15.2:0/852432468 conn(0x55ac33e54460 msgr2=0x55ac342062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 shutdown_connections 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 1 -- 172.21.15.2:0/852432468 wait complete. 2024-08-31T04:26:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.957+0000 7f705274a740 20 client.15642 trim_cache size 0 max 16384 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:26:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.958+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 msgr2=0x7f70300b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 0x7f70300b72c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70400e2e90 tx=0x7f70400e9640 comp rx=0 tx=0).stop 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 msgr2=0x7f70441a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f704000ea60 tx=0x7f704000ef20 comp rx=0 tx=0).stop 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 shutdown_connections 2024-08-31T04:26:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7044108ad0 0x7f70441a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7044108180 0x7f70441a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f70300b4db0 0x7f70300b72c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 --2- 172.21.15.2:0/1897372042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7044102840 0x7f70441a0830 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 >> 172.21.15.2:0/1897372042 conn(0x7f70440794f0 msgr2=0x7f70441041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 shutdown_connections 2024-08-31T04:26:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:10.959+0000 7f704c1d5640 1 -- 172.21.15.2:0/1897372042 wait complete. 2024-08-31T04:26:11.753 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:26:11.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:26:12.029 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:12.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:12 smithi002 ceph-mon[18656]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:12 smithi064 ceph-mon[22007]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:12 smithi132 ceph-mon[22335]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 -- 172.21.15.2:0/1139765324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47381050a0 msgr2=0x7f473810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 --2- 172.21.15.2:0/1139765324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47381050a0 0x7f473810d5f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f472c009900 tx=0x7f472c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 -- 172.21.15.2:0/1139765324 shutdown_connections 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 --2- 172.21.15.2:0/1139765324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47381050a0 0x7f473810d5f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 --2- 172.21.15.2:0/1139765324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 0x7f47381100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 --2- 172.21.15.2:0/1139765324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4738104750 0x7f4738104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 -- 172.21.15.2:0/1139765324 >> 172.21.15.2:0/1139765324 conn(0x7f47380794d0 msgr2=0x7f47380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 -- 172.21.15.2:0/1139765324 shutdown_connections 2024-08-31T04:26:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.580+0000 7f473d726640 1 -- 172.21.15.2:0/1139765324 wait complete. 2024-08-31T04:26:12.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.581+0000 7f473d726640 1 Processor -- start 2024-08-31T04:26:12.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.581+0000 7f473d726640 1 -- start start 2024-08-31T04:26:12.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47381050a0 0x7f473819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 0x7f473819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47381137d0 con 0x7f4738104750 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4738113650 con 0x7f473810dbb0 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f473d726640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4738113950 con 0x7f47381050a0 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50636/0 (socket says 172.21.15.2:50636) 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 -- 172.21.15.2:0/1242339011 learned_addr learned my addr 172.21.15.2:0/1242339011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f47377fe640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 0x7f473819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f47367fc640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47381050a0 0x7f473819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 -- 172.21.15.2:0/1242339011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47381050a0 msgr2=0x7f473819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47381050a0 0x7f473819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 -- 172.21.15.2:0/1242339011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 msgr2=0x7f473819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 0x7f473819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.582+0000 7f4736ffd640 1 -- 172.21.15.2:0/1242339011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47381a0190 con 0x7f4738104750 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f4736ffd640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f472800d770 tx=0x7f472800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728017070 con 0x7f4738104750 2024-08-31T04:26:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4728009c30 con 0x7f4738104750 2024-08-31T04:26:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728003cc0 con 0x7f4738104750 2024-08-31T04:26:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47381a0480 con 0x7f4738104750 2024-08-31T04:26:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.583+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381a6be0 con 0x7f4738104750 2024-08-31T04:26:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.585+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473806b300 con 0x7f4738104750 2024-08-31T04:26:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.587+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f4728003e60 con 0x7f4738104750 2024-08-31T04:26:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.588+0000 7f471ffff640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 0x7f47200b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.588+0000 7f47367fc640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 0x7f47200b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.588+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f47280e56d0 con 0x7f4738104750 2024-08-31T04:26:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.589+0000 7f47367fc640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 0x7f47200b72c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f472c009230 tx=0x7f472c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.594+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4728009de0 con 0x7f4738104750 2024-08-31T04:26:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.838+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4738104b60 con 0x7f4738104750 2024-08-31T04:26:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.839+0000 7f471ffff640 1 -- 172.21.15.2:0/1242339011 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11897 (secure 0 0 0) 0x7f47280ab960 con 0x7f4738104750 2024-08-31T04:26:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:26:12.966 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-08-31T04:25:28:900170+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:25:28.432300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:26:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-08-31T04:26:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 msgr2=0x7f47200b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 0x7f47200b72c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f472c009230 tx=0x7f472c031400 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 msgr2=0x7f473819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f472800d770 tx=0x7f472800dc30 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 shutdown_connections 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473810dbb0 0x7f473819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47381050a0 0x7f473819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f47200b4db0 0x7f47200b72c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 --2- 172.21.15.2:0/1242339011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738104750 0x7f473819a220 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 >> 172.21.15.2:0/1242339011 conn(0x7f47380794d0 msgr2=0x7f47380ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 shutdown_connections 2024-08-31T04:26:12.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:12.842+0000 7f473d726640 1 -- 172.21.15.2:0/1242339011 wait complete. 2024-08-31T04:26:13.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:13 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1242339011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:13 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1242339011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:13.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:13 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1242339011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:13.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:26:13.907 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:14.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:14 smithi002 ceph-mon[18656]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.501+0000 7f465bfff640 1 -- 172.21.15.2:0/628993152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c02f310 con 0x7f4664108ab0 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.502+0000 7f466b966640 1 -- 172.21.15.2:0/628993152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664108ab0 msgr2=0x7f466410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.502+0000 7f466b966640 1 --2- 172.21.15.2:0/628993152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664108ab0 0x7f466410f2e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ca0 tx=0x7f465c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 -- 172.21.15.2:0/628993152 shutdown_connections 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 --2- 172.21.15.2:0/628993152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664108ab0 0x7f466410f2e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 --2- 172.21.15.2:0/628993152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f4664108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 --2- 172.21.15.2:0/628993152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664102820 0x7f4664102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 -- 172.21.15.2:0/628993152 >> 172.21.15.2:0/628993152 conn(0x7f46640794e0 msgr2=0x7f46640798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 -- 172.21.15.2:0/628993152 shutdown_connections 2024-08-31T04:26:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.503+0000 7f466b966640 1 -- 172.21.15.2:0/628993152 wait complete. 2024-08-31T04:26:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 Processor -- start 2024-08-31T04:26:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 -- start start 2024-08-31T04:26:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664102820 0x7f466410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664108ab0 0x7f466419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4664110cb0 con 0x7f4664102820 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4664110b30 con 0x7f4664108ab0 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.504+0000 7f466b966640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4664110e30 con 0x7f4664108160 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4669702640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664102820 0x7f466410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4669f03640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664108ab0 0x7f466419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:54030/0 (socket says 172.21.15.2:54030) 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 -- 172.21.15.2:0/1116313940 learned_addr learned my addr 172.21.15.2:0/1116313940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 -- 172.21.15.2:0/1116313940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664108ab0 msgr2=0x7f466419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664108ab0 0x7f466419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 -- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664102820 msgr2=0x7f466410d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664102820 0x7f466410d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 -- 172.21.15.2:0/1116313940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466419ddf0 con 0x7f4664108160 2024-08-31T04:26:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.505+0000 7f4668f01640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46540097d0 tx=0x7f4654009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.506+0000 7f465a7fc640 1 -- 172.21.15.2:0/1116313940 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465400e8b0 con 0x7f4664108160 2024-08-31T04:26:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.506+0000 7f465a7fc640 1 -- 172.21.15.2:0/1116313940 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4654005020 con 0x7f4664108160 2024-08-31T04:26:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.506+0000 7f465a7fc640 1 -- 172.21.15.2:0/1116313940 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654004a00 con 0x7f4664108160 2024-08-31T04:26:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.507+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466419e0e0 con 0x7f4664108160 2024-08-31T04:26:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.507+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466419e4e0 con 0x7f4664108160 2024-08-31T04:26:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 Processor -- start 2024-08-31T04:26:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 -- start start 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad0e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 0x560c3ad0ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c3ac85680 con 0x560c3a948390 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c3ac74c10 con 0x560c3a969070 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f4671edb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560c3ac78bc0 con 0x560c3a9401b0 2024-08-31T04:26:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.511+0000 7f465a7fc640 1 -- 172.21.15.2:0/1116313940 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f465401b030 con 0x7f4664108160 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.512+0000 7f4669f03640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad0e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.512+0000 7f4669702640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.512+0000 7f4669702640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:54044/0 (socket says 172.21.15.2:54044) 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.512+0000 7f4669702640 1 -- 172.21.15.2:0/1844129517 learned_addr learned my addr 172.21.15.2:0/1844129517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.513+0000 7f4668f01640 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 0x560c3ad0ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.513+0000 7f465a7fc640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 0x7f46500bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.513+0000 7f465a7fc640 1 -- 172.21.15.2:0/1116313940 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f46540e4bd0 con 0x7f4664108160 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669f03640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 0x7f46500bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 -- 172.21.15.2:0/1844129517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 msgr2=0x560c3ad0e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad0e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 -- 172.21.15.2:0/1844129517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 msgr2=0x560c3ad0ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 0x560c3ad0ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 -- 172.21.15.2:0/1844129517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3a9d4650 con 0x560c3a9401b0 2024-08-31T04:26:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4668f01640 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 0x560c3ad0ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669f03640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 0x7f46500bfa50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f465c004af0 tx=0x7f465c02a8c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f4669702640 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4660009cf0 tx=0x7f4660011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6abd1a259f0c752 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f464f7fe640 1 -- 172.21.15.2:0/1844129517 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660004230 con 0x560c3a9401b0 2024-08-31T04:26:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f464f7fe640 1 -- 172.21.15.2:0/1844129517 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46600043d0 con 0x560c3a9401b0 2024-08-31T04:26:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.514+0000 7f464f7fe640 1 -- 172.21.15.2:0/1844129517 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660019880 con 0x560c3a9401b0 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- 172.21.15.2:0/1844129517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 msgr2=0x560c3ad0e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4660009cf0 tx=0x7f4660011810 comp rx=0 tx=0).stop 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- 172.21.15.2:0/1844129517 shutdown_connections 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a948390 0x560c3ad0ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad0e850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 --2- 172.21.15.2:0/1844129517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad0e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- 172.21.15.2:0/1844129517 >> 172.21.15.2:0/1844129517 conn(0x560c3a95d460 msgr2=0x560c3ad0c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- 172.21.15.2:0/1844129517 shutdown_connections 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- 172.21.15.2:0/1844129517 wait complete. 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.516+0000 7f4671edb740 1 -- start start 2024-08-31T04:26:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 Processor -- start 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 0x560c3ad19a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a948390 0x560c3ad19fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c3aad7700 con 0x560c3a9401b0 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c3abfb750 con 0x560c3a969070 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560c3ad1caf0 con 0x560c3a948390 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4671edb740 10 client.0 _ll_register_callbacks cb 0x560c3ac2ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4669f03640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4669702640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 0x560c3ad19a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4669f03640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57290/0 (socket says 172.21.15.2:57290) 2024-08-31T04:26:14.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4669f03640 1 -- 172.21.15.2:0/3281518607 learned_addr learned my addr 172.21.15.2:0/3281518607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:14.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.517+0000 7f4668f01640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a948390 0x560c3ad19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 -- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a948390 msgr2=0x560c3ad19fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a948390 0x560c3ad19fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 -- 172.21.15.2:0/3281518607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 msgr2=0x560c3ad19a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 0x560c3ad19a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 -- 172.21.15.2:0/3281518607 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3ac34900 con 0x560c3a969070 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669702640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 0x560c3ad19a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f4669f03640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c035000 tx=0x7f465c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff2bd643317fea2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.518+0000 7f464cff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c045070 con 0x560c3a969070 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46600043d0 con 0x560c3a969070 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f465c004040 con 0x560c3a969070 2024-08-31T04:26:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f465c05c050 con 0x560c3a969070 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f4671edb740 10 client.25382 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560c3ad28910 con 0x560c3a969070 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.519+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46600043d0 con 0x560c3a969070 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f465c049070 con 0x560c3a969070 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 10 client.25382 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 10 client.25382 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 20 client.25382 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a9279f0 0x560c3ad2c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 4 client.25382 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c3ac875d0 con 0x560c3a9279f0 2024-08-31T04:26:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.520+0000 7f4669702640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a9279f0 0x560c3ad2c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.521+0000 7f464cff9640 10 client.25382 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.521+0000 7f4669702640 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a9279f0 0x560c3ad2c290 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38051942cd675321 server_cookie=53e0a98ab5b47fd1 in_seq=0 out_seq=0 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.522+0000 7f464cff9640 1 -- 172.21.15.2:0/3281518607 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c3ac875d0 con 0x560c3a9279f0 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.522+0000 7f464cff9640 10 client.25382 handle_command_reply: tid=0 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.522+0000 7f4671edb740 1 client.25382 shutdown 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 msgr2=0x560c3ad25de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c035000 tx=0x7f465c005fd0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 shutdown_connections 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a9279f0 0x560c3ad2c290 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a969070 0x560c3ad25de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a948390 0x560c3ad19fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 --2- 172.21.15.2:0/3281518607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a9401b0 0x560c3ad19a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 >> 172.21.15.2:0/3281518607 conn(0x560c3a95d460 msgr2=0x560c3ad114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.523+0000 7f464cff9640 0 client.25382 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.526+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 shutdown_connections 2024-08-31T04:26:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.526+0000 7f4671edb740 1 -- 172.21.15.2:0/3281518607 wait complete. 2024-08-31T04:26:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.526+0000 7f4671edb740 20 client.25382 trim_cache size 0 max 16384 2024-08-31T04:26:14.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.552+0000 7f4671edb740 1 Processor -- start 2024-08-31T04:26:14.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.552+0000 7f4671edb740 1 -- start start 2024-08-31T04:26:14.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.552+0000 7f4671edb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.552+0000 7f4671edb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad11410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4671edb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4671edb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46641b1540 con 0x560c3a969070 2024-08-31T04:26:14.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4671edb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46641aee10 con 0x560c3a948390 2024-08-31T04:26:14.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4671edb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f46641acc60 con 0x560c3a9401b0 2024-08-31T04:26:14.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4669f03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad11410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4669f03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50672/0 (socket says 172.21.15.2:50672) 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4669f03640 1 -- 172.21.15.2:0/2666200734 learned_addr learned my addr 172.21.15.2:0/2666200734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4669702640 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 -- 172.21.15.2:0/2666200734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 msgr2=0x560c3ad07230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad07230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 -- 172.21.15.2:0/2666200734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 msgr2=0x560c3ad11950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.553+0000 7f4668f01640 1 -- 172.21.15.2:0/2666200734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3ad2c860 con 0x560c3a948390 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.554+0000 7f4669f03640 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.554+0000 7f4668f01640 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad11410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46540e1e40 tx=0x7f46540e4ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f5c05d82797dbe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.554+0000 7f464effd640 1 -- 172.21.15.2:0/2666200734 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540af5a0 con 0x560c3a948390 2024-08-31T04:26:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.554+0000 7f464effd640 1 -- 172.21.15.2:0/2666200734 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46540b4050 con 0x560c3a948390 2024-08-31T04:26:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.554+0000 7f464effd640 1 -- 172.21.15.2:0/2666200734 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540920b0 con 0x560c3a948390 2024-08-31T04:26:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 -- 172.21.15.2:0/2666200734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 msgr2=0x560c3ad11410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad11410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46540e1e40 tx=0x7f46540e4ed0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 -- 172.21.15.2:0/2666200734 shutdown_connections 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad11950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad11410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 --2- 172.21.15.2:0/2666200734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad07230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 -- 172.21.15.2:0/2666200734 >> 172.21.15.2:0/2666200734 conn(0x560c3a95d460 msgr2=0x560c3ad18300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 -- 172.21.15.2:0/2666200734 shutdown_connections 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.555+0000 7f4671edb740 1 -- 172.21.15.2:0/2666200734 wait complete. 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.556+0000 7f4671edb740 1 -- start start 2024-08-31T04:26:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.556+0000 7f4671edb740 1 Processor -- start 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad22360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad1d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50676/0 (socket says 172.21.15.2:50676) 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 -- 172.21.15.2:0/3448561334 learned_addr learned my addr 172.21.15.2:0/3448561334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ad2d0 con 0x560c3a969070 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ae740 con 0x560c3a948390 2024-08-31T04:26:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ad9a0 con 0x560c3a9401b0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669702640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad22360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4668f01640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad1d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4671edb740 10 client.0 _ll_register_callbacks cb 0x7f465c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 -- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 msgr2=0x560c3ad22360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad22360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 -- 172.21.15.2:0/3448561334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 msgr2=0x560c3ad1d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad1d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.557+0000 7f4669f03640 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3ad1e310 con 0x560c3a969070 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f4668f01640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad1d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f4669702640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad22360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f4669f03640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f465c02fd40 tx=0x7f465c02fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e306ce761c5cbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f464cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c02f860 con 0x560c3a969070 2024-08-31T04:26:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f465c004040 con 0x560c3a969070 2024-08-31T04:26:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46540b4050 con 0x560c3a969070 2024-08-31T04:26:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.558+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f465c071050 con 0x560c3a969070 2024-08-31T04:26:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 10 client.15666 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560c3ad969c0 con 0x560c3a969070 2024-08-31T04:26:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c036040 con 0x560c3a969070 2024-08-31T04:26:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f465c049050 con 0x560c3a969070 2024-08-31T04:26:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 10 client.15666 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 10 client.15666 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 20 client.15666 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a8fcda0 0x560c3ad99150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 4 client.15666 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.559+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f46540b4050 con 0x560c3a8fcda0 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.560+0000 7f4669702640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a8fcda0 0x560c3ad99150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.560+0000 7f464cff9640 10 client.15666 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.560+0000 7f4669702640 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a8fcda0 0x560c3ad99150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af5bc29f25206006 server_cookie=5f6d2ee07490a91 in_seq=0 out_seq=0 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.560+0000 7f464cff9640 1 -- 172.21.15.2:0/3448561334 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f46540b4050 con 0x560c3a8fcda0 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.560+0000 7f464cff9640 10 client.15666 handle_command_reply: tid=0 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 client.15666 shutdown 2024-08-31T04:26:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 msgr2=0x560c3ad1dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f465c02fd40 tx=0x7f465c02fff0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 shutdown_connections 2024-08-31T04:26:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560c3a8fcda0 0x560c3ad99150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c3a969070 0x560c3ad1dd50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.565 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c3a948390 0x560c3ad1d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 --2- 172.21.15.2:0/3448561334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c3a9401b0 0x560c3ad22360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 >> 172.21.15.2:0/3448561334 conn(0x560c3a95d460 msgr2=0x560c3ad11410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f464cff9640 0 client.15666 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 shutdown_connections 2024-08-31T04:26:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 1 -- 172.21.15.2:0/3448561334 wait complete. 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.561+0000 7f4671edb740 20 client.15666 trim_cache size 0 max 16384 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 msgr2=0x7f46500bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 0x7f46500bfa50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f465c004af0 tx=0x7f465c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 msgr2=0x7f466410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46540097d0 tx=0x7f4654009c90 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 shutdown_connections 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4664108ab0 0x7f466419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4664108160 0x7f466410d610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f46500bd540 0x7f46500bfa50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 --2- 172.21.15.2:0/1116313940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4664102820 0x7f466410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.562+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 >> 172.21.15.2:0/1116313940 conn(0x7f46640794e0 msgr2=0x7f4664103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.563+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 shutdown_connections 2024-08-31T04:26:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:14.563+0000 7f466b966640 1 -- 172.21.15.2:0/1116313940 wait complete. 2024-08-31T04:26:14.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:14 smithi132 ceph-mon[22335]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:14.568 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:14 smithi064 ceph-mon[22007]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T04:26:15.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:26:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 -- 172.21.15.2:0/2926319142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108140 msgr2=0x7fead8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 --2- 172.21.15.2:0/2926319142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108140 0x7fead8108550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7feac8009900 tx=0x7feac802a410 comp rx=0 tx=0).stop 2024-08-31T04:26:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 -- 172.21.15.2:0/2926319142 shutdown_connections 2024-08-31T04:26:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 --2- 172.21.15.2:0/2926319142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108140 0x7fead8108550 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 --2- 172.21.15.2:0/2926319142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108a90 0x7fead810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 --2- 172.21.15.2:0/2926319142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 -- 172.21.15.2:0/2926319142 >> 172.21.15.2:0/2926319142 conn(0x7fead80794d0 msgr2=0x7fead80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 -- 172.21.15.2:0/2926319142 shutdown_connections 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.053+0000 7feadfc4c640 1 -- 172.21.15.2:0/2926319142 wait complete. 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.054+0000 7feadfc4c640 1 Processor -- start 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.054+0000 7feadfc4c640 1 -- start start 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 0x7fead819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fead8111640 con 0x7fead8108a90 2024-08-31T04:26:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fead81114c0 con 0x7fead8108140 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadfc4c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fead81117c0 con 0x7fead8102800 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:60862/0 (socket says 172.21.15.2:60862) 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadd1e7640 1 -- 172.21.15.2:0/1819274998 learned_addr learned my addr 172.21.15.2:0/1819274998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd1e7640 1 -- 172.21.15.2:0/1819274998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 msgr2=0x7fead8198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feade1e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 0x7fead819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.055+0000 7feadd9e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd1e7640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd1e7640 1 -- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 msgr2=0x7fead819d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd1e7640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 0x7fead819d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd1e7640 1 -- 172.21.15.2:0/1819274998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead819e000 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feadd9e8640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.056+0000 7feade1e9640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 0x7fead819d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feadd1e7640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feac8005ab0 tx=0x7feac8003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feaceffd640 1 -- 172.21.15.2:0/1819274998 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac804d070 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feaceffd640 1 -- 172.21.15.2:0/1819274998 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feac80044d0 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feaceffd640 1 -- 172.21.15.2:0/1819274998 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8035070 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead819e290 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.057+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead81a4a50 con 0x7fead8108140 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.060+0000 7feae61c1740 1 Processor -- start 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.060+0000 7feae61c1740 1 -- start start 2024-08-31T04:26:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.060+0000 7feaceffd640 1 -- 172.21.15.2:0/1819274998 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7feac8050070 con 0x7fead8108140 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f229f070 0x5580f2644330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f2644db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5580f25bb680 con 0x5580f22761b0 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5580f25aac10 con 0x5580f227e390 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feae61c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5580f25aebc0 con 0x5580f229f070 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feadd9e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feadd9e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45152/0 (socket says 172.21.15.2:45152) 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feadd9e8640 1 -- 172.21.15.2:0/1893822987 learned_addr learned my addr 172.21.15.2:0/1893822987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.061+0000 7feade1e9640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f229f070 0x5580f2644330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 -- 172.21.15.2:0/1893822987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f229f070 msgr2=0x5580f2644330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f229f070 0x5580f2644330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 -- 172.21.15.2:0/1893822987 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 msgr2=0x5580f2644db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd1e7640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f2644db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f2644db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 -- 172.21.15.2:0/1893822987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f230a650 con 0x5580f22761b0 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feaceffd640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 0x7feac40b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd1e7640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f2644db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feaceffd640 1 -- 172.21.15.2:0/1819274998 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7feac810e0c0 con 0x7fead8108140 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feade1e9640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 0x7feac40b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.062+0000 7feadd9e8640 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fead400b670 tx=0x7fead4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c615a8d257a99e60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.063+0000 7feac3fff640 1 -- 172.21.15.2:0/1893822987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4004230 con 0x5580f22761b0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.063+0000 7feade1e9640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 0x7feac40b72c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fead0005fd0 tx=0x7fead0009530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.063+0000 7feac3fff640 1 -- 172.21.15.2:0/1893822987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fead40043d0 con 0x5580f22761b0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.063+0000 7feac3fff640 1 -- 172.21.15.2:0/1893822987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4015650 con 0x5580f22761b0 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- 172.21.15.2:0/1893822987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 msgr2=0x5580f2644870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fead400b670 tx=0x7fead4005f90 comp rx=0 tx=0).stop 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- 172.21.15.2:0/1893822987 shutdown_connections 2024-08-31T04:26:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f22761b0 0x5580f2644870 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f2644db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 --2- 172.21.15.2:0/1893822987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f229f070 0x5580f2644330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- 172.21.15.2:0/1893822987 >> 172.21.15.2:0/1893822987 conn(0x5580f2293460 msgr2=0x5580f2642220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- 172.21.15.2:0/1893822987 shutdown_connections 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- 172.21.15.2:0/1893822987 wait complete. 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.064+0000 7feae61c1740 1 -- start start 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 Processor -- start 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f264fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 0x5580f2650110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f265be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5580f240d700 con 0x5580f225d9f0 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5580f2531750 con 0x5580f229f070 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feae61c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5580f2652b10 con 0x5580f227e390 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 0x5580f2650110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.065+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 0x5580f2650110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:60880/0 (socket says 172.21.15.2:60880) 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd1e7640 1 -- 172.21.15.2:0/3209346920 learned_addr learned my addr 172.21.15.2:0/3209346920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f264fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feade1e9640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f265be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feae61c1740 10 client.0 _ll_register_callbacks cb 0x5580f2560e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 -- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 msgr2=0x5580f2650110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 0x5580f2650110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 -- 172.21.15.2:0/3209346920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 msgr2=0x5580f265be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f265be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 -- 172.21.15.2:0/3209346920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f256a900 con 0x5580f227e390 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fead40043d0 con 0x5580f227e390 2024-08-31T04:26:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feadd9e8640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f264fb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5580f2647030 tx=0x7fead4003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71c5676ae73508a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.066+0000 7feac17fa640 10 client.25279 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feac17fa640 1 -- 172.21.15.2:0/3209346920 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4021630 con 0x5580f227e390 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feac17fa640 1 -- 172.21.15.2:0/3209346920 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fead40217d0 con 0x5580f227e390 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feac17fa640 1 -- 172.21.15.2:0/3209346920 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fead4021a30 con 0x5580f227e390 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feae61c1740 10 client.25279 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5580f265e7b0 con 0x5580f227e390 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feac17fa640 1 -- 172.21.15.2:0/3209346920 <== mon.1 v2:172.21.15.132:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fead4014070 con 0x5580f227e390 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.067+0000 7feae61c1740 10 client.25279 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feae61c1740 10 client.25279 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feae61c1740 20 client.25279 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f2232da0 0x5580f2661b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feae61c1740 4 client.25279 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580f25bd5d0 con 0x5580f2232da0 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feadd1e7640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f2232da0 0x5580f2661b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feadd1e7640 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f2232da0 0x5580f2661b10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef72e57d82a95687 server_cookie=2820f43ff68406f6 in_seq=0 out_seq=0 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.068+0000 7feac17fa640 10 client.25279 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.069+0000 7feac17fa640 1 -- 172.21.15.2:0/3209346920 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580f25bd5d0 con 0x5580f2232da0 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.069+0000 7feac17fa640 10 client.25279 handle_command_reply: tid=0 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.069+0000 7feae61c1740 1 client.25279 shutdown 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.069+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 msgr2=0x5580f264fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.069+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f264fb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5580f2647030 tx=0x7fead4003820 comp rx=0 tx=0).stop 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 shutdown_connections 2024-08-31T04:26:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f2232da0 0x5580f2661b10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feac17fa640 0 client.25279 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f265be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f229f070 0x5580f2650110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 --2- 172.21.15.2:0/3209346920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f264fb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 >> 172.21.15.2:0/3209346920 conn(0x5580f2293460 msgr2=0x5580f26474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 shutdown_connections 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 1 -- 172.21.15.2:0/3209346920 wait complete. 2024-08-31T04:26:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.070+0000 7feae61c1740 20 client.25279 trim_cache size 0 max 16384 2024-08-31T04:26:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 Processor -- start 2024-08-31T04:26:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 -- start start 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 0x5580f2651a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f265bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fead81b1510 con 0x5580f225d9f0 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fead81aede0 con 0x5580f227e390 2024-08-31T04:26:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feae61c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fead81acc30 con 0x5580f2232da0 2024-08-31T04:26:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45168/0 (socket says 172.21.15.2:45168) 2024-08-31T04:26:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.084+0000 7feadd1e7640 1 -- 172.21.15.2:0/404065573 learned_addr learned my addr 172.21.15.2:0/404065573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd9e8640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 0x5580f2651a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feade1e9640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f265bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 -- 172.21.15.2:0/404065573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 msgr2=0x5580f2651a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 0x5580f2651a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 -- 172.21.15.2:0/404065573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 msgr2=0x5580f265bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f265bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 -- 172.21.15.2:0/404065573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f264ff00 con 0x5580f225d9f0 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd9e8640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 0x5580f2651a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.085+0000 7feadd1e7640 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7feac80d01f0 tx=0x7feac8031dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cdfb6a43348c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.086+0000 7feac37fe640 1 -- 172.21.15.2:0/404065573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac80d41c0 con 0x5580f225d9f0 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.086+0000 7feac37fe640 1 -- 172.21.15.2:0/404065573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feac80d8a30 con 0x5580f225d9f0 2024-08-31T04:26:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.086+0000 7feac37fe640 1 -- 172.21.15.2:0/404065573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac81100f0 con 0x5580f225d9f0 2024-08-31T04:26:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- 172.21.15.2:0/404065573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 msgr2=0x5580f2645a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7feac80d01f0 tx=0x7feac8031dd0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- 172.21.15.2:0/404065573 shutdown_connections 2024-08-31T04:26:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f2645a70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f227e390 0x5580f265bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 --2- 172.21.15.2:0/404065573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f2232da0 0x5580f2651a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- 172.21.15.2:0/404065573 >> 172.21.15.2:0/404065573 conn(0x5580f2293460 msgr2=0x5580f2645360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- 172.21.15.2:0/404065573 shutdown_connections 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- 172.21.15.2:0/404065573 wait complete. 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 -- start start 2024-08-31T04:26:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.087+0000 7feae61c1740 1 Processor -- start 2024-08-31T04:26:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 0x5580f26c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f26cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fead81ad2a0 con 0x5580f225d9f0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fead81ae710 con 0x5580f2232da0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fead81ad970 con 0x5580f227e390 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feae61c1740 10 client.0 _ll_register_callbacks cb 0x7fead400bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feadd1e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45170/0 (socket says 172.21.15.2:45170) 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feadd1e7640 1 -- 172.21.15.2:0/2068832233 learned_addr learned my addr 172.21.15.2:0/2068832233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feadd9e8640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 0x5580f26c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.088+0000 7feade1e9640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f26cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 -- 172.21.15.2:0/2068832233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 msgr2=0x5580f26cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f26cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 -- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 msgr2=0x5580f26c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 0x5580f26c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 -- 172.21.15.2:0/2068832233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f26cb8e0 con 0x5580f225d9f0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd9e8640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 0x5580f26c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feadd1e7640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feac8031440 tx=0x7feac8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d550ea12912e8c25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feac17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac80dd4e0 con 0x5580f225d9f0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7feac80d07b0 con 0x5580f225d9f0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.089+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac80d8a30 con 0x5580f225d9f0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feac80ee050 con 0x5580f225d9f0 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 10 client.15681 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5580f26ccb60 con 0x5580f225d9f0 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feac80d8a30 con 0x5580f225d9f0 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7feac8047030 con 0x5580f225d9f0 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 10 client.15681 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 10 client.15681 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 20 client.15681 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f229f070 0x5580f26cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 4 client.15681 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.090+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5580f25b9070 con 0x5580f229f070 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feadd9e8640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f229f070 0x5580f26cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feadd9e8640 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f229f070 0x5580f26cf210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=121f1fc92a435f57 server_cookie=d403973b1f9126 in_seq=0 out_seq=0 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feac17fa640 10 client.15681 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feac17fa640 1 -- 172.21.15.2:0/2068832233 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5580f25b9070 con 0x5580f229f070 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feac17fa640 10 client.15681 handle_command_reply: tid=0 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feae61c1740 1 client.15681 shutdown 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 msgr2=0x5580f26c09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.091+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feac8031440 tx=0x7feac8009260 comp rx=0 tx=0).stop 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 shutdown_connections 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5580f229f070 0x5580f26cf210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feac17fa640 0 client.15681 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5580f225d9f0 0x5580f26c09c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5580f227e390 0x5580f26cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 --2- 172.21.15.2:0/2068832233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580f2232da0 0x5580f26c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 >> 172.21.15.2:0/2068832233 conn(0x5580f2293460 msgr2=0x5580f2645c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 shutdown_connections 2024-08-31T04:26:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 1 -- 172.21.15.2:0/2068832233 wait complete. 2024-08-31T04:26:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.092+0000 7feae61c1740 20 client.15681 trim_cache size 0 max 16384 2024-08-31T04:26:16.099 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 msgr2=0x7feac40b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 0x7feac40b72c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fead0005fd0 tx=0x7fead0009530 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 msgr2=0x7fead8198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feac8005ab0 tx=0x7feac8003820 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 shutdown_connections 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7feac40b4db0 0x7feac40b72c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead8108a90 0x7fead819d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fead8108140 0x7fead8198630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 --2- 172.21.15.2:0/1819274998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead8102800 0x7fead8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 >> 172.21.15.2:0/1819274998 conn(0x7fead80794d0 msgr2=0x7fead8104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 shutdown_connections 2024-08-31T04:26:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:16.093+0000 7feadfc4c640 1 -- 172.21.15.2:0/1819274998 wait complete. 2024-08-31T04:26:16.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:16 smithi002 ceph-mon[18656]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-08-31T04:26:16.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:16 smithi132 ceph-mon[22335]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-08-31T04:26:16.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:16 smithi064 ceph-mon[22007]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-08-31T04:26:16.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:26:17.271 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 -- 172.21.15.2:0/213301385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108140 msgr2=0x7f72d4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/213301385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108140 0x7f72d4108550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009900 tx=0x7f72c802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 -- 172.21.15.2:0/213301385 shutdown_connections 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/213301385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108140 0x7f72d4108550 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/213301385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4108a90 0x7f72d410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/213301385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4102850 0x7f72d4102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 -- 172.21.15.2:0/213301385 >> 172.21.15.2:0/213301385 conn(0x7f72d4079420 msgr2=0x7f72d4079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 -- 172.21.15.2:0/213301385 shutdown_connections 2024-08-31T04:26:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.852+0000 7f72d9dfe640 1 -- 172.21.15.2:0/213301385 wait complete. 2024-08-31T04:26:17.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.853+0000 7f72d9dfe640 1 Processor -- start 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.853+0000 7f72d9dfe640 1 -- start start 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4108140 0x7f72d41a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108a90 0x7f72d41ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41138a0 con 0x7f72d4108a90 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72d4113720 con 0x7f72d4108140 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d9dfe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f72d4113a20 con 0x7f72d4102850 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:59732/0 (socket says 172.21.15.2:59732) 2024-08-31T04:26:17.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 -- 172.21.15.2:0/3754442948 learned_addr learned my addr 172.21.15.2:0/3754442948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d3fff640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108a90 0x7f72d41ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4108140 0x7f72d41a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 -- 172.21.15.2:0/3754442948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4108140 msgr2=0x7f72d41a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4108140 0x7f72d41a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 -- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108a90 msgr2=0x7f72d41ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108a90 0x7f72d41ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.854+0000 7f72d37fe640 1 -- 172.21.15.2:0/3754442948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d41a2330 con 0x7f72d4102850 2024-08-31T04:26:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.855+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e9f0 tx=0x7f72c400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.855+0000 7f72d0ff9640 1 -- 172.21.15.2:0/3754442948 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c400cd80 con 0x7f72d4102850 2024-08-31T04:26:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.855+0000 7f72d0ff9640 1 -- 172.21.15.2:0/3754442948 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c40108e0 con 0x7f72d4102850 2024-08-31T04:26:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.856+0000 7f72d0ff9640 1 -- 172.21.15.2:0/3754442948 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4018980 con 0x7f72d4102850 2024-08-31T04:26:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.856+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d41acc00 con 0x7f72d4102850 2024-08-31T04:26:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.856+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d41ad0a0 con 0x7f72d4102850 2024-08-31T04:26:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.858+0000 7f72e0373740 1 Processor -- start 2024-08-31T04:26:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.858+0000 7f72e0373740 1 -- start start 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55860f554680 con 0x55860f238070 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55860f543c10 con 0x55860f20f1b0 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72e0373740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55860f547bc0 con 0x55860f217390 2024-08-31T04:26:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:59742/0 (socket says 172.21.15.2:59742) 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 -- 172.21.15.2:0/3172404414 learned_addr learned my addr 172.21.15.2:0/3172404414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 -- 172.21.15.2:0/3172404414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 msgr2=0x55860f5dd850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d0ff9640 1 -- 172.21.15.2:0/3754442948 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f72c4010430 con 0x7f72d4102850 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5dd850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 -- 172.21.15.2:0/3172404414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 msgr2=0x55860f5dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.859+0000 7f72d2ffd640 1 -- 172.21.15.2:0/3172404414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55860f2a3650 con 0x55860f217390 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.860+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006010 tx=0x7f72c80042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c92ebd97128d855 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.860+0000 7f72b9ffb640 1 -- 172.21.15.2:0/3172404414 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8035030 con 0x55860f217390 2024-08-31T04:26:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.860+0000 7f72b9ffb640 1 -- 172.21.15.2:0/3172404414 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c80054f0 con 0x55860f217390 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.860+0000 7f72b9ffb640 1 -- 172.21.15.2:0/3172404414 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8003850 con 0x55860f217390 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72d0ff9640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 0x7f72bc0b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72d3fff640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 0x7f72bc0b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 -- 172.21.15.2:0/3172404414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 msgr2=0x55860f5ddd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006010 tx=0x7f72c80042e0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 -- 172.21.15.2:0/3172404414 shutdown_connections 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5ddd90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 --2- 172.21.15.2:0/3172404414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 -- 172.21.15.2:0/3172404414 >> 172.21.15.2:0/3172404414 conn(0x55860f22c460 msgr2=0x55860f5db200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 -- 172.21.15.2:0/3172404414 shutdown_connections 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.861+0000 7f72e0373740 1 -- 172.21.15.2:0/3172404414 wait complete. 2024-08-31T04:26:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.862+0000 7f72d0ff9640 1 -- 172.21.15.2:0/3754442948 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f72c40e5ed0 con 0x7f72d4102850 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.862+0000 7f72e0373740 1 -- start start 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.862+0000 7f72e0373740 1 Processor -- start 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72d3fff640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 0x7f72bc0b7370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f72cc008e40 tx=0x7f72cc0085d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f20f1b0 0x55860f5e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55860f3a6700 con 0x55860f238070 2024-08-31T04:26:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:60936/0 (socket says 172.21.15.2:60936) 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72d2ffd640 1 -- 172.21.15.2:0/132622229 learned_addr learned my addr 172.21.15.2:0/132622229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55860f4ca750 con 0x55860f217390 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55860f5eba90 con 0x55860f20f1b0 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.863+0000 7f72d37fe640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f20f1b0 0x55860f5e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 -- 172.21.15.2:0/132622229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f20f1b0 msgr2=0x55860f5e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f20f1b0 0x55860f5e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 -- 172.21.15.2:0/132622229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 msgr2=0x55860f5f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72e0373740 10 client.0 _ll_register_callbacks cb 0x55860f4f9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d3fff640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55860f503900 con 0x55860f217390 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c80054f0 con 0x55860f217390 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d3fff640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.864+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c802a430 tx=0x7f72c80056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d7883d5104d70a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72b2ffd640 10 client.25412 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72b2ffd640 1 -- 172.21.15.2:0/132622229 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8035070 con 0x55860f217390 2024-08-31T04:26:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72b2ffd640 1 -- 172.21.15.2:0/132622229 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f72c8005210 con 0x55860f217390 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72b2ffd640 1 -- 172.21.15.2:0/132622229 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f72c803b430 con 0x55860f217390 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72e0373740 10 client.25412 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.865+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55860f5f76f0 con 0x55860f217390 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72b2ffd640 1 -- 172.21.15.2:0/132622229 <== mon.2 v2:172.21.15.64:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f72c803b5d0 con 0x55860f217390 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 10 client.25412 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 10 client.25412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 20 client.25412 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1f69f0 0x55860f5faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 4 client.25412 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55860f5565d0 con 0x55860f1f69f0 2024-08-31T04:26:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.866+0000 7f72d37fe640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1f69f0 0x55860f5faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.867+0000 7f72d37fe640 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1f69f0 0x55860f5faa50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=342e6c6256e274cc server_cookie=8da31433647d119 in_seq=0 out_seq=0 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.867+0000 7f72b2ffd640 10 client.25412 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.867+0000 7f72b2ffd640 1 -- 172.21.15.2:0/132622229 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55860f5565d0 con 0x55860f1f69f0 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.867+0000 7f72b2ffd640 10 client.25412 handle_command_reply: tid=0 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.867+0000 7f72e0373740 1 client.25412 shutdown 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 msgr2=0x55860f5e9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c802a430 tx=0x7f72c80056a0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 shutdown_connections 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1f69f0 0x55860f5faa50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f238070 0x55860f5f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f217390 0x55860f5e9010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72b2ffd640 0 client.25412 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 --2- 172.21.15.2:0/132622229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f20f1b0 0x55860f5e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 >> 172.21.15.2:0/132622229 conn(0x55860f22c460 msgr2=0x55860f5e04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 shutdown_connections 2024-08-31T04:26:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 1 -- 172.21.15.2:0/132622229 wait complete. 2024-08-31T04:26:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.868+0000 7f72e0373740 20 client.25412 trim_cache size 0 max 16384 2024-08-31T04:26:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72e0373740 1 Processor -- start 2024-08-31T04:26:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72e0373740 1 -- start start 2024-08-31T04:26:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72e0373740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72e0373740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45220/0 (socket says 172.21.15.2:45220) 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.882+0000 7f72e0373740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 0x55860f5e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d2ffd640 1 -- 172.21.15.2:0/1684767977 learned_addr learned my addr 172.21.15.2:0/1684767977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b9c20 con 0x55860f217390 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b74f0 con 0x55860f20f1b0 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b5340 con 0x55860f238070 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d37fe640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 0x55860f5e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 -- 172.21.15.2:0/1684767977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 msgr2=0x55860f5e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5e0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 -- 172.21.15.2:0/1684767977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 msgr2=0x55860f5e5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d3fff640 1 -- 172.21.15.2:0/1684767977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55860f5e01a0 con 0x55860f238070 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.883+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.884+0000 7f72d3fff640 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 0x55860f5e6200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72cc01c590 tx=0x7f72cc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4c6406d744a12e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.884+0000 7f72b97fa640 1 -- 172.21.15.2:0/1684767977 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00e980 con 0x55860f238070 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.884+0000 7f72b97fa640 1 -- 172.21.15.2:0/1684767977 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72cc021070 con 0x55860f238070 2024-08-31T04:26:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.884+0000 7f72b97fa640 1 -- 172.21.15.2:0/1684767977 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc01d3f0 con 0x55860f238070 2024-08-31T04:26:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 msgr2=0x55860f5e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 0x55860f5e6200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72cc01c590 tx=0x7f72cc013000 comp rx=0 tx=0).stop 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 shutdown_connections 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f217390 0x55860f5e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f238070 0x55860f5e6200 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 --2- 172.21.15.2:0/1684767977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f20f1b0 0x55860f5e0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 >> 172.21.15.2:0/1684767977 conn(0x55860f22c460 msgr2=0x55860f5e0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 shutdown_connections 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- 172.21.15.2:0/1684767977 wait complete. 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.885+0000 7f72e0373740 1 -- start start 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 Processor -- start 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 0x55860f65e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b59b0 con 0x55860f20f1b0 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b6e20 con 0x55860f238070 2024-08-31T04:26:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b6080 con 0x55860f217390 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72e0373740 10 client.0 _ll_register_callbacks cb 0x7f72cc008470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45224/0 (socket says 172.21.15.2:45224) 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72d37fe640 1 -- 172.21.15.2:0/3904433147 learned_addr learned my addr 172.21.15.2:0/3904433147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.886+0000 7f72d3fff640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 0x55860f65e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 -- 172.21.15.2:0/3904433147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 msgr2=0x55860f5fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 -- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 msgr2=0x55860f65e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 0x55860f65e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 -- 172.21.15.2:0/3904433147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55860f65ea40 con 0x55860f20f1b0 2024-08-31T04:26:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d3fff640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 0x55860f65e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72d37fe640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f72c40abcd0 tx=0x7f72c4010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d92d95491aa6618 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40b52f0 con 0x55860f20f1b0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.887+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f72c40b3bc0 con 0x55860f20f1b0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72cc021070 con 0x55860f20f1b0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f72c40b3dc0 con 0x55860f20f1b0 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 10 client.15693 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55860f665e90 con 0x55860f20f1b0 2024-08-31T04:26:17.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c4097190 con 0x55860f20f1b0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f72c4018b20 con 0x55860f20f1b0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 20 client.15693 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1cbda0 0x55860f668610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 4 client.15693 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.888+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f72cc021070 con 0x55860f1cbda0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.889+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1cbda0 0x55860f668610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.889+0000 7f72b2ffd640 10 client.15693 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.890+0000 7f72d2ffd640 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1cbda0 0x55860f668610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a705bf2d38800285 server_cookie=e7fdf50983d07159 in_seq=0 out_seq=0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.890+0000 7f72b2ffd640 1 -- 172.21.15.2:0/3904433147 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f72cc021070 con 0x55860f1cbda0 2024-08-31T04:26:17.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.890+0000 7f72b2ffd640 10 client.15693 handle_command_reply: tid=0 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.890+0000 7f72e0373740 1 client.15693 shutdown 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 msgr2=0x55860f5fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f72c40abcd0 tx=0x7f72c4010cc0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 shutdown_connections 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55860f1cbda0 0x55860f668610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55860f238070 0x55860f65e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72b2ffd640 0 client.15693 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55860f217390 0x55860f5fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 --2- 172.21.15.2:0/3904433147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55860f20f1b0 0x55860f5fc660 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 >> 172.21.15.2:0/3904433147 conn(0x55860f22c460 msgr2=0x55860f5e9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 shutdown_connections 2024-08-31T04:26:17.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 1 -- 172.21.15.2:0/3904433147 wait complete. 2024-08-31T04:26:17.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.891+0000 7f72e0373740 20 client.15693 trim_cache size 0 max 16384 2024-08-31T04:26:17.900 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 msgr2=0x7f72bc0b7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 0x7f72bc0b7370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f72cc008e40 tx=0x7f72cc0085d0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 msgr2=0x7f72d41a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e9f0 tx=0x7f72c400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 shutdown_connections 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f72bc0b4e60 0x7f72bc0b7370 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d4108a90 0x7f72d41ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d4108140 0x7f72d41a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 --2- 172.21.15.2:0/3754442948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72d4102850 0x7f72d41a1520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 >> 172.21.15.2:0/3754442948 conn(0x7f72d4079420 msgr2=0x7f72d41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 shutdown_connections 2024-08-31T04:26:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:17.892+0000 7f72d9dfe640 1 -- 172.21.15.2:0/3754442948 wait complete. 2024-08-31T04:26:18.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:18 smithi064 ceph-mon[22007]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-08-31T04:26:18.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:18 smithi132 ceph-mon[22335]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-08-31T04:26:18.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:18 smithi002 ceph-mon[18656]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-08-31T04:26:19.623 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:26:19.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:26:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:20.410 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:20 smithi002 ceph-mon[18656]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-08-31T04:26:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:20 smithi064 ceph-mon[22007]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-08-31T04:26:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:20 smithi132 ceph-mon[22335]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-08-31T04:26:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 -- 172.21.15.2:0/2842782447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c104f70 msgr2=0x7fcb7c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 --2- 172.21.15.2:0/2842782447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c104f70 0x7fcb7c105380 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009900 tx=0x7fcb6c02a410 comp rx=0 tx=0).stop 2024-08-31T04:26:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 -- 172.21.15.2:0/2842782447 shutdown_connections 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 --2- 172.21.15.2:0/2842782447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c104f70 0x7fcb7c105380 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 --2- 172.21.15.2:0/2842782447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 --2- 172.21.15.2:0/2842782447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 -- 172.21.15.2:0/2842782447 >> 172.21.15.2:0/2842782447 conn(0x7fcb7c077a60 msgr2=0x7fcb7c077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 -- 172.21.15.2:0/2842782447 shutdown_connections 2024-08-31T04:26:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.608+0000 7fcb83f86640 1 -- 172.21.15.2:0/2842782447 wait complete. 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 Processor -- start 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 -- start start 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c104f70 0x7fcb7c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c112750 con 0x7fcb7c102fa0 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1125d0 con 0x7fcb7c104f70 2024-08-31T04:26:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb83f86640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1128d0 con 0x7fcb7c1058c0 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb81d22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb82523640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb82523640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:59786/0 (socket says 172.21.15.2:59786) 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb82523640 1 -- 172.21.15.2:0/1136027455 learned_addr learned my addr 172.21.15.2:0/1136027455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.610+0000 7fcb81521640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c104f70 0x7fcb7c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 -- 172.21.15.2:0/1136027455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c104f70 msgr2=0x7fcb7c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c104f70 0x7fcb7c199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 -- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 msgr2=0x7fcb7c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 -- 172.21.15.2:0/1136027455 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c19f130 con 0x7fcb7c1058c0 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb81d22640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb82523640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400eb10 tx=0x7fcb7400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.611+0000 7fcb72ffd640 1 -- 172.21.15.2:0/1136027455 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74004b20 con 0x7fcb7c1058c0 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.612+0000 7fcb72ffd640 1 -- 172.21.15.2:0/1136027455 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb74004cc0 con 0x7fcb7c1058c0 2024-08-31T04:26:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.612+0000 7fcb72ffd640 1 -- 172.21.15.2:0/1136027455 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74010670 con 0x7fcb7c1058c0 2024-08-31T04:26:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.612+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c19f420 con 0x7fcb7c1058c0 2024-08-31T04:26:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.612+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c101c00 con 0x7fcb7c1058c0 2024-08-31T04:26:20.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.615+0000 7fcb8a4fb740 1 Processor -- start 2024-08-31T04:26:20.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.616+0000 7fcb72ffd640 1 -- 172.21.15.2:0/1136027455 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7fcb74005020 con 0x7fcb7c1058c0 2024-08-31T04:26:20.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.616+0000 7fcb8a4fb740 1 -- start start 2024-08-31T04:26:20.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.616+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 0x555ccc7b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.616+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ccc7285f0 con 0x555ccc40c350 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ccc717b80 con 0x555ccc3e3490 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555ccc71bb30 con 0x555ccc3eb670 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:60984/0 (socket says 172.21.15.2:60984) 2024-08-31T04:26:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 -- 172.21.15.2:0/3899437308 learned_addr learned my addr 172.21.15.2:0/3899437308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb72ffd640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 0x7fcb680b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 -- 172.21.15.2:0/3899437308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 msgr2=0x555ccc7b3200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7b3200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81d22640 1 -- 172.21.15.2:0/3899437308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 msgr2=0x555ccc7b2780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb82523640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 0x7fcb680b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.617+0000 7fcb81521640 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 0x555ccc7b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb72ffd640 1 -- 172.21.15.2:0/1136027455 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fcb740e5fb0 con 0x7fcb7c1058c0 2024-08-31T04:26:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb81d22640 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 0x555ccc7b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb81d22640 1 -- 172.21.15.2:0/3899437308 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ccc477930 con 0x555ccc3e3490 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb81521640 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 0x555ccc7b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb82523640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 0x7fcb680b72c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb740e3220 tx=0x7fcb740e21a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.618+0000 7fcb81d22640 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb780114c0 tx=0x7fcb78011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac56d64040e97ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.619+0000 7fcb67fff640 1 -- 172.21.15.2:0/3899437308 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78004220 con 0x555ccc3e3490 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.619+0000 7fcb67fff640 1 -- 172.21.15.2:0/3899437308 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb7801ae20 con 0x555ccc3e3490 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.619+0000 7fcb67fff640 1 -- 172.21.15.2:0/3899437308 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb780047a0 con 0x555ccc3e3490 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/3899437308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 msgr2=0x555ccc7b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb780114c0 tx=0x7fcb78011980 comp rx=0 tx=0).stop 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/3899437308 shutdown_connections 2024-08-31T04:26:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7b2cc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/3899437308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc40c350 0x555ccc7b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/3899437308 >> 172.21.15.2:0/3899437308 conn(0x555ccc400740 msgr2=0x555ccc7b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/3899437308 shutdown_connections 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.620+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/3899437308 wait complete. 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.621+0000 7fcb8a4fb740 1 -- start start 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.621+0000 7fcb8a4fb740 1 Processor -- start 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.621+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.621+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.621+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc40c350 0x555ccc7ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ccc57a890 con 0x555ccc3eb670 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ccc69e790 con 0x555ccc3e3490 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555ccc7c0f60 con 0x555ccc40c350 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81521640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81d22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb8a4fb740 10 client.0 _ll_register_callbacks cb 0x555ccc423ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81d22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45256/0 (socket says 172.21.15.2:45256) 2024-08-31T04:26:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81d22640 1 -- 172.21.15.2:0/909264244 learned_addr learned my addr 172.21.15.2:0/909264244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:20.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81521640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc40c350 0x555ccc7ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81521640 1 -- 172.21.15.2:0/909264244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc40c350 msgr2=0x555ccc7ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81521640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc40c350 0x555ccc7ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.622+0000 7fcb81521640 1 -- 172.21.15.2:0/909264244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 msgr2=0x555ccc7be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb81521640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb81521640 1 -- 172.21.15.2:0/909264244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ccc6d5f30 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb81d22640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb7801ae20 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb81521640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7be090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c02a930 tx=0x7fcb6c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e1bb6d2a2bfff6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb657fa640 10 client.25430 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb657fa640 1 -- 172.21.15.2:0/909264244 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035070 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb657fa640 1 -- 172.21.15.2:0/909264244 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fcb6c004220 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb657fa640 1 -- 172.21.15.2:0/909264244 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcb6c004420 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb8a4fb740 10 client.25430 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.623+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({fsmap=26}) -- 0x555ccc7ca7f0 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb657fa640 1 -- 172.21.15.2:0/909264244 <== mon.2 v2:172.21.15.64:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcb6c005100 con 0x555ccc3e3490 2024-08-31T04:26:20.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 10 client.25430 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 20 client.25430 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc3cacd0 0x555ccc7cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 4 client.25430 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ccc72a540 con 0x555ccc3cacd0 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.624+0000 7fcb81d22640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc3cacd0 0x555ccc7cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.625+0000 7fcb657fa640 10 client.25430 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.625+0000 7fcb81d22640 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc3cacd0 0x555ccc7cdc40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2bd39a55f35d368 server_cookie=43ef2bdc06958de0 in_seq=0 out_seq=0 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb657fa640 1 -- 172.21.15.2:0/909264244 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ccc72a540 con 0x555ccc3cacd0 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb657fa640 10 client.25430 handle_command_reply: tid=0 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 client.25430 shutdown 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 msgr2=0x555ccc7be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7be090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c02a930 tx=0x7fcb6c009260 comp rx=0 tx=0).stop 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 shutdown_connections 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc3cacd0 0x555ccc7cdc40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb657fa640 0 client.25430 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc7be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc40c350 0x555ccc7ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/909264244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3e3490 0x555ccc7be090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 >> 172.21.15.2:0/909264244 conn(0x555ccc400740 msgr2=0x555ccc7b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 shutdown_connections 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/909264244 wait complete. 2024-08-31T04:26:20.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.626+0000 7fcb8a4fb740 20 client.25430 trim_cache size 0 max 16384 2024-08-31T04:26:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 Processor -- start 2024-08-31T04:26:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 -- start start 2024-08-31T04:26:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3e3490 0x555ccc7db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1a8e10 con 0x555ccc3e3490 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1a66e0 con 0x555ccc3cacd0 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.662+0000 7fcb8a4fb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c073d40 con 0x555ccc3eb670 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:59808/0 (socket says 172.21.15.2:59808) 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 -- 172.21.15.2:0/4069058973 learned_addr learned my addr 172.21.15.2:0/4069058973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 -- 172.21.15.2:0/4069058973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 msgr2=0x555ccc7ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 -- 172.21.15.2:0/4069058973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3e3490 msgr2=0x555ccc7db2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3e3490 0x555ccc7db2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 -- 172.21.15.2:0/4069058973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ccc7bea90 con 0x555ccc3eb670 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.663+0000 7fcb81521640 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c004650 tx=0x7fcb6c035000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc23698dc1439f58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.664+0000 7fcb677fe640 1 -- 172.21.15.2:0/4069058973 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c031a30 con 0x555ccc3eb670 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.664+0000 7fcb677fe640 1 -- 172.21.15.2:0/4069058973 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb7801ae20 con 0x555ccc3eb670 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.664+0000 7fcb677fe640 1 -- 172.21.15.2:0/4069058973 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c03d450 con 0x555ccc3eb670 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.665+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/4069058973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 msgr2=0x555ccc7bfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.665+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c004650 tx=0x7fcb6c035000 comp rx=0 tx=0).stop 2024-08-31T04:26:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/4069058973 shutdown_connections 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3e3490 0x555ccc7db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3eb670 0x555ccc7bfcc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/4069058973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/4069058973 >> 172.21.15.2:0/4069058973 conn(0x555ccc400740 msgr2=0x555ccc7bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/4069058973 shutdown_connections 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/4069058973 wait complete. 2024-08-31T04:26:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.680+0000 7fcb8a4fb740 1 -- start start 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.681+0000 7fcb8a4fb740 1 Processor -- start 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.681+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7c1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.681+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 0x555ccc7c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.681+0000 7fcb8a4fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc839ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb81521640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb81521640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:32784/0 (socket says 172.21.15.2:32784) 2024-08-31T04:26:20.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb81521640 1 -- 172.21.15.2:0/2270835210 learned_addr learned my addr 172.21.15.2:0/2270835210 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb81d22640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 0x555ccc7c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0743b0 con 0x555ccc3eb670 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1a6010 con 0x555ccc3cacd0 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c074a80 con 0x555ccc3e3490 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.682+0000 7fcb81521640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc839ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 -- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 msgr2=0x555ccc7c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 -- 172.21.15.2:0/2270835210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 msgr2=0x555ccc839ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc839ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ccc83a400 con 0x555ccc3e3490 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb8a4fb740 10 client.0 _ll_register_callbacks cb 0x7fcb740093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb7801ae20 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81521640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc839ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb81d22640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 0x555ccc7c1ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009350 tx=0x7fcb78009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53790a091155b17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.683+0000 7fcb657fa640 10 client.25315 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb657fa640 1 -- 172.21.15.2:0/2270835210 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78026040 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb657fa640 1 -- 172.21.15.2:0/2270835210 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fcb7800f670 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb657fa640 1 -- 172.21.15.2:0/2270835210 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcb7800f870 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 10 client.25315 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({fsmap=26}) -- 0x555ccc83b3a0 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb657fa640 1 -- 172.21.15.2:0/2270835210 <== mon.1 v2:172.21.15.132:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcb78044020 con 0x555ccc3e3490 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 10 client.25315 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 10 client.25315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 20 client.25315 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc40c350 0x555ccc83d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 4 client.25315 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.684+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555ccc725fe0 con 0x555ccc40c350 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.685+0000 7fcb81521640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc40c350 0x555ccc83d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.685+0000 7fcb657fa640 10 client.25315 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.685+0000 7fcb81521640 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc40c350 0x555ccc83d6f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635eb4ad2fd66f2e server_cookie=397f6afc5294e0c4 in_seq=0 out_seq=0 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.687+0000 7fcb657fa640 1 -- 172.21.15.2:0/2270835210 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555ccc725fe0 con 0x555ccc40c350 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.687+0000 7fcb657fa640 10 client.25315 handle_command_reply: tid=0 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.687+0000 7fcb8a4fb740 1 client.25315 shutdown 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.687+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 msgr2=0x555ccc7c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.687+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 0x555ccc7c1ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009350 tx=0x7fcb78009cc0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 shutdown_connections 2024-08-31T04:26:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x555ccc40c350 0x555ccc83d6f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ccc3eb670 0x555ccc839ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ccc3e3490 0x555ccc7c1ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 --2- 172.21.15.2:0/2270835210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ccc3cacd0 0x555ccc7c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 >> 172.21.15.2:0/2270835210 conn(0x555ccc400740 msgr2=0x555ccc7b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb657fa640 0 client.25315 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 shutdown_connections 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 1 -- 172.21.15.2:0/2270835210 wait complete. 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.688+0000 7fcb8a4fb740 20 client.25315 trim_cache size 0 max 16384 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa", 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:26:20.691 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 msgr2=0x7fcb680b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 0x7fcb680b72c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb740e3220 tx=0x7fcb740e21a0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 msgr2=0x7fcb7c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400eb10 tx=0x7fcb7400c2d0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 shutdown_connections 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb7c1058c0 0x7fcb7c19ea00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb7c104f70 0x7fcb7c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcb680b4db0 0x7fcb680b72c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 --2- 172.21.15.2:0/1136027455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb7c102fa0 0x7fcb7c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.689+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 >> 172.21.15.2:0/1136027455 conn(0x7fcb7c077a60 msgr2=0x7fcb7c107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.690+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 shutdown_connections 2024-08-31T04:26:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:20.690+0000 7fcb83f86640 1 -- 172.21.15.2:0/1136027455 wait complete. 2024-08-31T04:26:21.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:26:21.716 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 -- 172.21.15.2:0/2931083976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374108170 msgr2=0x7f0374108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 --2- 172.21.15.2:0/2931083976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374108170 0x7f0374108580 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).stop 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 -- 172.21.15.2:0/2931083976 shutdown_connections 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 --2- 172.21.15.2:0/2931083976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374108170 0x7f0374108580 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 --2- 172.21.15.2:0/2931083976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0374108ac0 0x7f037410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 --2- 172.21.15.2:0/2931083976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374102880 0x7f0374102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.345+0000 7f037b47a640 1 -- 172.21.15.2:0/2931083976 >> 172.21.15.2:0/2931083976 conn(0x7f0374079530 msgr2=0x7f0374079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.346+0000 7f037b47a640 1 -- 172.21.15.2:0/2931083976 shutdown_connections 2024-08-31T04:26:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.347+0000 7f037b47a640 1 -- 172.21.15.2:0/2931083976 wait complete. 2024-08-31T04:26:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.347+0000 7f037b47a640 1 Processor -- start 2024-08-31T04:26:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 -- start start 2024-08-31T04:26:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0374108170 0x7f0374112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374108ac0 0x7f03741134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03741127a0 con 0x7f0374102880 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0374112620 con 0x7f0374108170 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f037b47a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0374112920 con 0x7f0374108ac0 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f0379216640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f0379216640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45288/0 (socket says 172.21.15.2:45288) 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f0379216640 1 -- 172.21.15.2:0/3194821149 learned_addr learned my addr 172.21.15.2:0/3194821149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.348+0000 7f0379a17640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374108ac0 0x7f03741134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 -- 172.21.15.2:0/3194821149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374108ac0 msgr2=0x7f03741134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374108ac0 0x7f03741134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 -- 172.21.15.2:0/3194821149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0374108170 msgr2=0x7f0374112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0374108170 0x7f0374112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 -- 172.21.15.2:0/3194821149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0374113c70 con 0x7f0374102880 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f0379216640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f037000d770 tx=0x7f037000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f036a7fc640 1 -- 172.21.15.2:0/3194821149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370017070 con 0x7f0374102880 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f036a7fc640 1 -- 172.21.15.2:0/3194821149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03700054d0 con 0x7f0374102880 2024-08-31T04:26:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.349+0000 7f036a7fc640 1 -- 172.21.15.2:0/3194821149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370004c30 con 0x7f0374102880 2024-08-31T04:26:22.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.351+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03741acca0 con 0x7f0374102880 2024-08-31T04:26:22.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.351+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03741ad040 con 0x7f0374102880 2024-08-31T04:26:22.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.354+0000 7f03819ef740 1 Processor -- start 2024-08-31T04:26:22.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 -- start start 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f036a7fc640 1 -- 172.21.15.2:0/3194821149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f0370004dd0 con 0x7f0374102880 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed22300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed22840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a5ec99630 con 0x563a5e9541b0 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563a5ec88bc0 con 0x563a5e95c390 2024-08-31T04:26:22.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.355+0000 7f03819ef740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563a5ec8cb70 con 0x563a5e97d070 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.356+0000 7f0378a15640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.356+0000 7f0378a15640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:32812/0 (socket says 172.21.15.2:32812) 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.356+0000 7f0379216640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed22840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.356+0000 7f0378a15640 1 -- 172.21.15.2:0/2206588153 learned_addr learned my addr 172.21.15.2:0/2206588153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.356+0000 7f0379a17640 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed22300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f036a7fc640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 0x7f03600b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0378a15640 1 -- 172.21.15.2:0/2206588153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 msgr2=0x563a5ed22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0378a15640 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed22300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0378a15640 1 -- 172.21.15.2:0/2206588153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 msgr2=0x563a5ed22840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0379a17640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 0x7f03600b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0378a15640 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed22840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0378a15640 1 -- 172.21.15.2:0/2206588153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5e9e8650 con 0x563a5e95c390 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.357+0000 7f0379216640 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed22840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f036a7fc640 1 -- 172.21.15.2:0/3194821149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f03700e5880 con 0x7f0374102880 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f0379a17640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 0x7f03600b72c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f036c005fd0 tx=0x7f036c004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f0378a15640 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f036402a930 tx=0x7f0364000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668a69c27822cb26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f035f7fe640 1 -- 172.21.15.2:0/2206588153 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036403e030 con 0x563a5e95c390 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f035f7fe640 1 -- 172.21.15.2:0/2206588153 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0364005020 con 0x563a5e95c390 2024-08-31T04:26:22.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.358+0000 7f035f7fe640 1 -- 172.21.15.2:0/2206588153 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364035040 con 0x563a5e95c390 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- 172.21.15.2:0/2206588153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 msgr2=0x563a5ed22d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f036402a930 tx=0x7f0364000bc0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- 172.21.15.2:0/2206588153 shutdown_connections 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed22840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e95c390 0x563a5ed22d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 --2- 172.21.15.2:0/2206588153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- 172.21.15.2:0/2206588153 >> 172.21.15.2:0/2206588153 conn(0x563a5e971460 msgr2=0x563a5ed201f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- 172.21.15.2:0/2206588153 shutdown_connections 2024-08-31T04:26:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- 172.21.15.2:0/2206588153 wait complete. 2024-08-31T04:26:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.360+0000 7f03819ef740 1 -- start start 2024-08-31T04:26:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 Processor -- start 2024-08-31T04:26:22.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e9541b0 0x563a5ed2dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed39dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a5eaeb700 con 0x563a5e95c390 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563a5ec0f700 con 0x563a5e9541b0 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563a5ed30a80 con 0x563a5e97d070 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.361+0000 7f03819ef740 10 client.0 _ll_register_callbacks cb 0x563a5ec3edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45302/0 (socket says 172.21.15.2:45302) 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 -- 172.21.15.2:0/3695462375 learned_addr learned my addr 172.21.15.2:0/3695462375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 -- 172.21.15.2:0/3695462375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 msgr2=0x563a5ed39dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed39dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 -- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e9541b0 msgr2=0x563a5ed2dab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:26:22.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0379216640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e9541b0 0x563a5ed2dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e9541b0 0x563a5ed2dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.362+0000 7f0378a15640 1 -- 172.21.15.2:0/3695462375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5ec488b0 con 0x563a5e95c390 2024-08-31T04:26:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f0378a15640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0364006010 tx=0x7f0364005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574628c9a12846dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f035cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036403e040 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f03640053d0 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0364005020 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.363+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0364054050 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.364+0000 7f03819ef740 10 client.15717 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.364+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a5ed3c890 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.364+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036404b070 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f03640039c0 con 0x563a5e95c390 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 10 client.15717 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 20 client.15717 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e93b9f0 0x563a5ed3fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 4 client.15717 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0364005020 con 0x563a5e93b9f0 2024-08-31T04:26:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f0379216640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e93b9f0 0x563a5ed3fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.365+0000 7f035cff9640 10 client.15717 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.366+0000 7f0379216640 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e93b9f0 0x563a5ed3fbf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508f8239b9206a5a server_cookie=4f8c94eceed9abb4 in_seq=0 out_seq=0 2024-08-31T04:26:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f035cff9640 1 -- 172.21.15.2:0/3695462375 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0364005020 con 0x563a5e93b9f0 2024-08-31T04:26:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f035cff9640 10 client.15717 handle_command_reply: tid=0 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 client.15717 shutdown 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 msgr2=0x563a5ed2dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0364006010 tx=0x7f0364005e70 comp rx=0 tx=0).stop 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 shutdown_connections 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e93b9f0 0x563a5ed3fbf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed2dff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f035cff9640 0 client.15717 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e97d070 0x563a5ed39dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 --2- 172.21.15.2:0/3695462375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e9541b0 0x563a5ed2dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.367+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 >> 172.21.15.2:0/3695462375 conn(0x563a5e971460 msgr2=0x563a5ed25490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.368+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 shutdown_connections 2024-08-31T04:26:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.368+0000 7f03819ef740 1 -- 172.21.15.2:0/3695462375 wait complete. 2024-08-31T04:26:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.368+0000 7f03819ef740 20 client.15717 trim_cache size 0 max 16384 2024-08-31T04:26:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.403+0000 7f03819ef740 1 Processor -- start 2024-08-31T04:26:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.403+0000 7f03819ef740 1 -- start start 2024-08-31T04:26:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed23a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f0378a15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f0378a15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45304/0 (socket says 172.21.15.2:45304) 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f0378a15640 1 -- 172.21.15.2:0/1697782286 learned_addr learned my addr 172.21.15.2:0/1697782286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e95c390 0x563a5ed2b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b9d00 con 0x563a5e9541b0 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b75d0 con 0x563a5e93b9f0 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b5420 con 0x563a5e95c390 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.404+0000 7f0379216640 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed23a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 -- 172.21.15.2:0/1697782286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e95c390 msgr2=0x563a5ed2b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e95c390 0x563a5ed2b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 -- 172.21.15.2:0/1697782286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 msgr2=0x563a5ed2aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 -- 172.21.15.2:0/1697782286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5ed245f0 con 0x563a5e93b9f0 2024-08-31T04:26:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0378a15640 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f0379216640 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed23a40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03700e2af0 tx=0x7f03700e7d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce16110cdd27340 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f035effd640 1 -- 172.21.15.2:0/1697782286 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700a78a0 con 0x563a5e93b9f0 2024-08-31T04:26:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f035effd640 1 -- 172.21.15.2:0/1697782286 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03700ab4f0 con 0x563a5e93b9f0 2024-08-31T04:26:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.405+0000 7f035effd640 1 -- 172.21.15.2:0/1697782286 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700b4d00 con 0x563a5e93b9f0 2024-08-31T04:26:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.406+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 msgr2=0x563a5ed23a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.406+0000 7f03819ef740 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed23a40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03700e2af0 tx=0x7f03700e7d90 comp rx=0 tx=0).stop 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 shutdown_connections 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e9541b0 0x563a5ed2aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e95c390 0x563a5ed2b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 --2- 172.21.15.2:0/1697782286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed23a40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 >> 172.21.15.2:0/1697782286 conn(0x563a5e971460 msgr2=0x563a5ed23330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 shutdown_connections 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 -- 172.21.15.2:0/1697782286 wait complete. 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 -- start start 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.407+0000 7f03819ef740 1 Processor -- start 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.408+0000 7f03819ef740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed9e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.408+0000 7f03819ef740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.408+0000 7f03819ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.408+0000 7f0378a15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0379216640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed9e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0379216640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed9e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:32846/0 (socket says 172.21.15.2:32846) 2024-08-31T04:26:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0378a15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:59850/0 (socket says 172.21.15.2:59850) 2024-08-31T04:26:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0379a17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0379a17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45320/0 (socket says 172.21.15.2:45320) 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0379216640 1 -- 172.21.15.2:0/1399247830 learned_addr learned my addr 172.21.15.2:0/1399247830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b5a90 con 0x563a5e95c390 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b6f00 con 0x563a5e93b9f0 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f03741b6160 con 0x563a5e9541b0 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0378a15640 1 -- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 msgr2=0x563a5ed9e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0378a15640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed9e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.409+0000 7f0378a15640 1 -- 172.21.15.2:0/1399247830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 msgr2=0x563a5ed9ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f0378a15640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f0378a15640 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5eda9380 con 0x563a5e9541b0 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f0379a17640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f03819ef740 10 client.0 _ll_register_callbacks cb 0x7f03700e2980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03700ab4f0 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f0378a15640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f036402a930 tx=0x7f03640316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4d7c922127119c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f035cff9640 10 client.25327 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f035cff9640 1 -- 172.21.15.2:0/1399247830 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036403e040 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.410+0000 7f035cff9640 1 -- 172.21.15.2:0/1399247830 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0364003a00 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f035cff9640 1 -- 172.21.15.2:0/1399247830 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0364035040 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 10 client.25327 fetch_fsmap learned FSMap version 26 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({fsmap=26}) -- 0x563a5edaa3a0 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f035cff9640 1 -- 172.21.15.2:0/1399247830 <== mon.1 v2:172.21.15.132:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0364060030 con 0x563a5e9541b0 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 10 client.25327 fetch_fsmap finished waiting for FSMap version 26 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 10 client.25327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 20 client.25327 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e97d070 0x563a5edac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.411+0000 7f03819ef740 4 client.25327 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:26:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.412+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a5ec9b580 con 0x563a5e97d070 2024-08-31T04:26:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.412+0000 7f0379216640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e97d070 0x563a5edac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.412+0000 7f035cff9640 10 client.25327 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.412+0000 7f0379216640 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e97d070 0x563a5edac9d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0acfddf781804c server_cookie=5fa346e4327ad440 in_seq=0 out_seq=0 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f035cff9640 1 -- 172.21.15.2:0/1399247830 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x563a5ec9b580 con 0x563a5e97d070 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f035cff9640 10 client.25327 handle_command_reply: tid=0 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 client.25327 shutdown 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 msgr2=0x563a5ed9e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f036402a930 tx=0x7f03640316d0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 shutdown_connections 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x563a5e97d070 0x563a5edac9d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a5e95c390 0x563a5ed9ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f035cff9640 0 client.25327 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563a5e9541b0 0x563a5ed9e840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 --2- 172.21.15.2:0/1399247830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563a5e93b9f0 0x563a5ed9e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 >> 172.21.15.2:0/1399247830 conn(0x563a5e971460 msgr2=0x563a5ed2ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.413+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 shutdown_connections 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f03819ef740 1 -- 172.21.15.2:0/1399247830 wait complete. 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f03819ef740 20 client.25327 trim_cache size 0 max 16384 2024-08-31T04:26:22.418 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa", 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:26:22.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:22.420 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:26:22.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 msgr2=0x7f03600b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 0x7f03600b72c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f036c005fd0 tx=0x7f036c004ab0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 msgr2=0x7f03741149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.414+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f037000d770 tx=0x7f037000dc30 comp rx=0 tx=0).stop 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 shutdown_connections 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0374108ac0 0x7f03741134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0374108170 0x7f0374112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f03600b4db0 0x7f03600b72c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 --2- 172.21.15.2:0/3194821149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102880 0x7f03741149c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 >> 172.21.15.2:0/3194821149 conn(0x7f0374079530 msgr2=0x7f037406ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 shutdown_connections 2024-08-31T04:26:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:22.415+0000 7f037b47a640 1 -- 172.21.15.2:0/3194821149 wait complete. 2024-08-31T04:26:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:22 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:26:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:22 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:22 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:26:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:22 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:22 smithi064 ceph-mon[22007]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-31T04:26:22.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:22 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:26:22.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:22 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:22 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:26:22.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:22 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:22 smithi132 ceph-mon[22335]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-31T04:26:22.650 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:22 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:26:22.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:22 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:22 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:26:22.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:22 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:26:22.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:22 smithi002 ceph-mon[18656]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-31T04:26:23.117 INFO:tasks.cephfs.filesystem:scrub status for tag:7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa - {'path': '/', 'tag': '7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa', 'options': 'recursive,force'} 2024-08-31T04:26:23.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:23 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:26:23.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:23 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:26:23.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:23 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:26:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:24 smithi064 ceph-mon[22007]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-31T04:26:24.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:24 smithi132 ceph-mon[22335]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-31T04:26:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:24 smithi002 ceph-mon[18656]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-31T04:26:26.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:26 smithi064 ceph-mon[22007]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-31T04:26:26.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:26 smithi132 ceph-mon[22335]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-31T04:26:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:26 smithi002 ceph-mon[18656]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-31T04:26:28.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:28 smithi064 ceph-mon[22007]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:26:28.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:28 smithi132 ceph-mon[22335]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:26:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:28 smithi002 ceph-mon[18656]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T04:26:30.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:30 smithi064 ceph-mon[22007]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T04:26:30.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:30 smithi132 ceph-mon[22335]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T04:26:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:30 smithi002 ceph-mon[18656]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T04:26:32.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:32 smithi064 ceph-mon[22007]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-31T04:26:32.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:32 smithi132 ceph-mon[22335]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-31T04:26:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:32 smithi002 ceph-mon[18656]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-31T04:26:34.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:34 smithi064 ceph-mon[22007]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-08-31T04:26:34.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:34 smithi132 ceph-mon[22335]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-08-31T04:26:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:34 smithi002 ceph-mon[18656]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-08-31T04:26:36.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:36 smithi064 ceph-mon[22007]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T04:26:36.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:36 smithi064 ceph-mon[22007]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T04:26:36.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:36 smithi132 ceph-mon[22335]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T04:26:36.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:36 smithi132 ceph-mon[22335]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T04:26:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:36 smithi002 ceph-mon[18656]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T04:26:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:36 smithi002 ceph-mon[18656]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T04:26:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:38 smithi064 ceph-mon[22007]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:26:38.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:38 smithi132 ceph-mon[22335]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:26:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:38 smithi002 ceph-mon[18656]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:26:39.215 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 92% (11766/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T04:26:39.638 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T04:26:39.638 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.638 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T04:26:39.638 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-08-31T04:26:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:26:39.643 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T04:26:39.668 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T04:26:39.671 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:26:39.671 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T04:26:40.271 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T04:26:40.349 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T04:26:40.388 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:26:40.390 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:26:40.390 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T04:26:40.429 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:26:40.432 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:26:40.432 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T04:26:40.489 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-08-31T04:26:40.490 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-08-31T04:26:40.490 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-08-31T04:26:40.550 INFO:tasks.workunit.client.0.smithi002.stderr:+ dbench 1 2024-08-31T04:26:40.559 INFO:tasks.workunit.client.0.smithi002.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-31T04:26:40.559 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-08-31T04:26:40.559 INFO:tasks.workunit.client.0.smithi002.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-31T04:26:40.559 INFO:tasks.workunit.client.0.smithi002.stdout:0 of 1 processes prepared for launch 0 sec 2024-08-31T04:26:40.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:40 smithi064 ceph-mon[22007]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:26:40.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:40 smithi132 ceph-mon[22335]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:26:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:40 smithi002 ceph-mon[18656]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:26:40.659 INFO:tasks.workunit.client.0.smithi002.stdout:1 of 1 processes prepared for launch 0 sec 2024-08-31T04:26:40.660 INFO:tasks.workunit.client.0.smithi002.stdout:releasing clients 2024-08-31T04:26:41.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 3633 38.63 MB/sec warmup 1 sec latency 6.219 ms 2024-08-31T04:26:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:42 smithi064 ceph-mon[22007]: pgmap v377: 129 pgs: 129 active+clean; 1.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-08-31T04:26:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:42 smithi132 ceph-mon[22335]: pgmap v377: 129 pgs: 129 active+clean; 1.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-08-31T04:26:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:42 smithi002 ceph-mon[18656]: pgmap v377: 129 pgs: 129 active+clean; 1.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-08-31T04:26:42.659 INFO:tasks.workunit.client.0.smithi002.stdout: 1 6730 26.62 MB/sec warmup 2 sec latency 13.893 ms 2024-08-31T04:26:43.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 9280 21.66 MB/sec warmup 3 sec latency 22.059 ms 2024-08-31T04:26:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:44 smithi064 ceph-mon[22007]: pgmap v378: 129 pgs: 129 active+clean; 2.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 106 KiB/s wr, 14 op/s 2024-08-31T04:26:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:44 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:26:44.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:44 smithi132 ceph-mon[22335]: pgmap v378: 129 pgs: 129 active+clean; 2.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 106 KiB/s wr, 14 op/s 2024-08-31T04:26:44.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:44 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:26:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:44 smithi002 ceph-mon[18656]: pgmap v378: 129 pgs: 129 active+clean; 2.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 106 KiB/s wr, 14 op/s 2024-08-31T04:26:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:44 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:26:44.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10451 18.40 MB/sec warmup 4 sec latency 694.283 ms 2024-08-31T04:26:45.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10451 14.72 MB/sec warmup 5 sec latency 1694.381 ms 2024-08-31T04:26:46.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:46 smithi064 ceph-mon[22007]: pgmap v379: 129 pgs: 129 active+clean; 3.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 156 KiB/s wr, 16 op/s 2024-08-31T04:26:46.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:46 smithi132 ceph-mon[22335]: pgmap v379: 129 pgs: 129 active+clean; 3.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 156 KiB/s wr, 16 op/s 2024-08-31T04:26:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:46 smithi002 ceph-mon[18656]: pgmap v379: 129 pgs: 129 active+clean; 3.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 156 KiB/s wr, 16 op/s 2024-08-31T04:26:46.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10451 12.27 MB/sec warmup 6 sec latency 2694.460 ms 2024-08-31T04:26:47.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10451 10.52 MB/sec warmup 7 sec latency 3694.563 ms 2024-08-31T04:26:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:48 smithi064 ceph-mon[22007]: pgmap v380: 129 pgs: 129 active+clean; 6.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 520 KiB/s wr, 68 op/s 2024-08-31T04:26:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:48 smithi132 ceph-mon[22335]: pgmap v380: 129 pgs: 129 active+clean; 6.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 520 KiB/s wr, 68 op/s 2024-08-31T04:26:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:48 smithi002 ceph-mon[18656]: pgmap v380: 129 pgs: 129 active+clean; 6.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 520 KiB/s wr, 68 op/s 2024-08-31T04:26:48.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10451 9.20 MB/sec warmup 8 sec latency 4694.627 ms 2024-08-31T04:26:49.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 13090 9.50 MB/sec warmup 9 sec latency 4765.479 ms 2024-08-31T04:26:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:50 smithi064 ceph-mon[22007]: pgmap v381: 129 pgs: 129 active+clean; 6.4 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 522 KiB/s wr, 65 op/s 2024-08-31T04:26:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:50 smithi132 ceph-mon[22335]: pgmap v381: 129 pgs: 129 active+clean; 6.4 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 522 KiB/s wr, 65 op/s 2024-08-31T04:26:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:50 smithi002 ceph-mon[18656]: pgmap v381: 129 pgs: 129 active+clean; 6.4 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 522 KiB/s wr, 65 op/s 2024-08-31T04:26:50.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 14001 9.27 MB/sec warmup 10 sec latency 762.473 ms 2024-08-31T04:26:51.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 14001 8.43 MB/sec warmup 11 sec latency 1762.575 ms 2024-08-31T04:26:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:52 smithi064 ceph-mon[22007]: pgmap v382: 129 pgs: 129 active+clean; 7.5 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 623 KiB/s wr, 84 op/s 2024-08-31T04:26:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:52 smithi132 ceph-mon[22335]: pgmap v382: 129 pgs: 129 active+clean; 7.5 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 623 KiB/s wr, 84 op/s 2024-08-31T04:26:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:52 smithi002 ceph-mon[18656]: pgmap v382: 129 pgs: 129 active+clean; 7.5 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 623 KiB/s wr, 84 op/s 2024-08-31T04:26:52.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 14001 7.73 MB/sec warmup 12 sec latency 2762.680 ms 2024-08-31T04:26:53.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:26:53.386 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:53.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 14001 7.13 MB/sec warmup 13 sec latency 3762.747 ms 2024-08-31T04:26:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 -- 172.21.15.2:0/1950965292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c102820 msgr2=0x7fb20c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 --2- 172.21.15.2:0/1950965292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c102820 0x7fb20c102c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009900 tx=0x7fb1fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:26:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 -- 172.21.15.2:0/1950965292 shutdown_connections 2024-08-31T04:26:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 --2- 172.21.15.2:0/1950965292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c108ab0 0x7fb20c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 --2- 172.21.15.2:0/1950965292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108160 0x7fb20c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 --2- 172.21.15.2:0/1950965292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c102820 0x7fb20c102c30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 -- 172.21.15.2:0/1950965292 >> 172.21.15.2:0/1950965292 conn(0x7fb20c0794e0 msgr2=0x7fb20c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 -- 172.21.15.2:0/1950965292 shutdown_connections 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 -- 172.21.15.2:0/1950965292 wait complete. 2024-08-31T04:26:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:53.999+0000 7fb21258f640 1 Processor -- start 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 -- start start 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108ab0 0x7fb20c104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c112710 con 0x7fb20c108160 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c112590 con 0x7fb20c102820 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb21258f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c112890 con 0x7fb20c108ab0 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55570/0 (socket says 172.21.15.2:55570) 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20b7fe640 1 -- 172.21.15.2:0/3739474561 learned_addr learned my addr 172.21.15.2:0/3739474561 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47670/0 (socket says 172.21.15.2:47670) 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb210b2c640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108ab0 0x7fb20c104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20b7fe640 1 -- 172.21.15.2:0/3739474561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108ab0 msgr2=0x7fb20c104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.000+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108ab0 0x7fb20c104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb20b7fe640 1 -- 172.21.15.2:0/3739474561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 msgr2=0x7fb20c104010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb20b7fe640 1 -- 172.21.15.2:0/3739474561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c1a84d0 con 0x7fb20c108160 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb20bfff640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9c0 tx=0x7fb20000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb2097fa640 1 -- 172.21.15.2:0/3739474561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20000cd80 con 0x7fb20c108160 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb2097fa640 1 -- 172.21.15.2:0/3739474561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2000054d0 con 0x7fb20c108160 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c1a87c0 con 0x7fb20c108160 2024-08-31T04:26:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb2097fa640 1 -- 172.21.15.2:0/3739474561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200010430 con 0x7fb20c108160 2024-08-31T04:26:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.001+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c1a8d00 con 0x7fb20c108160 2024-08-31T04:26:54.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 Processor -- start 2024-08-31T04:26:54.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb2097fa640 1 -- 172.21.15.2:0/3739474561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb200004fb0 con 0x7fb20c108160 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 -- start start 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5578fb9f1630 con 0x5578fb6ac1b0 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578fb9e0bc0 con 0x5578fb6b4390 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb218b04740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fb9e4b70 con 0x5578fb6d5070 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.004+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55578/0 (socket says 172.21.15.2:55578) 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 -- 172.21.15.2:0/3072473619 learned_addr learned my addr 172.21.15.2:0/3072473619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb210b2c640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 -- 172.21.15.2:0/3072473619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 msgr2=0x5578fba7a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba7a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 -- 172.21.15.2:0/3072473619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 msgr2=0x5578fba7ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba7ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 -- 172.21.15.2:0/3072473619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fb740650 con 0x5578fb6ac1b0 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb210b2c640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba7a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb2097fa640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 0x7fb1f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb210b2c640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 0x7fb1f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb2097fa640 1 -- 172.21.15.2:0/3739474561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb2000e5e70 con 0x7fb20c108160 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.005+0000 7fb20bfff640 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc031440 tx=0x7fb1fc032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f605affc0a1380 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb1f27fc640 1 -- 172.21.15.2:0/3072473619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc03f070 con 0x5578fb6ac1b0 2024-08-31T04:26:54.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb1f27fc640 1 -- 172.21.15.2:0/3072473619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc0316a0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb1f27fc640 1 -- 172.21.15.2:0/3072473619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc035070 con 0x5578fb6ac1b0 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb218b04740 1 -- 172.21.15.2:0/3072473619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 msgr2=0x5578fba7a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb218b04740 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc031440 tx=0x7fb1fc032c30 comp rx=0 tx=0).stop 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.006+0000 7fb210b2c640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 0x7fb1f40b71b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb204009fd0 tx=0x7fb204009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 -- 172.21.15.2:0/3072473619 shutdown_connections 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba7a800 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba7ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 --2- 172.21.15.2:0/3072473619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba7a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 -- 172.21.15.2:0/3072473619 >> 172.21.15.2:0/3072473619 conn(0x5578fb6c9460 msgr2=0x5578fba781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 -- 172.21.15.2:0/3072473619 shutdown_connections 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 -- 172.21.15.2:0/3072473619 wait complete. 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 -- start start 2024-08-31T04:26:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.007+0000 7fb218b04740 1 Processor -- start 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba85ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba91d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5578fb843700 con 0x5578fb6ac1b0 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578fb967700 con 0x5578fb6b4390 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fba88a40 con 0x5578fb6d5070 2024-08-31T04:26:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb218b04740 10 client.0 _ll_register_callbacks cb 0x5578fb996dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55584/0 (socket says 172.21.15.2:55584) 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 -- 172.21.15.2:0/1092159129 learned_addr learned my addr 172.21.15.2:0/1092159129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba85ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb210b2c640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 -- 172.21.15.2:0/1092159129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 msgr2=0x5578fba91d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba91d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 -- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 msgr2=0x5578fba85ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba85ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 -- 172.21.15.2:0/1092159129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fb9a08b0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb20bfff640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc006010 tx=0x7fb1fc032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4f2bac683c4307 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb1eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.008+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc04b060 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb1fc004440 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1fc0316a0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc052050 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 10 client.15735 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578fba94750 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc0316a0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fb1fc0048c0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 10 client.15735 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 20 client.15735 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb6939f0 0x5578fba97ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 4 client.15735 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578fb9f3580 con 0x5578fb6939f0 2024-08-31T04:26:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.009+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb6939f0 0x5578fba97ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.010+0000 7fb1eb7fe640 10 client.15735 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.010+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb6939f0 0x5578fba97ab0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f1ed9152808401 server_cookie=9ca934a0deda05c7 in_seq=0 out_seq=0 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/1092159129 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578fb9f3580 con 0x5578fb6939f0 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb1eb7fe640 10 client.15735 handle_command_reply: tid=0 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 client.15735 shutdown 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 msgr2=0x5578fba85980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc006010 tx=0x7fb1fc032ee0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 shutdown_connections 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb6939f0 0x5578fba97ab0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6d5070 0x5578fba91d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6b4390 0x5578fba85ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 --2- 172.21.15.2:0/1092159129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba85980 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 >> 172.21.15.2:0/1092159129 conn(0x5578fb6c9460 msgr2=0x5578fba7d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb1eb7fe640 0 client.15735 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 shutdown_connections 2024-08-31T04:26:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 1 -- 172.21.15.2:0/1092159129 wait complete. 2024-08-31T04:26:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.011+0000 7fb218b04740 20 client.15735 trim_cache size 0 max 16384 2024-08-31T04:26:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.030+0000 7fb218b04740 1 Processor -- start 2024-08-31T04:26:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.030+0000 7fb218b04740 1 -- start start 2024-08-31T04:26:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6b4390 0x5578fba858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fba82b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b5940 con 0x5578fb6b4390 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b3210 con 0x5578fb6d5070 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb218b04740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b1060 con 0x5578fb6ac1b0 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:35576/0 (socket says 172.21.15.2:35576) 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 -- 172.21.15.2:0/477196695 learned_addr learned my addr 172.21.15.2:0/477196695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb210b2c640 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fba82b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6b4390 0x5578fba858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 -- 172.21.15.2:0/477196695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 msgr2=0x5578fba82b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fba82b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 -- 172.21.15.2:0/477196695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6b4390 msgr2=0x5578fba858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6b4390 0x5578fba858f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.031+0000 7fb20bfff640 1 -- 172.21.15.2:0/477196695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fba848e0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.032+0000 7fb20bfff640 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc02a450 tx=0x7fb1fc032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a36179bf1b7ca2fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.032+0000 7fb1f1ffb640 1 -- 172.21.15.2:0/477196695 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc05b070 con 0x5578fb6ac1b0 2024-08-31T04:26:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.032+0000 7fb1f1ffb640 1 -- 172.21.15.2:0/477196695 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc004e60 con 0x5578fb6ac1b0 2024-08-31T04:26:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.032+0000 7fb1f1ffb640 1 -- 172.21.15.2:0/477196695 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc04b070 con 0x5578fb6ac1b0 2024-08-31T04:26:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 -- 172.21.15.2:0/477196695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 msgr2=0x5578fba7dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc02a450 tx=0x7fb1fc032c30 comp rx=0 tx=0).stop 2024-08-31T04:26:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 -- 172.21.15.2:0/477196695 shutdown_connections 2024-08-31T04:26:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6b4390 0x5578fba858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fba82b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 --2- 172.21.15.2:0/477196695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6ac1b0 0x5578fba7dad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 -- 172.21.15.2:0/477196695 >> 172.21.15.2:0/477196695 conn(0x5578fb6c9460 msgr2=0x5578fba7d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 -- 172.21.15.2:0/477196695 shutdown_connections 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.033+0000 7fb218b04740 1 -- 172.21.15.2:0/477196695 wait complete. 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 -- start start 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 Processor -- start 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6b4390 0x5578fba99900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fbb01230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b16d0 con 0x5578fb6ac1b0 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b2b40 con 0x5578fb6d5070 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1b1da0 con 0x5578fb6b4390 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.034+0000 7fb218b04740 10 client.0 _ll_register_callbacks cb 0x7fb2000e9890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55588/0 (socket says 172.21.15.2:55588) 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 -- 172.21.15.2:0/4170945980 learned_addr learned my addr 172.21.15.2:0/4170945980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb210b2c640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fbb01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6b4390 0x5578fba99900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 -- 172.21.15.2:0/4170945980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6b4390 msgr2=0x5578fba99900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6b4390 0x5578fba99900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 -- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 msgr2=0x5578fbb01230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fbb01230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 -- 172.21.15.2:0/4170945980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fbb01870 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb20bfff640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc004d10 tx=0x7fb1fc0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782f40ca6bd21d8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb1eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc04b070 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1fc004e60 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.035+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb1fc005010 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc06d050 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 10 client.15741 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578fbb02b00 con 0x5578fb6ac1b0 2024-08-31T04:26:54.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc004e60 con 0x5578fb6ac1b0 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fb1fc068030 con 0x5578fb6ac1b0 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 10 client.15741 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 20 client.15741 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb668da0 0x5578fbb05250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 4 client.15741 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5578fb9ef020 con 0x5578fb668da0 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.036+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb668da0 0x5578fbb05250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb1eb7fe640 10 client.15741 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb20b7fe640 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb668da0 0x5578fbb05250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de22c786024f1d3 server_cookie=c2c35a5cc3b8cc81 in_seq=0 out_seq=0 2024-08-31T04:26:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb1eb7fe640 1 -- 172.21.15.2:0/4170945980 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5578fb9ef020 con 0x5578fb668da0 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb1eb7fe640 10 client.15741 handle_command_reply: tid=0 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 client.15741 shutdown 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 msgr2=0x5578fba99360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc004d10 tx=0x7fb1fc0058b0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 shutdown_connections 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5578fb668da0 0x5578fbb05250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578fb6d5070 0x5578fbb01230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fb6b4390 0x5578fba99900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 --2- 172.21.15.2:0/4170945980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5578fb6ac1b0 0x5578fba99360 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 >> 172.21.15.2:0/4170945980 conn(0x5578fb6c9460 msgr2=0x5578fba7d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb1eb7fe640 0 client.15741 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.037+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 shutdown_connections 2024-08-31T04:26:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb218b04740 1 -- 172.21.15.2:0/4170945980 wait complete. 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb218b04740 20 client.15741 trim_cache size 0 max 16384 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:26:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:26:54.049 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:26:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 msgr2=0x7fb1f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 0x7fb1f40b71b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb204009fd0 tx=0x7fb204009500 comp rx=0 tx=0).stop 2024-08-31T04:26:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 msgr2=0x7fb20c104550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.038+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9c0 tx=0x7fb20000ee80 comp rx=0 tx=0).stop 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 shutdown_connections 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb1f40b4ca0 0x7fb1f40b71b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c108160 0x7fb20c104550 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb20c108ab0 0x7fb20c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 --2- 172.21.15.2:0/3739474561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb20c102820 0x7fb20c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 >> 172.21.15.2:0/3739474561 conn(0x7fb20c0794e0 msgr2=0x7fb20c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 shutdown_connections 2024-08-31T04:26:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:54.039+0000 7fb21258f640 1 -- 172.21.15.2:0/3739474561 wait complete. 2024-08-31T04:26:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:54 smithi064 ceph-mon[22007]: pgmap v383: 129 pgs: 129 active+clean; 7.9 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 670 KiB/s wr, 84 op/s 2024-08-31T04:26:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:54 smithi132 ceph-mon[22335]: pgmap v383: 129 pgs: 129 active+clean; 7.9 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 670 KiB/s wr, 84 op/s 2024-08-31T04:26:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:54 smithi002 ceph-mon[18656]: pgmap v383: 129 pgs: 129 active+clean; 7.9 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 670 KiB/s wr, 84 op/s 2024-08-31T04:26:54.660 INFO:tasks.workunit.client.0.smithi002.stdout: 1 16584 7.46 MB/sec warmup 14 sec latency 3833.804 ms 2024-08-31T04:26:54.755 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:26:54.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:26:55.014 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 -- 172.21.15.2:0/3621468030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 msgr2=0x7f1bb01049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 --2- 172.21.15.2:0/3621468030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb01049f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ca0 tx=0x7f1ba002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 -- 172.21.15.2:0/3621468030 shutdown_connections 2024-08-31T04:26:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 --2- 172.21.15.2:0/3621468030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb010db90 0x7f1bb01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 --2- 172.21.15.2:0/3621468030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb0105010 0x7f1bb010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 --2- 172.21.15.2:0/3621468030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb01049f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 -- 172.21.15.2:0/3621468030 >> 172.21.15.2:0/3621468030 conn(0x7f1bb00794d0 msgr2=0x7f1bb00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 -- 172.21.15.2:0/3621468030 shutdown_connections 2024-08-31T04:26:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.486+0000 7f1bb5381640 1 -- 172.21.15.2:0/3621468030 wait complete. 2024-08-31T04:26:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 Processor -- start 2024-08-31T04:26:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 -- start start 2024-08-31T04:26:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 0x7f1bb019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb010db90 0x7f1bb01a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.487+0000 7f1bb5381640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0113830 con 0x7f1bb01045e0 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1bb5381640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb01136b0 con 0x7f1bb0105010 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1bb5381640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb01139b0 con 0x7f1bb010db90 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56530/0 (socket says 172.21.15.2:56530) 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 -- 172.21.15.2:0/2300189147 learned_addr learned my addr 172.21.15.2:0/2300189147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1ba7fff640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 0x7f1bb019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baf7fe640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb010db90 0x7f1bb01a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 -- 172.21.15.2:0/2300189147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb010db90 msgr2=0x7f1bb01a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb010db90 0x7f1bb01a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 -- 172.21.15.2:0/2300189147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 msgr2=0x7f1bb019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 0x7f1bb019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 -- 172.21.15.2:0/2300189147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb01a23d0 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1ba7fff640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 0x7f1bb019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1baeffd640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0033040 tx=0x7f1ba00316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.488+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0003b70 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.489+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb01a2660 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.489+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0003d10 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.489+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba002fa80 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.489+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb01a8e20 con 0x7f1bb01045e0 2024-08-31T04:26:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.490+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb01049f0 con 0x7f1bb01045e0 2024-08-31T04:26:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.491+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1ba002fc20 con 0x7f1bb01045e0 2024-08-31T04:26:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.492+0000 7f1bacff9640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 0x7f1b940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.492+0000 7f1ba7fff640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 0x7f1b940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.492+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1ba0106aa0 con 0x7f1bb01045e0 2024-08-31T04:26:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.493+0000 7f1ba7fff640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 0x7f1b940b71b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1bb010f9a0 tx=0x7f1b9c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.497+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ba00cd470 con 0x7f1bb01045e0 2024-08-31T04:26:55.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 18994 7.91 MB/sec warmup 15 sec latency 27.592 ms 2024-08-31T04:26:55.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.728+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bb019d590 con 0x7f1bb01045e0 2024-08-31T04:26:55.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.729+0000 7f1bacff9640 1 -- 172.21.15.2:0/2300189147 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11898 (secure 0 0 0) 0x7f1ba00ccd70 con 0x7f1bb01045e0 2024-08-31T04:26:55.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:26:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-08-31T04:26:43:286328+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:26:42.517875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:26:55.731 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-08-31T04:26:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 msgr2=0x7f1b940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 0x7f1b940b71b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1bb010f9a0 tx=0x7f1b9c005f90 comp rx=0 tx=0).stop 2024-08-31T04:26:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 msgr2=0x7f1bb019c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0033040 tx=0x7f1ba00316f0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 shutdown_connections 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bb010db90 0x7f1bb01a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb0105010 0x7f1bb019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1b940b4ca0 0x7f1b940b71b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 --2- 172.21.15.2:0/2300189147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bb01045e0 0x7f1bb019c460 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 >> 172.21.15.2:0/2300189147 conn(0x7f1bb00794d0 msgr2=0x7f1bb0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 shutdown_connections 2024-08-31T04:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:55.732+0000 7f1bb5381640 1 -- 172.21.15.2:0/2300189147 wait complete. 2024-08-31T04:26:56.387 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:56 smithi002 ceph-mon[18656]: pgmap v384: 129 pgs: 129 active+clean; 8.0 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 80 op/s 2024-08-31T04:26:56.388 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:56 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2300189147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:56.414 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:26:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:56 smithi064 ceph-mon[22007]: pgmap v384: 129 pgs: 129 active+clean; 8.0 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 80 op/s 2024-08-31T04:26:56.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:56 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2300189147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:56 smithi132 ceph-mon[22335]: pgmap v384: 129 pgs: 129 active+clean; 8.0 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 80 op/s 2024-08-31T04:26:56.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:56 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2300189147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:56.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 21131 8.19 MB/sec warmup 16 sec latency 532.493 ms 2024-08-31T04:26:56.668 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 -- 172.21.15.2:0/1003526891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 msgr2=0x7ff394103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/1003526891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff394103d10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff390009900 tx=0x7ff39002a410 comp rx=0 tx=0).stop 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 -- 172.21.15.2:0/1003526891 shutdown_connections 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/1003526891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff3941103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/1003526891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 0x7ff394109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/1003526891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff394103d10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 -- 172.21.15.2:0/1003526891 >> 172.21.15.2:0/1003526891 conn(0x7ff39407b5f0 msgr2=0x7ff39407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 -- 172.21.15.2:0/1003526891 shutdown_connections 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.165+0000 7ff39ba5b640 1 -- 172.21.15.2:0/1003526891 wait complete. 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 Processor -- start 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 -- start start 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 0x7ff3940759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff394075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff394113850 con 0x7ff394103900 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941136d0 con 0x7ff394109b90 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.166+0000 7ff39ba5b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941139d0 con 0x7ff394109240 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56542/0 (socket says 172.21.15.2:56542) 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 -- 172.21.15.2:0/631841973 learned_addr learned my addr 172.21.15.2:0/631841973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff398ff6640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 0x7ff3940759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff399ff8640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff394075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 -- 172.21.15.2:0/631841973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 msgr2=0x7ff3940759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 0x7ff3940759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 -- 172.21.15.2:0/631841973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 msgr2=0x7ff394075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff394075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 -- 172.21.15.2:0/631841973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3941a8450 con 0x7ff394103900 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff399ff8640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff394075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff3997f7640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff390005940 tx=0x7ff3900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff38a7fc640 1 -- 172.21.15.2:0/631841973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39003f030 con 0x7ff394103900 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3941a86e0 con 0x7ff394103900 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff38a7fc640 1 -- 172.21.15.2:0/631841973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff390003cb0 con 0x7ff394103900 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.167+0000 7ff38a7fc640 1 -- 172.21.15.2:0/631841973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390035070 con 0x7ff394103900 2024-08-31T04:26:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.168+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3941a8c10 con 0x7ff394103900 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 Processor -- start 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 -- start start 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f48e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f48ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56497f405680 con 0x56497f0c01b0 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56497f3f4c10 con 0x56497f0e9070 2024-08-31T04:26:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56497f3f8bc0 con 0x56497f0c8390 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff38a7fc640 1 -- 172.21.15.2:0/631841973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff390042030 con 0x7ff394103900 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48044/0 (socket says 172.21.15.2:48044) 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff399ff8640 1 -- 172.21.15.2:0/3296615960 learned_addr learned my addr 172.21.15.2:0/3296615960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff3997f7640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f48e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.171+0000 7ff398ff6640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f48ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 -- 172.21.15.2:0/3296615960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 msgr2=0x56497f48ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f48ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 -- 172.21.15.2:0/3296615960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 msgr2=0x56497f48e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f48e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 -- 172.21.15.2:0/3296615960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497f154650 con 0x56497f0e9070 2024-08-31T04:26:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff3997f7640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f48e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009fb0 tx=0x7ff38c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c78df72fd48a1f69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff37f7fe640 1 -- 172.21.15.2:0/3296615960 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c016070 con 0x56497f0e9070 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff38a7fc640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 0x7ff3800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff37f7fe640 1 -- 172.21.15.2:0/3296615960 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c012bc0 con 0x56497f0e9070 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff37f7fe640 1 -- 172.21.15.2:0/3296615960 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011ba0 con 0x56497f0e9070 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff3997f7640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 0x7ff3800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.172+0000 7ff38a7fc640 1 -- 172.21.15.2:0/631841973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff390106270 con 0x7ff394103900 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3296615960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 msgr2=0x56497f48e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3997f7640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 0x7ff3800b71b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff390103650 tx=0x7ff39002a410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009fb0 tx=0x7ff38c010800 comp rx=0 tx=0).stop 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3296615960 shutdown_connections 2024-08-31T04:26:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f48e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f48ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3296615960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f48e310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3296615960 >> 172.21.15.2:0/3296615960 conn(0x56497f0dd460 msgr2=0x56497f48c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3296615960 shutdown_connections 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3296615960 wait complete. 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.173+0000 7ff3a1fd0740 1 -- start start 2024-08-31T04:26:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 Processor -- start 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c01b0 0x56497f499a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 0x56497f499fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 0x56497f4a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56497f257700 con 0x56497f0e9070 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56497f37b750 con 0x56497f0c8390 2024-08-31T04:26:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56497f49caf0 con 0x56497f0c01b0 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff3a1fd0740 10 client.0 _ll_register_callbacks cb 0x56497f3aae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 0x56497f4a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff398ff6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 0x56497f499fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 0x56497f4a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56562/0 (socket says 172.21.15.2:56562) 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff399ff8640 1 -- 172.21.15.2:0/778424286 learned_addr learned my addr 172.21.15.2:0/778424286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.174+0000 7ff399ff8640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c01b0 0x56497f499a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 -- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c01b0 msgr2=0x56497f499a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c01b0 0x56497f499a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 -- 172.21.15.2:0/778424286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 msgr2=0x56497f4a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 0x56497f4a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 -- 172.21.15.2:0/778424286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497f3b4900 con 0x56497f0c8390 2024-08-31T04:26:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff398ff6640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 0x56497f499fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff39406c500 tx=0x7ff384010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366213be6874eba6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff37cff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38401e060 con 0x56497f0c8390 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff38400fb60 con 0x56497f0c8390 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff38c012bc0 con 0x56497f0c8390 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff384025050 con 0x56497f0c8390 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff3a1fd0740 10 client.25484 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.175+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56497f4a88c0 con 0x56497f0c8390 2024-08-31T04:26:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c012bc0 con 0x56497f0c8390 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff384018370 con 0x56497f0c8390 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 10 client.25484 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 10 client.25484 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 20 client.25484 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f0a79f0 0x56497f4abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 4 client.25484 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56497f4075d0 con 0x56497f0a79f0 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.176+0000 7ff399ff8640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f0a79f0 0x56497f4abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.177+0000 7ff399ff8640 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f0a79f0 0x56497f4abe10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bbdf759fa7d4e98 server_cookie=53451f4870fe8078 in_seq=0 out_seq=0 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.177+0000 7ff37cff9640 10 client.25484 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.177+0000 7ff37cff9640 1 -- 172.21.15.2:0/778424286 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56497f4075d0 con 0x56497f0a79f0 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.177+0000 7ff37cff9640 10 client.25484 handle_command_reply: tid=0 2024-08-31T04:26:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 client.25484 shutdown 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 msgr2=0x56497f499fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 0x56497f499fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff39406c500 tx=0x7ff384010c10 comp rx=0 tx=0).stop 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 shutdown_connections 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f0a79f0 0x56497f4abe10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0e9070 0x56497f4a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c8390 0x56497f499fd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff37cff9640 0 client.25484 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/778424286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c01b0 0x56497f499a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 >> 172.21.15.2:0/778424286 conn(0x56497f0dd460 msgr2=0x56497f4914f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 shutdown_connections 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/778424286 wait complete. 2024-08-31T04:26:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.178+0000 7ff3a1fd0740 20 client.25484 trim_cache size 0 max 16384 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.191+0000 7ff3a1fd0740 1 Processor -- start 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.191+0000 7ff3a1fd0740 1 -- start start 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f4a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f491410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b58f0 con 0x56497f0c01b0 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b31c0 con 0x56497f0e9070 2024-08-31T04:26:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b1010 con 0x56497f0c8390 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56574/0 (socket says 172.21.15.2:56574) 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 -- 172.21.15.2:0/3970684779 learned_addr learned my addr 172.21.15.2:0/3970684779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f491410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff398ff6640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f4a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 -- 172.21.15.2:0/3970684779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 msgr2=0x56497f4a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f4a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 -- 172.21.15.2:0/3970684779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 msgr2=0x56497f491410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f491410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 -- 172.21.15.2:0/3970684779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497f48c5b0 con 0x56497f0c01b0 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff398ff6640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f4a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff399ff8640 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0116b0 tx=0x7ff38c011780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e437e3689196411 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff37effd640 1 -- 172.21.15.2:0/3970684779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c016040 con 0x56497f0c01b0 2024-08-31T04:26:57.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff37effd640 1 -- 172.21.15.2:0/3970684779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c0125f0 con 0x56497f0c01b0 2024-08-31T04:26:57.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.192+0000 7ff37effd640 1 -- 172.21.15.2:0/3970684779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011b60 con 0x56497f0c01b0 2024-08-31T04:26:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3970684779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 msgr2=0x56497f499f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0116b0 tx=0x7ff38c011780 comp rx=0 tx=0).stop 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3970684779 shutdown_connections 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0e9070 0x56497f491410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0c8390 0x56497f4a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/3970684779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c01b0 0x56497f499f50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3970684779 >> 172.21.15.2:0/3970684779 conn(0x56497f0dd460 msgr2=0x56497f499840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3970684779 shutdown_connections 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.193+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/3970684779 wait complete. 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 -- start start 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 Processor -- start 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 0x56497f4a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0e9070 0x56497f49ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b1680 con 0x56497f0c8390 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b2af0 con 0x56497f0c01b0 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941b1d50 con 0x56497f0e9070 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff3a1fd0740 10 client.0 _ll_register_callbacks cb 0x7ff384010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff398ff6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff398ff6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56578/0 (socket says 172.21.15.2:56578) 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.194+0000 7ff398ff6640 1 -- 172.21.15.2:0/2179067342 learned_addr learned my addr 172.21.15.2:0/2179067342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff399ff8640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 0x56497f4a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff399ff8640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0e9070 0x56497f49ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 -- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0e9070 msgr2=0x56497f49ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0e9070 0x56497f49ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 -- 172.21.15.2:0/2179067342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 msgr2=0x56497f4a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 0x56497f4a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 -- 172.21.15.2:0/2179067342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497f49f280 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff399ff8640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 0x56497f4a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff398ff6640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff38400b010 tx=0x7ff38400acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3a0875bb1df470 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff37cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384010e60 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff384018bc0 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff38c0125f0 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff38401e020 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff3a1fd0740 10 client.15765 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.195+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56497f517490 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c0125f0 con 0x56497f0c8390 2024-08-31T04:26:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff3840299a0 con 0x56497f0c8390 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 10 client.15765 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 10 client.15765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 20 client.15765 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f07cda0 0x56497f519c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 4 client.15765 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56497f403070 con 0x56497f07cda0 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.196+0000 7ff399ff8640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f07cda0 0x56497f519c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff399ff8640 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f07cda0 0x56497f519c70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c91794aeb1e9a4b3 server_cookie=d3ca68dccc2ed09e in_seq=0 out_seq=0 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff37cff9640 10 client.15765 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff37cff9640 1 -- 172.21.15.2:0/2179067342 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56497f403070 con 0x56497f07cda0 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff37cff9640 10 client.15765 handle_command_reply: tid=0 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 client.15765 shutdown 2024-08-31T04:26:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 msgr2=0x56497f49e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff38400b010 tx=0x7ff38400acf0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 shutdown_connections 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56497f07cda0 0x56497f519c70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56497f0c8390 0x56497f49e7d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56497f0e9070 0x56497f49ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff37cff9640 0 client.15765 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 --2- 172.21.15.2:0/2179067342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56497f0c01b0 0x56497f4a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 >> 172.21.15.2:0/2179067342 conn(0x56497f0dd460 msgr2=0x56497f491410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 shutdown_connections 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 1 -- 172.21.15.2:0/2179067342 wait complete. 2024-08-31T04:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.197+0000 7ff3a1fd0740 20 client.15765 trim_cache size 0 max 16384 2024-08-31T04:26:57.205 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:26:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 msgr2=0x7ff3800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 0x7ff3800b71b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff390103650 tx=0x7ff39002a410 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 msgr2=0x7ff3940754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff390005940 tx=0x7ff3900042f0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 shutdown_connections 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff394109b90 0x7ff394075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff394109240 0x7ff3940759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3800b4ca0 0x7ff3800b71b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 --2- 172.21.15.2:0/631841973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394103900 0x7ff3940754b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 >> 172.21.15.2:0/631841973 conn(0x7ff39407b5f0 msgr2=0x7ff3941072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 shutdown_connections 2024-08-31T04:26:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:57.198+0000 7ff39ba5b640 1 -- 172.21.15.2:0/631841973 wait complete. 2024-08-31T04:26:57.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 21131 7.71 MB/sec warmup 17 sec latency 1532.592 ms 2024-08-31T04:26:57.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:26:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:58.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:26:58 smithi002 ceph-mon[18656]: pgmap v385: 129 pgs: 129 active+clean; 11 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 847 KiB/s wr, 120 op/s 2024-08-31T04:26:58.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:26:58 smithi064 ceph-mon[22007]: pgmap v385: 129 pgs: 129 active+clean; 11 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 847 KiB/s wr, 120 op/s 2024-08-31T04:26:58.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:26:58 smithi132 ceph-mon[22335]: pgmap v385: 129 pgs: 129 active+clean; 11 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 847 KiB/s wr, 120 op/s 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 -- 172.21.15.2:0/3273042444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190108170 msgr2=0x7f9190108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 --2- 172.21.15.2:0/3273042444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190108170 0x7f9190108580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f918002a410 comp rx=0 tx=0).stop 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 -- 172.21.15.2:0/3273042444 shutdown_connections 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 --2- 172.21.15.2:0/3273042444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190108170 0x7f9190108580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 --2- 172.21.15.2:0/3273042444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 0x7f919010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 --2- 172.21.15.2:0/3273042444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190102830 0x7f9190102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 -- 172.21.15.2:0/3273042444 >> 172.21.15.2:0/3273042444 conn(0x7f91900794f0 msgr2=0x7f9190079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 -- 172.21.15.2:0/3273042444 shutdown_connections 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 -- 172.21.15.2:0/3273042444 wait complete. 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.585+0000 7f9197bba640 1 Processor -- start 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 -- start start 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190108170 0x7f919019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 0x7f919019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91901126f0 con 0x7f9190102830 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9190112570 con 0x7f9190108170 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9197bba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9190112870 con 0x7f9190108ac0 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56608/0 (socket says 172.21.15.2:56608) 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195155640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190108170 0x7f919019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 -- 172.21.15.2:0/311343156 learned_addr learned my addr 172.21.15.2:0/311343156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9196157640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 0x7f919019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 -- 172.21.15.2:0/311343156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 msgr2=0x7f919019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 0x7f919019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 -- 172.21.15.2:0/311343156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190108170 msgr2=0x7f919019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190108170 0x7f919019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.586+0000 7f9195956640 1 -- 172.21.15.2:0/311343156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91901a01a0 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9195956640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d950 tx=0x7f918c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9186ffd640 1 -- 172.21.15.2:0/311343156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c017070 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9186ffd640 1 -- 172.21.15.2:0/311343156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918c009c30 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91901a0490 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9186ffd640 1 -- 172.21.15.2:0/311343156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c00f620 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.587+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91901a6bf0 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 Processor -- start 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f9186ffd640 1 -- 172.21.15.2:0/311343156 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f918c010460 con 0x7f9190102830 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 -- start start 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c92426070 0x561c927cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923fd1b0 0x561c927cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561c92742680 con 0x561c92405390 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561c92731c10 con 0x561c92426070 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f919e12f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561c92735bc0 con 0x561c923fd1b0 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f9195155640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f9195155640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56618/0 (socket says 172.21.15.2:56618) 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.590+0000 7f9195155640 1 -- 172.21.15.2:0/3899612796 learned_addr learned my addr 172.21.15.2:0/3899612796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9196157640 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c92426070 0x561c927cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195956640 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923fd1b0 0x561c927cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 -- 172.21.15.2:0/3899612796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923fd1b0 msgr2=0x561c927cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923fd1b0 0x561c927cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 -- 172.21.15.2:0/3899612796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c92426070 msgr2=0x561c927cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c92426070 0x561c927cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9186ffd640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 0x7f917c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 -- 172.21.15.2:0/3899612796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c92491650 con 0x561c92405390 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9196157640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 0x7f917c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9186ffd640 1 -- 172.21.15.2:0/311343156 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f918c0e5530 con 0x7f9190102830 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f9195155640 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f9180032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c20301a9a16675 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f917bfff640 1 -- 172.21.15.2:0/3899612796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180040070 con 0x561c92405390 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f917bfff640 1 -- 172.21.15.2:0/3899612796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9180032e50 con 0x561c92405390 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.591+0000 7f917bfff640 1 -- 172.21.15.2:0/3899612796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180035040 con 0x561c92405390 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 -- 172.21.15.2:0/3899612796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 msgr2=0x561c927cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f9196157640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 0x7f917c0b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9188005fd0 tx=0x7f9188009580 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f9180032c60 comp rx=0 tx=0).stop 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 -- 172.21.15.2:0/3899612796 shutdown_connections 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927cbd90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923fd1b0 0x561c927cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 --2- 172.21.15.2:0/3899612796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c92426070 0x561c927cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 -- 172.21.15.2:0/3899612796 >> 172.21.15.2:0/3899612796 conn(0x561c9241a460 msgr2=0x561c927c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 -- 172.21.15.2:0/3899612796 shutdown_connections 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.592+0000 7f919e12f740 1 -- 172.21.15.2:0/3899612796 wait complete. 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 -- start start 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 Processor -- start 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927d6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c927d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561c92594700 con 0x561c92426070 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561c926b8750 con 0x561c923fd1b0 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561c927ddea0 con 0x561c92405390 2024-08-31T04:26:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.593+0000 7f919e12f740 10 client.0 _ll_register_callbacks cb 0x561c926e7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9195956640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927d6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9195155640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c927d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56626/0 (socket says 172.21.15.2:56626) 2024-08-31T04:26:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 -- 172.21.15.2:0/1670289637 learned_addr learned my addr 172.21.15.2:0/1670289637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 -- 172.21.15.2:0/1670289637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 msgr2=0x561c927d6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c927d6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 -- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 msgr2=0x561c927d6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927d6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 -- 172.21.15.2:0/1670289637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c926f1900 con 0x561c92426070 2024-08-31T04:26:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9195956640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f9196157640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9188012900 tx=0x7f9188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa51f1272a19662b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f91797fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800ece0 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9180032e50 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.594+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f918801f420 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9188009670 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561c927e9c40 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9180032e50 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f918800f040 con 0x561c92426070 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 10 client.15777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 20 client.15777 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c923e49f0 0x561c927ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 4 client.15777 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c927445d0 con 0x561c923e49f0 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.595+0000 7f9195956640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c923e49f0 0x561c927ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.596+0000 7f91797fa640 10 client.15777 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.596+0000 7f9195956640 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c923e49f0 0x561c927ed1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61307841658db1b9 server_cookie=80d885840aebb59 in_seq=0 out_seq=0 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f91797fa640 1 -- 172.21.15.2:0/1670289637 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c927445d0 con 0x561c923e49f0 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f91797fa640 10 client.15777 handle_command_reply: tid=0 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 client.15777 shutdown 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 msgr2=0x561c927e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9188012900 tx=0x7f9188004a40 comp rx=0 tx=0).stop 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 shutdown_connections 2024-08-31T04:26:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c923e49f0 0x561c927ed1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92426070 0x561c927e7190 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c927d6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f919e12f740 1 --2- 172.21.15.2:0/1670289637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.597+0000 7f91797fa640 0 client.15777 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.598+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 >> 172.21.15.2:0/1670289637 conn(0x561c9241a460 msgr2=0x561c927ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.598+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 shutdown_connections 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.598+0000 7f919e12f740 1 -- 172.21.15.2:0/1670289637 wait complete. 2024-08-31T04:26:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.598+0000 7f919e12f740 20 client.15777 trim_cache size 0 max 16384 2024-08-31T04:26:58.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 Processor -- start 2024-08-31T04:26:58.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 -- start start 2024-08-31T04:26:58.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 0x561c927d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91901b15a0 con 0x561c92405390 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91901aee70 con 0x561c923fd1b0 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f919e12f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f91901accc0 con 0x561c923e49f0 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f9196157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.611+0000 7f9196157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56640/0 (socket says 172.21.15.2:56640) 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 -- 172.21.15.2:0/3845666816 learned_addr learned my addr 172.21.15.2:0/3845666816 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9195155640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9195956640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 0x561c927d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 -- 172.21.15.2:0/3845666816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 msgr2=0x561c927d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 0x561c927d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 -- 172.21.15.2:0/3845666816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 msgr2=0x561c927e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927e7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 -- 172.21.15.2:0/3845666816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c927cd600 con 0x561c92405390 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9195956640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 0x561c927d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f9196157640 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9188012fb0 tx=0x7f9188005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b0134df2c6d87f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f917b7fe640 1 -- 172.21.15.2:0/3845666816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918803a070 con 0x561c92405390 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f917b7fe640 1 -- 172.21.15.2:0/3845666816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918800e720 con 0x561c92405390 2024-08-31T04:26:58.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.612+0000 7f917b7fe640 1 -- 172.21.15.2:0/3845666816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918801f750 con 0x561c92405390 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- 172.21.15.2:0/3845666816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 msgr2=0x561c927e75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9188012fb0 tx=0x7f9188005ac0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- 172.21.15.2:0/3845666816 shutdown_connections 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c92405390 0x561c927e75d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923fd1b0 0x561c927e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 --2- 172.21.15.2:0/3845666816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c923e49f0 0x561c927d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- 172.21.15.2:0/3845666816 >> 172.21.15.2:0/3845666816 conn(0x561c9241a460 msgr2=0x561c927d5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- 172.21.15.2:0/3845666816 shutdown_connections 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- 172.21.15.2:0/3845666816 wait complete. 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.613+0000 7f919e12f740 1 -- start start 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 Processor -- start 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923e49f0 0x561c927df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c92856b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91901ad330 con 0x561c923fd1b0 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91901ae7a0 con 0x561c923e49f0 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f91901ada00 con 0x561c92405390 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f919e12f740 10 client.0 _ll_register_callbacks cb 0x7f9188009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f9195155640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f9195155640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56646/0 (socket says 172.21.15.2:56646) 2024-08-31T04:26:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f9195155640 1 -- 172.21.15.2:0/938244064 learned_addr learned my addr 172.21.15.2:0/938244064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f9195956640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923e49f0 0x561c927df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.614+0000 7f9196157640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c92856b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 -- 172.21.15.2:0/938244064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 msgr2=0x561c92856b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c92856b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 -- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923e49f0 msgr2=0x561c927df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923e49f0 0x561c927df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 -- 172.21.15.2:0/938244064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c927e01c0 con 0x561c923fd1b0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9196157640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c92856b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f9195155640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f91800050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48539c7f31418a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f91797fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180054060 con 0x561c923fd1b0 2024-08-31T04:26:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f91800316a0 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918800e720 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9180035040 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f919e12f740 10 client.15783 fetch_fsmap learned FSMap version 27 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561c92858080 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.615+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918800e720 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f91800039c0 con 0x561c923fd1b0 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 10 client.15783 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 20 client.15783 populate_metadata read hostname 'smithi002' 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c92426070 0x561c9285a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 4 client.15783 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c92740070 con 0x561c92426070 2024-08-31T04:26:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f9195956640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c92426070 0x561c9285a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f9195956640 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c92426070 0x561c9285a400 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd243e67386cd637 server_cookie=d86d3d78f60c1e77 in_seq=0 out_seq=0 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.616+0000 7f91797fa640 10 client.15783 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f91797fa640 1 -- 172.21.15.2:0/938244064 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c92740070 con 0x561c92426070 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f91797fa640 10 client.15783 handle_command_reply: tid=0 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 client.15783 shutdown 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 msgr2=0x561c927df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f91800050e0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 shutdown_connections 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x561c92426070 0x561c9285a400 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c923fd1b0 0x561c927df920 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561c92405390 0x561c92856b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f91797fa640 0 client.15783 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 --2- 172.21.15.2:0/938244064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561c923e49f0 0x561c927df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 >> 172.21.15.2:0/938244064 conn(0x561c9241a460 msgr2=0x561c927cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 shutdown_connections 2024-08-31T04:26:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 1 -- 172.21.15.2:0/938244064 wait complete. 2024-08-31T04:26:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.617+0000 7f919e12f740 20 client.15783 trim_cache size 0 max 16384 2024-08-31T04:26:58.624 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 msgr2=0x7f917c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 0x7f917c0b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9188005fd0 tx=0x7f9188009580 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 msgr2=0x7f919019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d950 tx=0x7f918c00de10 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 shutdown_connections 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9190108ac0 0x7f919019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9190108170 0x7f919019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f917c0b4d20 0x7f917c0b7230 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 --2- 172.21.15.2:0/311343156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9190102830 0x7f919019a230 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 >> 172.21.15.2:0/311343156 conn(0x7f91900794f0 msgr2=0x7f919006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 shutdown_connections 2024-08-31T04:26:58.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:26:58.618+0000 7f9197bba640 1 -- 172.21.15.2:0/311343156 wait complete. 2024-08-31T04:26:58.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 21131 7.28 MB/sec warmup 18 sec latency 2532.617 ms 2024-08-31T04:26:59.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:26:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:59.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 23709 7.51 MB/sec warmup 19 sec latency 2602.641 ms 2024-08-31T04:27:00.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.097+0000 7f4570a17640 1 -- 172.21.15.2:0/1192963807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 msgr2=0x7f456c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.097+0000 7f4570a17640 1 --2- 172.21.15.2:0/1192963807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c102c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f455c009860 tx=0x7f455c02a340 comp rx=0 tx=0).stop 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 -- 172.21.15.2:0/1192963807 shutdown_connections 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 --2- 172.21.15.2:0/1192963807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 --2- 172.21.15.2:0/1192963807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 0x7f456c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 --2- 172.21.15.2:0/1192963807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c102c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 -- 172.21.15.2:0/1192963807 >> 172.21.15.2:0/1192963807 conn(0x7f456c0794d0 msgr2=0x7f456c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 -- 172.21.15.2:0/1192963807 shutdown_connections 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.098+0000 7f4570a17640 1 -- 172.21.15.2:0/1192963807 wait complete. 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 Processor -- start 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 -- start start 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 0x7f456c104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f456c112710 con 0x7f456c108a90 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f456c112590 con 0x7f456c102800 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4570a17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f456c112890 con 0x7f456c108140 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f456a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f456ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f456a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48158/0 (socket says 172.21.15.2:48158) 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f456a59c640 1 -- 172.21.15.2:0/524067179 learned_addr learned my addr 172.21.15.2:0/524067179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.099+0000 7f4569d9b640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 0x7f456c104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 -- 172.21.15.2:0/524067179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 msgr2=0x7f456c104530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 0x7f456c104530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 -- 172.21.15.2:0/524067179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 msgr2=0x7f456c103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 -- 172.21.15.2:0/524067179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c1a84f0 con 0x7f456c108a90 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456a59c640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f456ad9d640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c104a70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f456400efc0 tx=0x7f456400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f455b7fe640 1 -- 172.21.15.2:0/524067179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564003970 con 0x7f456c108a90 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f455b7fe640 1 -- 172.21.15.2:0/524067179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4564004020 con 0x7f456c108a90 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c1a87e0 con 0x7f456c108a90 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f455b7fe640 1 -- 172.21.15.2:0/524067179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456400b940 con 0x7f456c108a90 2024-08-31T04:27:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.100+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c1a8cd0 con 0x7f456c108a90 2024-08-31T04:27:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 Processor -- start 2024-08-31T04:27:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f455b7fe640 1 -- 172.21.15.2:0/524067179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f456401d020 con 0x7f456c108a90 2024-08-31T04:27:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 -- start start 2024-08-31T04:27:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c77d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5623e3bee680 con 0x5623e38a91b0 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5623e3bddc10 con 0x5623e38b1390 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.104+0000 7f4576f8c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5623e3be1bc0 con 0x5623e38d2070 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56672/0 (socket says 172.21.15.2:56672) 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 -- 172.21.15.2:0/356393053 learned_addr learned my addr 172.21.15.2:0/356393053 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f4569d9b640 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c77d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 -- 172.21.15.2:0/356393053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 msgr2=0x5623e3c77310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c77310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 -- 172.21.15.2:0/356393053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 msgr2=0x5623e3c77d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c77d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 -- 172.21.15.2:0/356393053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e393d650 con 0x5623e38a91b0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f455b7fe640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 0x7f45540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f4569d9b640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 0x7f45540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f456a59c640 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f455c0303f0 tx=0x7f455c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2937cdb978a34e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.105+0000 7f455b7fe640 1 -- 172.21.15.2:0/524067179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f45640e5890 con 0x7f456c108a90 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.106+0000 7f4558ff9640 1 -- 172.21.15.2:0/356393053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c041020 con 0x5623e38a91b0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.106+0000 7f4558ff9640 1 -- 172.21.15.2:0/356393053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f455c030dd0 con 0x5623e38a91b0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.106+0000 7f4558ff9640 1 -- 172.21.15.2:0/356393053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c037040 con 0x5623e38a91b0 2024-08-31T04:27:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.106+0000 7f4569d9b640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 0x7f45540b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4560009fd0 tx=0x7f45600046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- 172.21.15.2:0/356393053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 msgr2=0x5623e3c77850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f455c0303f0 tx=0x7f455c005db0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- 172.21.15.2:0/356393053 shutdown_connections 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38a91b0 0x5623e3c77850 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c77d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 --2- 172.21.15.2:0/356393053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c77310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- 172.21.15.2:0/356393053 >> 172.21.15.2:0/356393053 conn(0x5623e38c6460 msgr2=0x5623e3c75200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- 172.21.15.2:0/356393053 shutdown_connections 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- 172.21.15.2:0/356393053 wait complete. 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.107+0000 7f4576f8c740 1 -- start start 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 Processor -- start 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c82fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 0x5623e3c8ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5623e3a40700 con 0x5623e38d2070 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5623e3b64750 con 0x5623e38b1390 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5623e3c85a90 con 0x5623e38a91b0 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c82fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f456ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 0x5623e3c8ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c82fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48164/0 (socket says 172.21.15.2:48164) 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4569d9b640 1 -- 172.21.15.2:0/2376200592 learned_addr learned my addr 172.21.15.2:0/2376200592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f4576f8c740 10 client.0 _ll_register_callbacks cb 0x5623e3b93e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.108+0000 7f456a59c640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 -- 172.21.15.2:0/2376200592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 msgr2=0x5623e3c82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c82a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 -- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 msgr2=0x5623e3c82fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c82fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 -- 172.21.15.2:0/2376200592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e3b9d900 con 0x5623e38d2070 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f456ad9d640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 0x5623e3c8ed80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f45640e2bc0 tx=0x7f45640ac320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c2e5bdede86810 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f4551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45640b4e80 con 0x5623e38d2070 2024-08-31T04:27:00.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f45640041d0 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.109+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f455c030dd0 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f45640a7df0 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 10 client.15795 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623e3c918a0 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f455c030dd0 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f456400b040 con 0x5623e38d2070 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 20 client.15795 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e38909f0 0x5623e3c94ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 4 client.15795 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e3bf05d0 con 0x5623e38909f0 2024-08-31T04:27:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.110+0000 7f456a59c640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e38909f0 0x5623e3c94ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.111+0000 7f4551ffb640 10 client.15795 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:00.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.111+0000 7f456a59c640 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e38909f0 0x5623e3c94ca0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f46aa1133791d0 server_cookie=972d9cb70a635883 in_seq=0 out_seq=0 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4551ffb640 1 -- 172.21.15.2:0/2376200592 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623e3bf05d0 con 0x5623e38909f0 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4551ffb640 10 client.15795 handle_command_reply: tid=0 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 client.15795 shutdown 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 msgr2=0x5623e3c8ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 0x5623e3c8ed80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f45640e2bc0 tx=0x7f45640ac320 comp rx=0 tx=0).stop 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 shutdown_connections 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e38909f0 0x5623e3c94ca0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38d2070 0x5623e3c8ed80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38b1390 0x5623e3c82fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2376200592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 >> 172.21.15.2:0/2376200592 conn(0x5623e38c6460 msgr2=0x5623e3c7a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4551ffb640 0 client.15795 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 shutdown_connections 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 1 -- 172.21.15.2:0/2376200592 wait complete. 2024-08-31T04:27:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.114+0000 7f4576f8c740 20 client.15795 trim_cache size 0 max 16384 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.128+0000 7f4576f8c740 1 Processor -- start 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.128+0000 7f4576f8c740 1 -- start start 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 0x5623e3c7ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c74b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b5900 con 0x5623e38b1390 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b31d0 con 0x5623e38a91b0 2024-08-31T04:27:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4576f8c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b1020 con 0x5623e38d2070 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56688/0 (socket says 172.21.15.2:56688) 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 -- 172.21.15.2:0/2030429660 learned_addr learned my addr 172.21.15.2:0/2030429660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f456a59c640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 0x5623e3c7ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f456ad9d640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c74b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 -- 172.21.15.2:0/2030429660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 msgr2=0x5623e3c74b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c74b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 -- 172.21.15.2:0/2030429660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 msgr2=0x5623e3c7ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 0x5623e3c7ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 -- 172.21.15.2:0/2030429660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e3c7a170 con 0x5623e38b1390 2024-08-31T04:27:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f456a59c640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 0x5623e3c7ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.129+0000 7f4569d9b640 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4560003fe0 tx=0x7f4560016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f45f847985ca9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.130+0000 7f4553fff640 1 -- 172.21.15.2:0/2030429660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560011c80 con 0x5623e38b1390 2024-08-31T04:27:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.130+0000 7f4553fff640 1 -- 172.21.15.2:0/2030429660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4560011e20 con 0x5623e38b1390 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.130+0000 7f4553fff640 1 -- 172.21.15.2:0/2030429660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560004d00 con 0x5623e38b1390 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- 172.21.15.2:0/2030429660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 msgr2=0x5623e3c8ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4560003fe0 tx=0x7f4560016000 comp rx=0 tx=0).stop 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- 172.21.15.2:0/2030429660 shutdown_connections 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c8ec80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38d2070 0x5623e3c74b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- 172.21.15.2:0/2030429660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38a91b0 0x5623e3c7ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- 172.21.15.2:0/2030429660 >> 172.21.15.2:0/2030429660 conn(0x5623e38c6460 msgr2=0x5623e3c7a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- 172.21.15.2:0/2030429660 shutdown_connections 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- 172.21.15.2:0/2030429660 wait complete. 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- start start 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 Processor -- start 2024-08-31T04:27:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c87640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 0x5623e3cf86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b1690 con 0x5623e38b1390 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b2b00 con 0x5623e38d2070 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.131+0000 7f4576f8c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1b1d60 con 0x5623e38a91b0 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4576f8c740 10 client.0 _ll_register_callbacks cb 0x7f45640a7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f456a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c87640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56696/0 (socket says 172.21.15.2:56696) 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 -- 172.21.15.2:0/1991664664 learned_addr learned my addr 172.21.15.2:0/1991664664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f456ad9d640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 0x5623e3cf86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 -- 172.21.15.2:0/1991664664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 msgr2=0x5623e3c87640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c87640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 -- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 msgr2=0x5623e3cf86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 0x5623e3cf86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 -- 172.21.15.2:0/1991664664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e3cf8d10 con 0x5623e38b1390 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f456ad9d640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 0x5623e3cf86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4569d9b640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4560009ed0 tx=0x7f4560005b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d894310c70a7cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.132+0000 7f4551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560011320 con 0x5623e38b1390 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4560004c80 con 0x5623e38b1390 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4560011e20 con 0x5623e38b1390 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4560040050 con 0x5623e38b1390 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4576f8c740 10 client.15801 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623e3d00050 con 0x5623e38b1390 2024-08-31T04:27:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4560011e20 con 0x5623e38b1390 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f4560035800 con 0x5623e38b1390 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.133+0000 7f4576f8c740 10 client.15801 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4576f8c740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4576f8c740 20 client.15801 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e3865da0 0x5623e3d02810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4576f8c740 4 client.15801 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623e3c833e0 con 0x5623e3865da0 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f456a59c640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e3865da0 0x5623e3d02810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f4551ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.134+0000 7f456a59c640 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e3865da0 0x5623e3d02810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=747995fd62e7d37f server_cookie=f683ccf733ffb50b in_seq=0 out_seq=0 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4551ffb640 1 -- 172.21.15.2:0/1991664664 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623e3c833e0 con 0x5623e3865da0 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4551ffb640 10 client.15801 handle_command_reply: tid=0 2024-08-31T04:27:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 client.15801 shutdown 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 msgr2=0x5623e3c87be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4560009ed0 tx=0x7f4560005b30 comp rx=0 tx=0).stop 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 shutdown_connections 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5623e3865da0 0x5623e3d02810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5623e38b1390 0x5623e3c87be0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5623e38d2070 0x5623e3cf86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 --2- 172.21.15.2:0/1991664664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5623e38a91b0 0x5623e3c87640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 >> 172.21.15.2:0/1991664664 conn(0x5623e38c6460 msgr2=0x5623e3c749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4551ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 shutdown_connections 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 1 -- 172.21.15.2:0/1991664664 wait complete. 2024-08-31T04:27:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.135+0000 7f4576f8c740 20 client.15801 trim_cache size 0 max 16384 2024-08-31T04:27:00.149 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 msgr2=0x7f45540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 0x7f45540b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4560009fd0 tx=0x7f45600046c0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 msgr2=0x7f456c104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c104a70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f456400efc0 tx=0x7f456400c800 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 shutdown_connections 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f45540b4ca0 0x7f45540b71b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c108a90 0x7f456c104a70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f456c108140 0x7f456c104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 --2- 172.21.15.2:0/524067179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c102800 0x7f456c103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 >> 172.21.15.2:0/524067179 conn(0x7f456c0794d0 msgr2=0x7f456c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 shutdown_connections 2024-08-31T04:27:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:00.136+0000 7f4570a17640 1 -- 172.21.15.2:0/524067179 wait complete. 2024-08-31T04:27:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:00 smithi064 ceph-mon[22007]: pgmap v386: 129 pgs: 129 active+clean; 12 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 524 KiB/s wr, 70 op/s 2024-08-31T04:27:00.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:00 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:00 smithi132 ceph-mon[22335]: pgmap v386: 129 pgs: 129 active+clean; 12 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 524 KiB/s wr, 70 op/s 2024-08-31T04:27:00.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:00 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:00.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:00 smithi002 ceph-mon[18656]: pgmap v386: 129 pgs: 129 active+clean; 12 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 524 KiB/s wr, 70 op/s 2024-08-31T04:27:00.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:00 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:00.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 25066 7.71 MB/sec warmup 20 sec latency 90.626 ms 2024-08-31T04:27:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:01.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:27:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:27:01.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 27315 7.71 MB/sec warmup 21 sec latency 53.885 ms 2024-08-31T04:27:01.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:01.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:01.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:27:01.921 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:27:01.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:27:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:02.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 29827 8.14 MB/sec warmup 22 sec latency 38.842 ms 2024-08-31T04:27:02.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.659+0000 7f353a85b640 1 -- 172.21.15.2:0/3771885701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534103930 msgr2=0x7f3534103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.659+0000 7f353a85b640 1 --2- 172.21.15.2:0/3771885701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534103930 0x7f3534103d40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3524009900 tx=0x7f352402a410 comp rx=0 tx=0).stop 2024-08-31T04:27:02.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 -- 172.21.15.2:0/3771885701 shutdown_connections 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 --2- 172.21.15.2:0/3771885701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534109bc0 0x7f35341103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 --2- 172.21.15.2:0/3771885701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f3534109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 --2- 172.21.15.2:0/3771885701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534103930 0x7f3534103d40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 -- 172.21.15.2:0/3771885701 >> 172.21.15.2:0/3771885701 conn(0x7f35340ff3a0 msgr2=0x7f35341017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 -- 172.21.15.2:0/3771885701 shutdown_connections 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 -- 172.21.15.2:0/3771885701 wait complete. 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 Processor -- start 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.660+0000 7f353a85b640 1 -- start start 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534103930 0x7f353419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534109bc0 0x7f353419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3534113880 con 0x7f3534109bc0 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3534113700 con 0x7f3534109270 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f353a85b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3534113a00 con 0x7f3534103930 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48200/0 (socket says 172.21.15.2:48200) 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 -- 172.21.15.2:0/113524434 learned_addr learned my addr 172.21.15.2:0/113524434 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f3538df8640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534109bc0 0x7f353419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f3533fff640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534103930 0x7f353419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 -- 172.21.15.2:0/113524434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534103930 msgr2=0x7f353419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534103930 0x7f353419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 -- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534109bc0 msgr2=0x7f353419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534109bc0 0x7f353419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.661+0000 7f35337fe640 1 -- 172.21.15.2:0/113524434 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341a0280 con 0x7f3534109270 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f35337fe640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9f0 tx=0x7f352800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f35317fa640 1 -- 172.21.15.2:0/113524434 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352800ccc0 con 0x7f3534109270 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35341a0570 con 0x7f3534109270 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f35317fa640 1 -- 172.21.15.2:0/113524434 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35280108e0 con 0x7f3534109270 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f35317fa640 1 -- 172.21.15.2:0/113524434 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528018860 con 0x7f3534109270 2024-08-31T04:27:02.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.662+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341a6cd0 con 0x7f3534109270 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 Processor -- start 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 -- start start 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f35317fa640 1 -- 172.21.15.2:0/113524434 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3528010430 con 0x7f3534109270 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ee5401b5f0 con 0x55ee53cff350 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ee5400ab80 con 0x55ee53cde670 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3540dd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ee5400eb30 con 0x55ee53cd6490 2024-08-31T04:27:02.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56714/0 (socket says 172.21.15.2:56714) 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3538df8640 1 -- 172.21.15.2:0/3944878948 learned_addr learned my addr 172.21.15.2:0/3944878948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f35337fe640 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.665+0000 7f3533fff640 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 -- 172.21.15.2:0/3944878948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 msgr2=0x55ee540a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 -- 172.21.15.2:0/3944878948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 msgr2=0x55ee540a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 -- 172.21.15.2:0/3944878948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee53d6a930 con 0x55ee53cff350 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3538df8640 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f352c009f90 tx=0x7f352c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1d5766443c129 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f35317fa640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 0x7f351c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f3533fff640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 0x7f351c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.666+0000 7f35317fa640 1 -- 172.21.15.2:0/113524434 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f35280e5c00 con 0x7f3534109270 2024-08-31T04:27:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.667+0000 7f3533fff640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 0x7f351c0b71b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3524031440 tx=0x7f3524009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.667+0000 7f351a7fc640 1 -- 172.21.15.2:0/3944878948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c011700 con 0x55ee53cff350 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.667+0000 7f351a7fc640 1 -- 172.21.15.2:0/3944878948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f352c011d50 con 0x55ee53cff350 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.667+0000 7f351a7fc640 1 -- 172.21.15.2:0/3944878948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c019d40 con 0x55ee53cff350 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 -- 172.21.15.2:0/3944878948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 msgr2=0x55ee540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f352c009f90 tx=0x7f352c010860 comp rx=0 tx=0).stop 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 -- 172.21.15.2:0/3944878948 shutdown_connections 2024-08-31T04:27:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 --2- 172.21.15.2:0/3944878948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540a5780 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 -- 172.21.15.2:0/3944878948 >> 172.21.15.2:0/3944878948 conn(0x55ee53cf3740 msgr2=0x55ee540a3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 -- 172.21.15.2:0/3944878948 shutdown_connections 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.668+0000 7f3540dd0740 1 -- 172.21.15.2:0/3944878948 wait complete. 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.669+0000 7f3540dd0740 1 -- start start 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.669+0000 7f3540dd0740 1 Processor -- start 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.669+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.669+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.669+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3540dd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ee53e6d890 con 0x55ee53cff350 2024-08-31T04:27:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3540dd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ee53f91790 con 0x55ee53cde670 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3540dd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ee540b3f60 con 0x55ee53cd6490 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3540dd0740 10 client.0 _ll_register_callbacks cb 0x55ee53d16ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56720/0 (socket says 172.21.15.2:56720) 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 -- 172.21.15.2:0/2603362612 learned_addr learned my addr 172.21.15.2:0/2603362612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3533fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f35337fe640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 -- 172.21.15.2:0/2603362612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 msgr2=0x55ee540b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 -- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 msgr2=0x55ee540b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 -- 172.21.15.2:0/2603362612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee53fc8f30 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3538df8640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f352c011010 tx=0x7f352c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c94fdcc417280 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f35137fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c027030 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f352c01f070 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.670+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f352c011d50 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f352c031050 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 10 client.15813 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee540c40e0 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f352c011d50 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f352c003a70 con 0x55ee53cff350 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 10 client.15813 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 20 client.15813 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53cbdcd0 0x55ee540c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 4 client.15813 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5401d540 con 0x55ee53cbdcd0 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.671+0000 7f3533fff640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53cbdcd0 0x55ee540c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.672+0000 7f35137fe640 10 client.15813 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.672+0000 7f3533fff640 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53cbdcd0 0x55ee540c74f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c06b33107a34428 server_cookie=5a39b83d9df85f12 in_seq=0 out_seq=0 2024-08-31T04:27:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f35137fe640 1 -- 172.21.15.2:0/2603362612 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee5401d540 con 0x55ee53cbdcd0 2024-08-31T04:27:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f35137fe640 10 client.15813 handle_command_reply: tid=0 2024-08-31T04:27:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 client.15813 shutdown 2024-08-31T04:27:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 msgr2=0x55ee540bd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f352c011010 tx=0x7f352c009bf0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 shutdown_connections 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53cbdcd0 0x55ee540c74f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540bd250 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2603362612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f35137fe640 0 client.15813 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 >> 172.21.15.2:0/2603362612 conn(0x55ee53cf3740 msgr2=0x55ee540a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 shutdown_connections 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 1 -- 172.21.15.2:0/2603362612 wait complete. 2024-08-31T04:27:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.674+0000 7f3540dd0740 20 client.15813 trim_cache size 0 max 16384 2024-08-31T04:27:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 Processor -- start 2024-08-31T04:27:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 -- start start 2024-08-31T04:27:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cff350 0x55ee540ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35341b1670 con 0x55ee53cde670 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35341aef40 con 0x55ee53cff350 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3540dd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f35341acd90 con 0x55ee53cd6490 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f35337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3533fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3533fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:36732/0 (socket says 172.21.15.2:36732) 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f35337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56724/0 (socket says 172.21.15.2:56724) 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3533fff640 1 -- 172.21.15.2:0/447411011 learned_addr learned my addr 172.21.15.2:0/447411011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.694+0000 7f3538df8640 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cff350 0x55ee540ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 -- 172.21.15.2:0/447411011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 msgr2=0x55ee540a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 -- 172.21.15.2:0/447411011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cff350 msgr2=0x55ee540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cff350 0x55ee540ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 -- 172.21.15.2:0/447411011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee540a85e0 con 0x55ee53cde670 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f35337fe640 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f35280e2f00 tx=0x7f35280096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abea1eacff62228a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f3519ffb640 1 -- 172.21.15.2:0/447411011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280ab6f0 con 0x55ee53cde670 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f3519ffb640 1 -- 172.21.15.2:0/447411011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3528010720 con 0x55ee53cde670 2024-08-31T04:27:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.695+0000 7f3519ffb640 1 -- 172.21.15.2:0/447411011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280a8210 con 0x55ee53cde670 2024-08-31T04:27:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- 172.21.15.2:0/447411011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 msgr2=0x55ee540bd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f35280e2f00 tx=0x7f35280096a0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- 172.21.15.2:0/447411011 shutdown_connections 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cde670 0x55ee540bd150 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cff350 0x55ee540ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 --2- 172.21.15.2:0/447411011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- 172.21.15.2:0/447411011 >> 172.21.15.2:0/447411011 conn(0x55ee53cf3740 msgr2=0x55ee540b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- 172.21.15.2:0/447411011 shutdown_connections 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- 172.21.15.2:0/447411011 wait complete. 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.696+0000 7f3540dd0740 1 -- start start 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 Processor -- start 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35341ad400 con 0x55ee53cff350 2024-08-31T04:27:02.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35341ae870 con 0x55ee53cde670 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f35341adad0 con 0x55ee53cd6490 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3540dd0740 10 client.0 _ll_register_callbacks cb 0x7f35280e9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f35337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3538df8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56732/0 (socket says 172.21.15.2:56732) 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f35337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48222/0 (socket says 172.21.15.2:48222) 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3538df8640 1 -- 172.21.15.2:0/2930574801 learned_addr learned my addr 172.21.15.2:0/2930574801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.697+0000 7f3533fff640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 -- 172.21.15.2:0/2930574801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 msgr2=0x55ee540b9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 -- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 msgr2=0x55ee540b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 -- 172.21.15.2:0/2930574801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee54130c90 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f35337fe640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3533fff640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3538df8640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f352c000f80 tx=0x7f352c011550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ccb50b03d2b63b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f35137fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c027070 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee54018fe0 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f352c0116d0 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f352c0197b0 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3540dd0740 10 client.15819 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.698+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee54131e50 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee54018fe0 con 0x55ee53cff350 2024-08-31T04:27:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f352c019a80 con 0x55ee53cff350 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 10 client.15819 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 20 client.15819 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53c93080 0x55ee54134570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 4 client.15819 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee54016720 con 0x55ee53c93080 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3533fff640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53c93080 0x55ee54134570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f35137fe640 10 client.15819 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.699+0000 7f3533fff640 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53c93080 0x55ee54134570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752dd2a3520a4e34 server_cookie=7ca4f0c8eee63d33 in_seq=0 out_seq=0 2024-08-31T04:27:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.701+0000 7f35137fe640 1 -- 172.21.15.2:0/2930574801 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee54016720 con 0x55ee53c93080 2024-08-31T04:27:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.701+0000 7f35137fe640 10 client.15819 handle_command_reply: tid=0 2024-08-31T04:27:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.701+0000 7f3540dd0740 1 client.15819 shutdown 2024-08-31T04:27:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 msgr2=0x55ee540b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f352c000f80 tx=0x7f352c011550 comp rx=0 tx=0).stop 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 shutdown_connections 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55ee53c93080 0x55ee54134570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee53cff350 0x55ee540b5840 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee53cde670 0x55ee540b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f35137fe640 0 client.15819 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 --2- 172.21.15.2:0/2930574801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee53cd6490 0x55ee540b9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 >> 172.21.15.2:0/2930574801 conn(0x55ee53cf3740 msgr2=0x55ee540b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 shutdown_connections 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 1 -- 172.21.15.2:0/2930574801 wait complete. 2024-08-31T04:27:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.702+0000 7f3540dd0740 20 client.15819 trim_cache size 0 max 16384 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "634fff1a-aaca-4743-94d1-27a415c30abd", 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:27:02.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 msgr2=0x7f351c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 0x7f351c0b71b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3524031440 tx=0x7f3524009560 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 msgr2=0x7f353419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9f0 tx=0x7f352800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 shutdown_connections 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f351c0b4ca0 0x7f351c0b71b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3534109bc0 0x7f353419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3534109270 0x7f353419a8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 --2- 172.21.15.2:0/113524434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3534103930 0x7f353419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 >> 172.21.15.2:0/113524434 conn(0x7f35340ff3a0 msgr2=0x7f35341017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 shutdown_connections 2024-08-31T04:27:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:02.703+0000 7f353a85b640 1 -- 172.21.15.2:0/113524434 wait complete. 2024-08-31T04:27:02.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:02 smithi002 ceph-mon[18656]: pgmap v387: 129 pgs: 129 active+clean; 12 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 568 KiB/s wr, 87 op/s 2024-08-31T04:27:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:02 smithi064 ceph-mon[22007]: pgmap v387: 129 pgs: 129 active+clean; 12 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 568 KiB/s wr, 87 op/s 2024-08-31T04:27:03.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:02 smithi132 ceph-mon[22335]: pgmap v387: 129 pgs: 129 active+clean; 12 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 568 KiB/s wr, 87 op/s 2024-08-31T04:27:03.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:27:03.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 31767 8.19 MB/sec warmup 23 sec latency 394.038 ms 2024-08-31T04:27:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:03.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:27:03.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:03.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:27:03.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:27:03.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:03.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:03 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:03 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:27:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:27:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:27:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:03 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 -- 172.21.15.2:0/3238661720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 msgr2=0x7fd288102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 --2- 172.21.15.2:0/3238661720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd288102c10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd278009860 tx=0x7fd27802a340 comp rx=0 tx=0).stop 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 -- 172.21.15.2:0/3238661720 shutdown_connections 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 --2- 172.21.15.2:0/3238661720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 0x7fd28810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 --2- 172.21.15.2:0/3238661720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 0x7fd288108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 --2- 172.21.15.2:0/3238661720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd288102c10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 -- 172.21.15.2:0/3238661720 >> 172.21.15.2:0/3238661720 conn(0x7fd2880794d0 msgr2=0x7fd2880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 -- 172.21.15.2:0/3238661720 shutdown_connections 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 -- 172.21.15.2:0/3238661720 wait complete. 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.426+0000 7fd28dad3640 1 Processor -- start 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 -- start start 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 0x7fd28819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 0x7fd28819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd288113810 con 0x7fd288102800 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd288113690 con 0x7fd288108a90 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd28dad3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd288113990 con 0x7fd288108140 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56744/0 (socket says 172.21.15.2:56744) 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 -- 172.21.15.2:0/742761709 learned_addr learned my addr 172.21.15.2:0/742761709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd287fff640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 0x7fd28819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd286ffd640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 0x7fd28819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 -- 172.21.15.2:0/742761709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 msgr2=0x7fd28819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 0x7fd28819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 -- 172.21.15.2:0/742761709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 msgr2=0x7fd28819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 0x7fd28819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.427+0000 7fd2877fe640 1 -- 172.21.15.2:0/742761709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2881a0190 con 0x7fd288102800 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd2877fe640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd2780303f0 tx=0x7fd278032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd284ff9640 1 -- 172.21.15.2:0/742761709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278040020 con 0x7fd288102800 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2881a0420 con 0x7fd288102800 2024-08-31T04:27:04.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd284ff9640 1 -- 172.21.15.2:0/742761709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd278030dd0 con 0x7fd288102800 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd284ff9640 1 -- 172.21.15.2:0/742761709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278037040 con 0x7fd288102800 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.428+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2881a6be0 con 0x7fd288102800 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 Processor -- start 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 -- start start 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd284ff9640 1 -- 172.21.15.2:0/742761709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd278043020 con 0x7fd288102800 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606155e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56061555d630 con 0x560615241070 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56061554cbc0 con 0x560615220390 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd294048740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560615550b70 con 0x5606152181b0 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606155e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606155e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56746/0 (socket says 172.21.15.2:56746) 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd287fff640 1 -- 172.21.15.2:0/1492042918 learned_addr learned my addr 172.21.15.2:0/1492042918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.431+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 -- 172.21.15.2:0/1492042918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 msgr2=0x5606155e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 -- 172.21.15.2:0/1492042918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 msgr2=0x5606155e62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606155e62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 -- 172.21.15.2:0/1492042918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606152ac650 con 0x560615220390 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e6d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd28806a840 tx=0x7fd270011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66eea82ae10c0d9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd284ff9640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 0x7fd2740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd27dffb640 1 -- 172.21.15.2:0/1492042918 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270009d70 con 0x560615220390 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd27dffb640 1 -- 172.21.15.2:0/1492042918 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd270005020 con 0x560615220390 2024-08-31T04:27:04.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd27dffb640 1 -- 172.21.15.2:0/1492042918 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270004bc0 con 0x560615220390 2024-08-31T04:27:04.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd287fff640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 0x7fd2740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.432+0000 7fd284ff9640 1 -- 172.21.15.2:0/742761709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd278105820 con 0x7fd288102800 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 -- 172.21.15.2:0/1492042918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 msgr2=0x5606155e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e6d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd28806a840 tx=0x7fd270011810 comp rx=0 tx=0).stop 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd287fff640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 0x7fd2740b71b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd280005c40 tx=0x7fd280010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 -- 172.21.15.2:0/1492042918 shutdown_connections 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e6d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 --2- 172.21.15.2:0/1492042918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606155e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 -- 172.21.15.2:0/1492042918 >> 172.21.15.2:0/1492042918 conn(0x560615235460 msgr2=0x5606155e41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 -- 172.21.15.2:0/1492042918 shutdown_connections 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.433+0000 7fd294048740 1 -- 172.21.15.2:0/1492042918 wait complete. 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 -- start start 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 Processor -- start 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606156020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5606153af700 con 0x560615241070 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5606154d3700 con 0x560615220390 2024-08-31T04:27:04.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5606155f8d40 con 0x5606152181b0 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.434+0000 7fd294048740 10 client.0 _ll_register_callbacks cb 0x560615502dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48264/0 (socket says 172.21.15.2:48264) 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 -- 172.21.15.2:0/1062940609 learned_addr learned my addr 172.21.15.2:0/1062940609 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606156020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 -- 172.21.15.2:0/1062940609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 msgr2=0x5606155f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 -- 172.21.15.2:0/1062940609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 msgr2=0x5606156020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606156020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 -- 172.21.15.2:0/1062940609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061550c8b0 con 0x560615220390 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd287fff640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606156020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd27001b040 tx=0x7fd270009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58d5f9a3ac9a7721 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270029020 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd270005020 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.435+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd270004bd0 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd270034050 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 10 client.25556 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560615604a60 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd270005020 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd270023420 con 0x560615220390 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 10 client.25556 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 10 client.25556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 20 client.25556 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151ff9f0 0x560615607e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 4 client.25556 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56061555f580 con 0x5606151ff9f0 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.436+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151ff9f0 0x560615607e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.437+0000 7fd266ffd640 10 client.25556 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.437+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151ff9f0 0x560615607e80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c13196303a1b10 server_cookie=93fe7395fcb8e43 in_seq=0 out_seq=0 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd266ffd640 1 -- 172.21.15.2:0/1062940609 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56061555f580 con 0x5606151ff9f0 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd266ffd640 10 client.25556 handle_command_reply: tid=0 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 client.25556 shutdown 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 msgr2=0x5606155f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd27001b040 tx=0x7fd270009fa0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 shutdown_connections 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151ff9f0 0x560615607e80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x5606156020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155f62a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 --2- 172.21.15.2:0/1062940609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 >> 172.21.15.2:0/1062940609 conn(0x560615235460 msgr2=0x5606155e7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd266ffd640 0 client.25556 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 shutdown_connections 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 1 -- 172.21.15.2:0/1062940609 wait complete. 2024-08-31T04:27:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.439+0000 7fd294048740 20 client.25556 trim_cache size 0 max 16384 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 Processor -- start 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 -- start start 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881b1460 con 0x560615241070 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881aed30 con 0x560615220390 2024-08-31T04:27:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd294048740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881acb80 con 0x5606152181b0 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56764/0 (socket says 172.21.15.2:56764) 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd287fff640 1 -- 172.21.15.2:0/1630273658 learned_addr learned my addr 172.21.15.2:0/1630273658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.457+0000 7fd286ffd640 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 -- 172.21.15.2:0/1630273658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 msgr2=0x5606155f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 -- 172.21.15.2:0/1630273658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 msgr2=0x5606155e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 -- 172.21.15.2:0/1630273658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606155e7100 con 0x560615241070 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd2877fe640 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd287fff640 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd280004170 tx=0x7fd280016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af8e8c68b1cf5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd27d7fa640 1 -- 172.21.15.2:0/1630273658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280020040 con 0x560615241070 2024-08-31T04:27:04.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd27d7fa640 1 -- 172.21.15.2:0/1630273658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd28000dd80 con 0x560615241070 2024-08-31T04:27:04.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.458+0000 7fd27d7fa640 1 -- 172.21.15.2:0/1630273658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28001a450 con 0x560615241070 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- 172.21.15.2:0/1630273658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 msgr2=0x560615601fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd280004170 tx=0x7fd280016000 comp rx=0 tx=0).stop 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- 172.21.15.2:0/1630273658 shutdown_connections 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615241070 0x560615601fa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615220390 0x5606155e41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 --2- 172.21.15.2:0/1630273658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- 172.21.15.2:0/1630273658 >> 172.21.15.2:0/1630273658 conn(0x560615235460 msgr2=0x5606155e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- 172.21.15.2:0/1630273658 shutdown_connections 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- 172.21.15.2:0/1630273658 wait complete. 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.459+0000 7fd294048740 1 -- start start 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 Processor -- start 2024-08-31T04:27:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615241070 0x5606155f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ad1f0 con 0x560615220390 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ae660 con 0x560615241070 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ad8c0 con 0x5606152181b0 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd294048740 10 client.0 _ll_register_callbacks cb 0x7fd280009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56772/0 (socket says 172.21.15.2:56772) 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 -- 172.21.15.2:0/4195359275 learned_addr learned my addr 172.21.15.2:0/4195359275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd287fff640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615241070 0x5606155f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 -- 172.21.15.2:0/4195359275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 msgr2=0x5606155fe4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155fe4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 -- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615241070 msgr2=0x5606155f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.460+0000 7fd286ffd640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615241070 0x5606155f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd286ffd640 1 -- 172.21.15.2:0/4195359275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606155fa420 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd286ffd640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd2700059f0 tx=0x7fd270011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b1fddbee5b4f8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27003c020 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd270023a30 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28000dd80 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd270047050 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd294048740 10 client.15837 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560615672430 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.461+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd28000dd80 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd270004040 con 0x560615220390 2024-08-31T04:27:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 20 client.15837 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151d4da0 0x560615674b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 4 client.15837 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56061555b020 con 0x5606151d4da0 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd2877fe640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151d4da0 0x560615674b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd2877fe640 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151d4da0 0x560615674b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7917df4c386356e server_cookie=97f92b6aef40b55c in_seq=0 out_seq=0 2024-08-31T04:27:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.462+0000 7fd266ffd640 10 client.15837 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd266ffd640 1 -- 172.21.15.2:0/4195359275 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x56061555b020 con 0x5606151d4da0 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd266ffd640 10 client.15837 handle_command_reply: tid=0 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 client.15837 shutdown 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 msgr2=0x5606155f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd2700059f0 tx=0x7fd270011d10 comp rx=0 tx=0).stop 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 shutdown_connections 2024-08-31T04:27:04.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5606151d4da0 0x560615674b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560615220390 0x5606155f99a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560615241070 0x5606155f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 --2- 172.21.15.2:0/4195359275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5606152181b0 0x5606155fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 >> 172.21.15.2:0/4195359275 conn(0x560615235460 msgr2=0x5606155e72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd266ffd640 0 client.15837 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 shutdown_connections 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.463+0000 7fd294048740 1 -- 172.21.15.2:0/4195359275 wait complete. 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd294048740 20 client.15837 trim_cache size 0 max 16384 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:27:04.469 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "634fff1a-aaca-4743-94d1-27a415c30abd", 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:04.470 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:04.471 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:04.472 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 msgr2=0x7fd2740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 0x7fd2740b71b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd280005c40 tx=0x7fd280010040 comp rx=0 tx=0).stop 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 msgr2=0x7fd28819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd2780303f0 tx=0x7fd278032da0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 shutdown_connections 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd288108a90 0x7fd28819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd288108140 0x7fd28819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd2740b4ca0 0x7fd2740b71b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 --2- 172.21.15.2:0/742761709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd288102800 0x7fd28819a220 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 >> 172.21.15.2:0/742761709 conn(0x7fd2880794d0 msgr2=0x7fd288101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 shutdown_connections 2024-08-31T04:27:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:04.464+0000 7fd28dad3640 1 -- 172.21.15.2:0/742761709 wait complete. 2024-08-31T04:27:04.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 34406 8.34 MB/sec warmup 24 sec latency 461.247 ms 2024-08-31T04:27:05.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:04 smithi002 ceph-mon[18656]: pgmap v388: 129 pgs: 129 active+clean; 15 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 806 KiB/s wr, 118 op/s 2024-08-31T04:27:05.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:04 smithi064 ceph-mon[22007]: pgmap v388: 129 pgs: 129 active+clean; 15 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 806 KiB/s wr, 118 op/s 2024-08-31T04:27:05.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:04 smithi132 ceph-mon[22335]: pgmap v388: 129 pgs: 129 active+clean; 15 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 806 KiB/s wr, 118 op/s 2024-08-31T04:27:05.477 INFO:tasks.cephfs.filesystem:scrub status for tag:634fff1a-aaca-4743-94d1-27a415c30abd - {'path': '/', 'tag': '634fff1a-aaca-4743-94d1-27a415c30abd', 'options': 'recursive,force'} 2024-08-31T04:27:05.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 36687 8.57 MB/sec warmup 25 sec latency 34.177 ms 2024-08-31T04:27:06.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 38856 8.72 MB/sec warmup 26 sec latency 477.298 ms 2024-08-31T04:27:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:06 smithi064 ceph-mon[22007]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-08-31T04:27:07.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:06 smithi132 ceph-mon[22335]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-08-31T04:27:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:06 smithi002 ceph-mon[18656]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-08-31T04:27:07.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 38856 8.39 MB/sec warmup 27 sec latency 1477.377 ms 2024-08-31T04:27:08.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 38856 8.09 MB/sec warmup 28 sec latency 2477.473 ms 2024-08-31T04:27:08.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:08 smithi002 ceph-mon[18656]: pgmap v390: 129 pgs: 129 active+clean; 25 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T04:27:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:08 smithi064 ceph-mon[22007]: pgmap v390: 129 pgs: 129 active+clean; 25 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T04:27:09.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:08 smithi132 ceph-mon[22335]: pgmap v390: 129 pgs: 129 active+clean; 25 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T04:27:09.661 INFO:tasks.workunit.client.0.smithi002.stdout: 1 41259 8.18 MB/sec warmup 29 sec latency 2550.123 ms 2024-08-31T04:27:10.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 43733 8.42 MB/sec warmup 30 sec latency 26.544 ms 2024-08-31T04:27:11.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:10 smithi064 ceph-mon[22007]: pgmap v391: 129 pgs: 129 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T04:27:11.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:10 smithi132 ceph-mon[22335]: pgmap v391: 129 pgs: 129 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T04:27:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:10 smithi002 ceph-mon[18656]: pgmap v391: 129 pgs: 129 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T04:27:11.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 45948 8.54 MB/sec warmup 31 sec latency 486.585 ms 2024-08-31T04:27:12.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 45948 8.28 MB/sec warmup 32 sec latency 1486.677 ms 2024-08-31T04:27:13.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:12 smithi064 ceph-mon[22007]: pgmap v392: 129 pgs: 129 active+clean; 28 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.6 MiB/s wr, 178 op/s 2024-08-31T04:27:13.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:12 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:27:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:12 smithi132 ceph-mon[22335]: pgmap v392: 129 pgs: 129 active+clean; 28 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.6 MiB/s wr, 178 op/s 2024-08-31T04:27:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:12 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:27:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:12 smithi002 ceph-mon[18656]: pgmap v392: 129 pgs: 129 active+clean; 28 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.6 MiB/s wr, 178 op/s 2024-08-31T04:27:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:12 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:27:13.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 45948 8.03 MB/sec warmup 33 sec latency 2486.773 ms 2024-08-31T04:27:14.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:13 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:27:14.069 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:13 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:27:14.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:13 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:27:14.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 48493 8.13 MB/sec warmup 34 sec latency 2571.155 ms 2024-08-31T04:27:15.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:14 smithi064 ceph-mon[22007]: pgmap v393: 129 pgs: 129 active+clean; 39 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-08-31T04:27:15.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:14 smithi132 ceph-mon[22335]: pgmap v393: 129 pgs: 129 active+clean; 39 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-08-31T04:27:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:14 smithi002 ceph-mon[18656]: pgmap v393: 129 pgs: 129 active+clean; 39 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-08-31T04:27:15.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 50844 8.31 MB/sec warmup 35 sec latency 30.898 ms 2024-08-31T04:27:16.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 53833 8.55 MB/sec warmup 36 sec latency 19.654 ms 2024-08-31T04:27:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:16 smithi064 ceph-mon[22007]: pgmap v394: 129 pgs: 129 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-08-31T04:27:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:16 smithi132 ceph-mon[22335]: pgmap v394: 129 pgs: 129 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-08-31T04:27:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:16 smithi002 ceph-mon[18656]: pgmap v394: 129 pgs: 129 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-08-31T04:27:17.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 56586 8.71 MB/sec warmup 37 sec latency 73.116 ms 2024-08-31T04:27:18.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 56586 8.48 MB/sec warmup 38 sec latency 1073.237 ms 2024-08-31T04:27:19.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:18 smithi064 ceph-mon[22007]: pgmap v395: 129 pgs: 129 active+clean; 51 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-08-31T04:27:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:18 smithi132 ceph-mon[22335]: pgmap v395: 129 pgs: 129 active+clean; 51 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-08-31T04:27:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:18 smithi002 ceph-mon[18656]: pgmap v395: 129 pgs: 129 active+clean; 51 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-08-31T04:27:19.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 58389 8.52 MB/sec warmup 39 sec latency 1144.387 ms 2024-08-31T04:27:20.662 INFO:tasks.workunit.client.0.smithi002.stdout: 1 61109 8.66 MB/sec warmup 40 sec latency 24.925 ms 2024-08-31T04:27:21.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:20 smithi064 ceph-mon[22007]: pgmap v396: 129 pgs: 129 active+clean; 52 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.7 MiB/s wr, 146 op/s 2024-08-31T04:27:21.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:20 smithi132 ceph-mon[22335]: pgmap v396: 129 pgs: 129 active+clean; 52 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.7 MiB/s wr, 146 op/s 2024-08-31T04:27:21.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:20 smithi002 ceph-mon[18656]: pgmap v396: 129 pgs: 129 active+clean; 52 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.7 MiB/s wr, 146 op/s 2024-08-31T04:27:21.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 63677 8.79 MB/sec warmup 41 sec latency 289.024 ms 2024-08-31T04:27:22.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 63677 8.58 MB/sec warmup 42 sec latency 1289.157 ms 2024-08-31T04:27:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:22 smithi064 ceph-mon[22007]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 161 op/s 2024-08-31T04:27:23.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:22 smithi132 ceph-mon[22335]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 161 op/s 2024-08-31T04:27:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:22 smithi002 ceph-mon[18656]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 161 op/s 2024-08-31T04:27:23.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 63677 8.38 MB/sec warmup 43 sec latency 2289.259 ms 2024-08-31T04:27:24.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 65459 8.42 MB/sec warmup 44 sec latency 2363.103 ms 2024-08-31T04:27:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:24 smithi064 ceph-mon[22007]: pgmap v398: 129 pgs: 129 active+clean; 53 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-08-31T04:27:25.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:24 smithi132 ceph-mon[22335]: pgmap v398: 129 pgs: 129 active+clean; 53 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-08-31T04:27:25.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:24 smithi002 ceph-mon[18656]: pgmap v398: 129 pgs: 129 active+clean; 53 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-08-31T04:27:25.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 68172 8.55 MB/sec warmup 45 sec latency 25.139 ms 2024-08-31T04:27:26.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 71264 8.76 MB/sec warmup 46 sec latency 12.373 ms 2024-08-31T04:27:27.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:26 smithi064 ceph-mon[22007]: pgmap v399: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 185 op/s 2024-08-31T04:27:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:26 smithi132 ceph-mon[22335]: pgmap v399: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 185 op/s 2024-08-31T04:27:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:26 smithi002 ceph-mon[18656]: pgmap v399: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 185 op/s 2024-08-31T04:27:27.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 73927 8.85 MB/sec warmup 47 sec latency 32.718 ms 2024-08-31T04:27:28.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 74345 8.71 MB/sec warmup 48 sec latency 898.940 ms 2024-08-31T04:27:29.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:28 smithi064 ceph-mon[22007]: pgmap v400: 129 pgs: 129 active+clean; 56 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-08-31T04:27:29.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:28 smithi132 ceph-mon[22335]: pgmap v400: 129 pgs: 129 active+clean; 56 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-08-31T04:27:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:28 smithi002 ceph-mon[18656]: pgmap v400: 129 pgs: 129 active+clean; 56 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-08-31T04:27:29.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 76247 8.73 MB/sec warmup 49 sec latency 965.403 ms 2024-08-31T04:27:30.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 78894 8.84 MB/sec warmup 50 sec latency 25.399 ms 2024-08-31T04:27:31.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:30 smithi064 ceph-mon[22007]: pgmap v401: 129 pgs: 129 active+clean; 60 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 166 op/s 2024-08-31T04:27:31.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:30 smithi132 ceph-mon[22335]: pgmap v401: 129 pgs: 129 active+clean; 60 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 166 op/s 2024-08-31T04:27:31.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:30 smithi002 ceph-mon[18656]: pgmap v401: 129 pgs: 129 active+clean; 60 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 166 op/s 2024-08-31T04:27:31.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 81435 8.94 MB/sec warmup 51 sec latency 334.417 ms 2024-08-31T04:27:32.663 INFO:tasks.workunit.client.0.smithi002.stdout: 1 81435 8.77 MB/sec warmup 52 sec latency 1334.517 ms 2024-08-31T04:27:33.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:32 smithi064 ceph-mon[22007]: pgmap v402: 129 pgs: 129 active+clean; 62 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-31T04:27:33.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:32 smithi132 ceph-mon[22335]: pgmap v402: 129 pgs: 129 active+clean; 62 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-31T04:27:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:32 smithi002 ceph-mon[18656]: pgmap v402: 129 pgs: 129 active+clean; 62 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-31T04:27:33.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 81435 8.61 MB/sec warmup 53 sec latency 2334.601 ms 2024-08-31T04:27:34.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 83303 8.63 MB/sec warmup 54 sec latency 2409.674 ms 2024-08-31T04:27:35.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:34 smithi064 ceph-mon[22007]: pgmap v403: 129 pgs: 129 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2024-08-31T04:27:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:34 smithi132 ceph-mon[22335]: pgmap v403: 129 pgs: 129 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2024-08-31T04:27:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:34 smithi002 ceph-mon[18656]: pgmap v403: 129 pgs: 129 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2024-08-31T04:27:35.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:27:35.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 84984 8.64 MB/sec warmup 55 sec latency 602.648 ms 2024-08-31T04:27:35.739 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:36.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 -- 172.21.15.2:0/3261403091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4109bb0 msgr2=0x7f75a41103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/3261403091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4109bb0 0x7f75a41103e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f759c009ca0 tx=0x7f759c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 -- 172.21.15.2:0/3261403091 shutdown_connections 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/3261403091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4109bb0 0x7f75a41103e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/3261403091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 0x7f75a4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/3261403091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4103920 0x7f75a4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.266+0000 7f75aa8a3640 1 -- 172.21.15.2:0/3261403091 >> 172.21.15.2:0/3261403091 conn(0x7f75a40ff3b0 msgr2=0x7f75a4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.267+0000 7f75aa8a3640 1 -- 172.21.15.2:0/3261403091 shutdown_connections 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.267+0000 7f75aa8a3640 1 -- 172.21.15.2:0/3261403091 wait complete. 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.267+0000 7f75aa8a3640 1 Processor -- start 2024-08-31T04:27:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.267+0000 7f75aa8a3640 1 -- start start 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 0x7f75a419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4109bb0 0x7f75a419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4113870 con 0x7f75a4103920 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41136f0 con 0x7f75a4109260 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75aa8a3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41139f0 con 0x7f75a4109bb0 2024-08-31T04:27:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36074/0 (socket says 172.21.15.2:36074) 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 -- 172.21.15.2:0/2470054761 learned_addr learned my addr 172.21.15.2:0/2470054761 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a8e40640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4109bb0 0x7f75a419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a37fe640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 0x7f75a419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 -- 172.21.15.2:0/2470054761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4109bb0 msgr2=0x7f75a419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4109bb0 0x7f75a419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 -- 172.21.15.2:0/2470054761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 msgr2=0x7f75a419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 0x7f75a419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 -- 172.21.15.2:0/2470054761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a41a0190 con 0x7f75a4103920 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.268+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f759400d770 tx=0x7f759400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.269+0000 7f75a17fa640 1 -- 172.21.15.2:0/2470054761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594017070 con 0x7f75a4103920 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.269+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a41a0480 con 0x7f75a4103920 2024-08-31T04:27:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.269+0000 7f75a17fa640 1 -- 172.21.15.2:0/2470054761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75940054d0 con 0x7f75a4103920 2024-08-31T04:27:36.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.269+0000 7f75a17fa640 1 -- 172.21.15.2:0/2470054761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594004c30 con 0x7f75a4103920 2024-08-31T04:27:36.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.269+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41a6be0 con 0x7f75a4103920 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.271+0000 7f75a17fa640 1 -- 172.21.15.2:0/2470054761 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7594004e10 con 0x7f75a4103920 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 Processor -- start 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 -- start start 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0584800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0584d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628d04fb630 con 0x5628d01df070 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5628d04eabc0 con 0x5628d01b61b0 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75b0e18740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628d04eeb70 con 0x5628d01be390 2024-08-31T04:27:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36090/0 (socket says 172.21.15.2:36090) 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75a8e40640 1 -- 172.21.15.2:0/2352859750 learned_addr learned my addr 172.21.15.2:0/2352859750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0584800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.272+0000 7f75a37fe640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0584d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 -- 172.21.15.2:0/2352859750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 msgr2=0x5628d0584d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0584d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 -- 172.21.15.2:0/2352859750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 msgr2=0x5628d0584800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0584800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 -- 172.21.15.2:0/2352859750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d024a650 con 0x5628d01df070 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a37fe640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0584d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a17fa640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 0x7f758c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 0x7f758c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a8e40640 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f759c02f4c0 tx=0x7f759c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4859cd595e0b3789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f75a17fa640 1 -- 172.21.15.2:0/2470054761 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f75940e53d0 con 0x7f75a4103920 2024-08-31T04:27:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f758a7fc640 1 -- 172.21.15.2:0/2352859750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c031cf0 con 0x5628d01df070 2024-08-31T04:27:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f758a7fc640 1 -- 172.21.15.2:0/2352859750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c036030 con 0x5628d01df070 2024-08-31T04:27:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.273+0000 7f758a7fc640 1 -- 172.21.15.2:0/2352859750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0042a0 con 0x5628d01df070 2024-08-31T04:27:36.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 -- 172.21.15.2:0/2352859750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 msgr2=0x5628d05842c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75a3fff640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 0x7f758c0b71b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75940e27b0 tx=0x7f75940ea040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f759c02f4c0 tx=0x7f759c009800 comp rx=0 tx=0).stop 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 -- 172.21.15.2:0/2352859750 shutdown_connections 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0584d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0584800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 --2- 172.21.15.2:0/2352859750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d05842c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 -- 172.21.15.2:0/2352859750 >> 172.21.15.2:0/2352859750 conn(0x5628d01d3460 msgr2=0x5628d05821b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 -- 172.21.15.2:0/2352859750 shutdown_connections 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.274+0000 7f75b0e18740 1 -- 172.21.15.2:0/2352859750 wait complete. 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 -- start start 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 Processor -- start 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0590010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01df070 0x5628d059fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628d034d700 con 0x5628d01b61b0 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5628d0471700 con 0x5628d01df070 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628d0596cd0 con 0x5628d01be390 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75b0e18740 10 client.0 _ll_register_callbacks cb 0x5628d04a0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36102/0 (socket says 172.21.15.2:36102) 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75a8e40640 1 -- 172.21.15.2:0/73612649 learned_addr learned my addr 172.21.15.2:0/73612649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.275+0000 7f75a8e40640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01df070 0x5628d059fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a37fe640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0590010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 -- 172.21.15.2:0/73612649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 msgr2=0x5628d0590010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0590010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 -- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01df070 msgr2=0x5628d059fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01df070 0x5628d059fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 -- 172.21.15.2:0/73612649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d04aa8b0 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a37fe640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0590010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75a8e40640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f759c003e70 tx=0x7f759c003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530171e0bbb269c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75837fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c058060 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f759c02f660 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759c036030 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f759c05f050 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75b0e18740 10 client.15849 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.276+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628d05a2b00 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c036030 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f759c043070 con 0x5628d01b61b0 2024-08-31T04:27:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 10 client.15849 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 20 client.15849 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d019d9f0 0x5628d05a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 4 client.15849 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628d04fd580 con 0x5628d019d9f0 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.277+0000 7f75a37fe640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d019d9f0 0x5628d05a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.278+0000 7f75a37fe640 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d019d9f0 0x5628d05a5e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643346d234119dba server_cookie=6a3682af98a34a6c in_seq=0 out_seq=0 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.278+0000 7f75837fe640 10 client.15849 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.278+0000 7f75837fe640 1 -- 172.21.15.2:0/73612649 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628d04fd580 con 0x5628d019d9f0 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.278+0000 7f75837fe640 10 client.15849 handle_command_reply: tid=0 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.278+0000 7f75b0e18740 1 client.15849 shutdown 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 msgr2=0x5628d058fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f759c003e70 tx=0x7f759c003d70 comp rx=0 tx=0).stop 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 shutdown_connections 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d019d9f0 0x5628d05a5e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01df070 0x5628d059fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d0590010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 --2- 172.21.15.2:0/73612649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d058fad0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 >> 172.21.15.2:0/73612649 conn(0x5628d01d3460 msgr2=0x5628d05874a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75837fe640 0 client.15849 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 shutdown_connections 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 1 -- 172.21.15.2:0/73612649 wait complete. 2024-08-31T04:27:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.279+0000 7f75b0e18740 20 client.15849 trim_cache size 0 max 16384 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 Processor -- start 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 -- start start 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0587ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d058ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.298+0000 7f75b0e18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41b13c0 con 0x5628d01df070 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75b0e18740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41aec90 con 0x5628d01b61b0 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75b0e18740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41acae0 con 0x5628d01be390 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36108/0 (socket says 172.21.15.2:36108) 2024-08-31T04:27:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d058ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 -- 172.21.15.2:0/1785939661 learned_addr learned my addr 172.21.15.2:0/1785939661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0587ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 -- 172.21.15.2:0/1785939661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 msgr2=0x5628d058ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d058ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 -- 172.21.15.2:0/1785939661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 msgr2=0x5628d0587ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0587ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 -- 172.21.15.2:0/1785939661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d05a61d0 con 0x5628d01df070 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f75a8e40640 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f759c003e40 tx=0x7f759c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19b947f3438eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f7589ffb640 1 -- 172.21.15.2:0/1785939661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c058040 con 0x5628d01df070 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.299+0000 7f7589ffb640 1 -- 172.21.15.2:0/1785939661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c036040 con 0x5628d01df070 2024-08-31T04:27:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f7589ffb640 1 -- 172.21.15.2:0/1785939661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c031760 con 0x5628d01df070 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 -- 172.21.15.2:0/1785939661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 msgr2=0x5628d058d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f759c003e40 tx=0x7f759c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 -- 172.21.15.2:0/1785939661 shutdown_connections 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01df070 0x5628d058d200 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01be390 0x5628d058ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 --2- 172.21.15.2:0/1785939661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01b61b0 0x5628d0587ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 -- 172.21.15.2:0/1785939661 >> 172.21.15.2:0/1785939661 conn(0x5628d01d3460 msgr2=0x5628d05873c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 -- 172.21.15.2:0/1785939661 shutdown_connections 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.300+0000 7f75b0e18740 1 -- 172.21.15.2:0/1785939661 wait complete. 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.301+0000 7f75b0e18740 1 -- start start 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.301+0000 7f75b0e18740 1 Processor -- start 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.301+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 0x5628d0598f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01df070 0x5628d0609720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ad150 con 0x5628d01b61b0 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ae5c0 con 0x5628d01be390 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ad820 con 0x5628d01df070 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 10 client.0 _ll_register_callbacks cb 0x7f75940e8de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36124/0 (socket says 172.21.15.2:36124) 2024-08-31T04:27:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 -- 172.21.15.2:0/890647790 learned_addr learned my addr 172.21.15.2:0/890647790 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a37fe640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 0x5628d0598f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 -- 172.21.15.2:0/890647790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01df070 msgr2=0x5628d0609720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01df070 0x5628d0609720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 -- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 msgr2=0x5628d0598f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 0x5628d0598f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 -- 172.21.15.2:0/890647790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d0609d90 con 0x5628d01b61b0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a37fe640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 0x5628d0598f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75a8e40640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f759c006010 tx=0x7f759c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ea53a5aa8c419b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75837fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c058070 con 0x5628d01b61b0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f759c02f660 con 0x5628d01b61b0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.302+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759c036040 con 0x5628d01b61b0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f759c076050 con 0x5628d01b61b0 2024-08-31T04:27:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 10 client.15855 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628d06110e0 con 0x5628d01b61b0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c036040 con 0x5628d01b61b0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f759c043070 con 0x5628d01b61b0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 10 client.15855 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 20 client.15855 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d0172da0 0x5628d06137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 4 client.15855 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628d04f9020 con 0x5628d0172da0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.303+0000 7f75a37fe640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d0172da0 0x5628d06137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75837fe640 10 client.15855 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75a37fe640 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d0172da0 0x5628d06137b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35d1b0d3dc1a53c9 server_cookie=2583ac433936be25 in_seq=0 out_seq=0 2024-08-31T04:27:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75837fe640 1 -- 172.21.15.2:0/890647790 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x5628d04f9020 con 0x5628d0172da0 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75837fe640 10 client.15855 handle_command_reply: tid=0 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 client.15855 shutdown 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 msgr2=0x5628d0598980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f759c006010 tx=0x7f759c009b20 comp rx=0 tx=0).stop 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 shutdown_connections 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5628d0172da0 0x5628d06137b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628d01df070 0x5628d0609720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5628d01be390 0x5628d0598f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 --2- 172.21.15.2:0/890647790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628d01b61b0 0x5628d0598980 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 >> 172.21.15.2:0/890647790 conn(0x5628d01d3460 msgr2=0x5628d0585280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75837fe640 0 client.15855 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 shutdown_connections 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.304+0000 7f75b0e18740 1 -- 172.21.15.2:0/890647790 wait complete. 2024-08-31T04:27:36.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75b0e18740 20 client.15855 trim_cache size 0 max 16384 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:36.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:27:36.313 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:36.314 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 msgr2=0x7f758c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 0x7f758c0b71b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75940e27b0 tx=0x7f75940ea040 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 msgr2=0x7f75a419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f759400d770 tx=0x7f759400dc30 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 shutdown_connections 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a4109bb0 0x7f75a419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75a4109260 0x7f75a419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f758c0b4ca0 0x7f758c0b71b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 --2- 172.21.15.2:0/2470054761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a4103920 0x7f75a419a220 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 >> 172.21.15.2:0/2470054761 conn(0x7f75a40ff3b0 msgr2=0x7f75a41088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:36.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 shutdown_connections 2024-08-31T04:27:36.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:36.305+0000 7f75aa8a3640 1 -- 172.21.15.2:0/2470054761 wait complete. 2024-08-31T04:27:36.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 84984 8.49 MB/sec warmup 56 sec latency 1602.676 ms 2024-08-31T04:27:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:36 smithi002 ceph-mon[18656]: pgmap v404: 129 pgs: 129 active+clean; 63 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 189 op/s 2024-08-31T04:27:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:36 smithi064 ceph-mon[22007]: pgmap v404: 129 pgs: 129 active+clean; 63 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 189 op/s 2024-08-31T04:27:37.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:36 smithi132 ceph-mon[22335]: pgmap v404: 129 pgs: 129 active+clean; 63 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 189 op/s 2024-08-31T04:27:37.118 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:27:37.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:27:37.405 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:37.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 84984 8.34 MB/sec warmup 57 sec latency 2602.732 ms 2024-08-31T04:27:37.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 -- 172.21.15.2:0/4028414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0108a90 msgr2=0x7fe7c010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 --2- 172.21.15.2:0/4028414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0108a90 0x7fe7c010f2c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009ca0 tx=0x7fe7b802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 -- 172.21.15.2:0/4028414094 shutdown_connections 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 --2- 172.21.15.2:0/4028414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0108a90 0x7fe7c010f2c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 --2- 172.21.15.2:0/4028414094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108140 0x7fe7c0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 --2- 172.21.15.2:0/4028414094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0102800 0x7fe7c0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 -- 172.21.15.2:0/4028414094 >> 172.21.15.2:0/4028414094 conn(0x7fe7c00794d0 msgr2=0x7fe7c00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 -- 172.21.15.2:0/4028414094 shutdown_connections 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.884+0000 7fe7c6457640 1 -- 172.21.15.2:0/4028414094 wait complete. 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 Processor -- start 2024-08-31T04:27:37.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 -- start start 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0108140 0x7fe7c019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 0x7fe7c019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0113810 con 0x7fe7c0102800 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0113690 con 0x7fe7c0108a90 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.885+0000 7fe7c6457640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0113990 con 0x7fe7c0108140 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36140/0 (socket says 172.21.15.2:36140) 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 -- 172.21.15.2:0/2453812773 learned_addr learned my addr 172.21.15.2:0/2453812773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7b7fff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0108140 0x7fe7c019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7c49f4640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 0x7fe7c019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:37.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 -- 172.21.15.2:0/2453812773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0108140 msgr2=0x7fe7c019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0108140 0x7fe7c019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 -- 172.21.15.2:0/2453812773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 msgr2=0x7fe7c019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 0x7fe7c019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 -- 172.21.15.2:0/2453812773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c01a0190 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7c49f4640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 0x7fe7c019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bffff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e9f0 tx=0x7fe7b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000cd80 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b00054d0 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c01a0480 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0010690 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.886+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01a6be0 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.888+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c0102c10 con 0x7fe7c0102800 2024-08-31T04:27:37.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.889+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe7b0004e50 con 0x7fe7c0102800 2024-08-31T04:27:37.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.890+0000 7fe7bdffb640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 0x7fe7ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:37.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.890+0000 7fe7b7fff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 0x7fe7ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:37.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.890+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe7b00e5f90 con 0x7fe7c0102800 2024-08-31T04:27:37.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.891+0000 7fe7b7fff640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 0x7fe7ac0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80095f0 tx=0x7fe7a8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:37.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:37.894+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe7b0056130 con 0x7fe7c0102800 2024-08-31T04:27:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.118+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c019b350 con 0x7fe7c0102800 2024-08-31T04:27:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.119+0000 7fe7bdffb640 1 -- 172.21.15.2:0/2453812773 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11898 (secure 0 0 0) 0x7fe7b00ac940 con 0x7fe7c0102800 2024-08-31T04:27:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:27:38.121 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-08-31T04:26:43:286328+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:26:42.517875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:27:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-08-31T04:27:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 msgr2=0x7fe7ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 0x7fe7ac0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80095f0 tx=0x7fe7a8005f90 comp rx=0 tx=0).stop 2024-08-31T04:27:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 msgr2=0x7fe7c019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e9f0 tx=0x7fe7b000edf0 comp rx=0 tx=0).stop 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 shutdown_connections 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7c0108a90 0x7fe7c019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0108140 0x7fe7c019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe7ac0b4d20 0x7fe7ac0b7230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 --2- 172.21.15.2:0/2453812773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0102800 0x7fe7c019a220 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 >> 172.21.15.2:0/2453812773 conn(0x7fe7c00794d0 msgr2=0x7fe7c0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 shutdown_connections 2024-08-31T04:27:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:38.122+0000 7fe7c6457640 1 -- 172.21.15.2:0/2453812773 wait complete. 2024-08-31T04:27:38.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 84984 8.19 MB/sec warmup 58 sec latency 3602.764 ms 2024-08-31T04:27:38.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:38 smithi002 ceph-mon[18656]: pgmap v405: 129 pgs: 129 active+clean; 63 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-08-31T04:27:38.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2453812773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:38.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:27:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:38 smithi064 ceph-mon[22007]: pgmap v405: 129 pgs: 129 active+clean; 63 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-08-31T04:27:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2453812773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:38 smithi132 ceph-mon[22335]: pgmap v405: 129 pgs: 129 active+clean; 63 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-08-31T04:27:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2453812773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:39.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 86761 8.22 MB/sec warmup 59 sec latency 3678.437 ms 2024-08-31T04:27:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 -- 172.21.15.2:0/3464746817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e98105010 msgr2=0x7f7e9810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3464746817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e98105010 0x7f7e9810d650 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009900 tx=0x7f7e8802a410 comp rx=0 tx=0).stop 2024-08-31T04:27:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 -- 172.21.15.2:0/3464746817 shutdown_connections 2024-08-31T04:27:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3464746817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e98105010 0x7f7e9810d650 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3464746817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 0x7f7e981100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3464746817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e981045e0 0x7f7e981049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 -- 172.21.15.2:0/3464746817 >> 172.21.15.2:0/3464746817 conn(0x7f7e980794d0 msgr2=0x7f7e980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 -- 172.21.15.2:0/3464746817 shutdown_connections 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.760+0000 7f7ea029c640 1 -- 172.21.15.2:0/3464746817 wait complete. 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 Processor -- start 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 -- start start 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e98105010 0x7f7e9819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 0x7f7e9819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981137f0 con 0x7f7e981045e0 2024-08-31T04:27:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98113670 con 0x7f7e9810db90 2024-08-31T04:27:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.761+0000 7f7ea029c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98113970 con 0x7f7e98105010 2024-08-31T04:27:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36160/0 (socket says 172.21.15.2:36160) 2024-08-31T04:27:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 -- 172.21.15.2:0/3686552669 learned_addr learned my addr 172.21.15.2:0/3686552669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9d837640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e98105010 0x7f7e9819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 0x7f7e9819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 -- 172.21.15.2:0/3686552669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e98105010 msgr2=0x7f7e9819a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e98105010 0x7f7e9819a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 -- 172.21.15.2:0/3686552669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 msgr2=0x7f7e9819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 0x7f7e9819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 -- 172.21.15.2:0/3686552669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e981a0250 con 0x7f7e981045e0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400e9c0 tx=0x7f7e9400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e8f7fe640 1 -- 172.21.15.2:0/3686552669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400ccc0 con 0x7f7e981045e0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e8f7fe640 1 -- 172.21.15.2:0/3686552669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e940035f0 con 0x7f7e981045e0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e981a0540 con 0x7f7e981045e0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7e8f7fe640 1 -- 172.21.15.2:0/3686552669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400ce60 con 0x7f7e981045e0 2024-08-31T04:27:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.762+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981a6ca0 con 0x7f7e981045e0 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.766+0000 7f7e8f7fe640 1 -- 172.21.15.2:0/3686552669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7e94004000 con 0x7f7e981045e0 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.766+0000 7f7ea6811740 1 Processor -- start 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.766+0000 7f7ea6811740 1 -- start start 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468cf070 0x565146c74310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 0x565146c74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565146beb680 con 0x5651468ae390 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x565146bdac10 con 0x5651468a61b0 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7ea6811740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x565146bdebc0 con 0x5651468cf070 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9e038640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 0x565146c74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36170/0 (socket says 172.21.15.2:36170) 2024-08-31T04:27:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 -- 172.21.15.2:0/1636034215 learned_addr learned my addr 172.21.15.2:0/1636034215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e8f7fe640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 0x7f7e840b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9e839640 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468cf070 0x565146c74310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 0x7f7e840b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 -- 172.21.15.2:0/1636034215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468cf070 msgr2=0x565146c74310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468cf070 0x565146c74310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 -- 172.21.15.2:0/1636034215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 msgr2=0x565146c74850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 0x565146c74850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 -- 172.21.15.2:0/1636034215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514693a650 con 0x5651468ae390 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9e038640 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 0x565146c74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e8f7fe640 1 -- 172.21.15.2:0/3686552669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f7e940e5e00 con 0x7f7e981045e0 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.767+0000 7f7e9d837640 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e88033000 tx=0x7f7e88000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52241752b65f5033 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.768+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 0x7f7e840b7230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005fd0 tx=0x7f7e90009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.768+0000 7f7e8cd9a640 1 -- 172.21.15.2:0/1636034215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88035040 con 0x5651468ae390 2024-08-31T04:27:39.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.768+0000 7f7e8cd9a640 1 -- 172.21.15.2:0/1636034215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e88004030 con 0x5651468ae390 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.768+0000 7f7e8cd9a640 1 -- 172.21.15.2:0/1636034215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e880053d0 con 0x5651468ae390 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- 172.21.15.2:0/1636034215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 msgr2=0x565146c74d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e88033000 tx=0x7f7e88000bc0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- 172.21.15.2:0/1636034215 shutdown_connections 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c74d90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468a61b0 0x565146c74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 --2- 172.21.15.2:0/1636034215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468cf070 0x565146c74310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- 172.21.15.2:0/1636034215 >> 172.21.15.2:0/1636034215 conn(0x5651468c3460 msgr2=0x565146c72200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- 172.21.15.2:0/1636034215 shutdown_connections 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- 172.21.15.2:0/1636034215 wait complete. 2024-08-31T04:27:39.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 -- start start 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.769+0000 7f7ea6811740 1 Processor -- start 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c83e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565146a3d700 con 0x5651468ae390 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x565146b61750 con 0x5651468cf070 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x565146c86dc0 con 0x5651468a61b0 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7ea6811740 10 client.0 _ll_register_callbacks cb 0x565146b90e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36178/0 (socket says 172.21.15.2:36178) 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 -- 172.21.15.2:0/2086929824 learned_addr learned my addr 172.21.15.2:0/2086929824 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9e839640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9e038640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c83e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 -- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 msgr2=0x565146c83e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c83e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 -- 172.21.15.2:0/2086929824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 msgr2=0x565146c90120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c90120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9d837640 1 -- 172.21.15.2:0/2086929824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565146b9a900 con 0x5651468ae390 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9e038640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c83e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.770+0000 7f7e9e839640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e9d837640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e88032ed0 tx=0x7f7e88032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44077a32fdb2b81f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88052060 con 0x5651468ae390 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f7e880314a0 con 0x5651468ae390 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e88004030 con 0x5651468ae390 2024-08-31T04:27:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7e88035070 con 0x5651468ae390 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7ea6811740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565146c92b70 con 0x5651468ae390 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.771+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e88004030 con 0x5651468ae390 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f7e88004930 con 0x5651468ae390 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 10 client.15873 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 20 client.15873 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56514688d9f0 0x565146c95ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 4 client.15873 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:39.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565146bed5d0 con 0x56514688d9f0 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7e9e038640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56514688d9f0 0x565146c95ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7e81ffb640 10 client.15873 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.772+0000 7f7e9e038640 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56514688d9f0 0x565146c95ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f88cfaacfd0ace18 server_cookie=9ea07798f7984b7b in_seq=0 out_seq=0 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.773+0000 7f7e81ffb640 1 -- 172.21.15.2:0/2086929824 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565146bed5d0 con 0x56514688d9f0 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.773+0000 7f7e81ffb640 10 client.15873 handle_command_reply: tid=0 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.773+0000 7f7ea6811740 1 client.15873 shutdown 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.773+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 msgr2=0x565146c84350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.773+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e88032ed0 tx=0x7f7e88032f00 comp rx=0 tx=0).stop 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 shutdown_connections 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x56514688d9f0 0x565146c95ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468ae390 0x565146c84350 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 --2- 172.21.15.2:0/2086929824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c83e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 >> 172.21.15.2:0/2086929824 conn(0x5651468c3460 msgr2=0x565146c774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7e81ffb640 0 client.15873 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:27:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 shutdown_connections 2024-08-31T04:27:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 1 -- 172.21.15.2:0/2086929824 wait complete. 2024-08-31T04:27:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.774+0000 7f7ea6811740 20 client.15873 trim_cache size 0 max 16384 2024-08-31T04:27:39.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 Processor -- start 2024-08-31T04:27:39.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 -- start start 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c77bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468ae390 0x565146c90090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981b1520 con 0x5651468cf070 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981aedf0 con 0x5651468ae390 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7ea6811740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981acc40 con 0x5651468a61b0 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.787+0000 7f7e9e839640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36180/0 (socket says 172.21.15.2:36180) 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 -- 172.21.15.2:0/3855008079 learned_addr learned my addr 172.21.15.2:0/3855008079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9d837640 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468ae390 0x565146c90090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c77bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 -- 172.21.15.2:0/3855008079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 msgr2=0x565146c77bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c77bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 -- 172.21.15.2:0/3855008079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468ae390 msgr2=0x565146c90090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468ae390 0x565146c90090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 -- 172.21.15.2:0/3855008079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565146c82310 con 0x5651468cf070 2024-08-31T04:27:39.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7e90010d20 tx=0x7f7e90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab110388a7bc9b9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e83fff640 1 -- 172.21.15.2:0/3855008079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90010e10 con 0x5651468cf070 2024-08-31T04:27:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e83fff640 1 -- 172.21.15.2:0/3855008079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e9001d8c0 con 0x5651468cf070 2024-08-31T04:27:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.788+0000 7f7e83fff640 1 -- 172.21.15.2:0/3855008079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9001f8e0 con 0x5651468cf070 2024-08-31T04:27:39.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- 172.21.15.2:0/3855008079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 msgr2=0x565146c81000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7e90010d20 tx=0x7f7e90018000 comp rx=0 tx=0).stop 2024-08-31T04:27:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- 172.21.15.2:0/3855008079 shutdown_connections 2024-08-31T04:27:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468cf070 0x565146c81000 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468ae390 0x565146c90090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3855008079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468a61b0 0x565146c77bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- 172.21.15.2:0/3855008079 >> 172.21.15.2:0/3855008079 conn(0x5651468c3460 msgr2=0x565146c774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- 172.21.15.2:0/3855008079 shutdown_connections 2024-08-31T04:27:39.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- 172.21.15.2:0/3855008079 wait complete. 2024-08-31T04:27:39.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.789+0000 7f7ea6811740 1 -- start start 2024-08-31T04:27:39.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 Processor -- start 2024-08-31T04:27:39.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 0x565146c99700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468ae390 0x565146c96bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c97130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981ad2b0 con 0x5651468a61b0 2024-08-31T04:27:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981ae720 con 0x5651468cf070 2024-08-31T04:27:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981ad980 con 0x5651468ae390 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7ea6811740 10 client.0 _ll_register_callbacks cb 0x7f7e940a7f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 0x565146c99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 0x565146c99700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36196/0 (socket says 172.21.15.2:36196) 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e038640 1 -- 172.21.15.2:0/3285622577 learned_addr learned my addr 172.21.15.2:0/3285622577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9d837640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468ae390 0x565146c96bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 -- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468ae390 msgr2=0x565146c96bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468ae390 0x565146c96bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 -- 172.21.15.2:0/3285622577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 msgr2=0x565146c99700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 0x565146c99700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.790+0000 7f7e9e839640 1 -- 172.21.15.2:0/3285622577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565146c978c0 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e9e839640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c97130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000ff80 tx=0x7f7e9001dd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7d17e0e361359f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9001f870 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e9001d8c0 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f7e9001fa10 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7e90038050 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7ea6811740 10 client.25598 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565146d005b0 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.791+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e9001d8c0 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f7e90031060 con 0x5651468cf070 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 10 client.25598 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 10 client.25598 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 20 client.25598 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x565146862da0 0x565146d02c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 4 client.25598 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565146be9070 con 0x565146862da0 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x565146862da0 0x565146d02c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7e9e038640 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x565146862da0 0x565146d02c90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c632d20c4c303742 server_cookie=2f1e02fcfa3507c3 in_seq=0 out_seq=0 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.792+0000 7f7e81ffb640 10 client.25598 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7e81ffb640 1 -- 172.21.15.2:0/3285622577 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565146be9070 con 0x565146862da0 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7e81ffb640 10 client.25598 handle_command_reply: tid=0 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 client.25598 shutdown 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 msgr2=0x565146c97130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c97130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000ff80 tx=0x7f7e9001dd00 comp rx=0 tx=0).stop 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 shutdown_connections 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x565146862da0 0x565146d02c90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5651468cf070 0x565146c97130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5651468ae390 0x565146c96bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 --2- 172.21.15.2:0/3285622577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651468a61b0 0x565146c99700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7e81ffb640 0 client.25598 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 >> 172.21.15.2:0/3285622577 conn(0x5651468c3460 msgr2=0x565146c75340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 shutdown_connections 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 1 -- 172.21.15.2:0/3285622577 wait complete. 2024-08-31T04:27:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea6811740 20 client.25598 trim_cache size 0 max 16384 2024-08-31T04:27:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:27:39.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 msgr2=0x7f7e840b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 0x7f7e840b7230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005fd0 tx=0x7f7e90009500 comp rx=0 tx=0).stop 2024-08-31T04:27:39.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 msgr2=0x7f7e9819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.793+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400e9c0 tx=0x7f7e9400edc0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 shutdown_connections 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e9810db90 0x7f7e9819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e98105010 0x7f7e9819a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f7e840b4d20 0x7f7e840b7230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 --2- 172.21.15.2:0/3686552669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e981045e0 0x7f7e9819a2e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 >> 172.21.15.2:0/3686552669 conn(0x7f7e980794d0 msgr2=0x7f7e980ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 shutdown_connections 2024-08-31T04:27:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:39.794+0000 7f7ea029c640 1 -- 172.21.15.2:0/3686552669 wait complete. 2024-08-31T04:27:40.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 88527 8.24 MB/sec warmup 60 sec latency 530.067 ms 2024-08-31T04:27:40.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:27:40.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:40 smithi002 ceph-mon[18656]: pgmap v406: 129 pgs: 129 active+clean; 65 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-08-31T04:27:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:41.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:40 smithi064 ceph-mon[22007]: pgmap v406: 129 pgs: 129 active+clean; 65 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-08-31T04:27:41.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:40 smithi132 ceph-mon[22335]: pgmap v406: 129 pgs: 129 active+clean; 65 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 -- 172.21.15.2:0/3833936894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84109b90 msgr2=0x7fea841103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 --2- 172.21.15.2:0/3833936894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84109b90 0x7fea841103c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009ca0 tx=0x7fea7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 -- 172.21.15.2:0/3833936894 shutdown_connections 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 --2- 172.21.15.2:0/3833936894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84109b90 0x7fea841103c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 --2- 172.21.15.2:0/3833936894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109240 0x7fea84109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 --2- 172.21.15.2:0/3833936894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84103900 0x7fea84103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 -- 172.21.15.2:0/3833936894 >> 172.21.15.2:0/3833936894 conn(0x7fea8407b5f0 msgr2=0x7fea8407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 -- 172.21.15.2:0/3833936894 shutdown_connections 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.407+0000 7fea88e40640 1 -- 172.21.15.2:0/3833936894 wait complete. 2024-08-31T04:27:41.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.408+0000 7fea88e40640 1 Processor -- start 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.408+0000 7fea88e40640 1 -- start start 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.408+0000 7fea88e40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.408+0000 7fea88e40640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84109240 0x7fea8419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea88e40640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109b90 0x7fea8419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea88e40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea84113850 con 0x7fea84103900 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea88e40640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea841136d0 con 0x7fea84109240 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea88e40640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea841139d0 con 0x7fea84109b90 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36216/0 (socket says 172.21.15.2:36216) 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 -- 172.21.15.2:0/46068632 learned_addr learned my addr 172.21.15.2:0/46068632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea82d9d640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109b90 0x7fea8419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea81d9b640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84109240 0x7fea8419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 -- 172.21.15.2:0/46068632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109b90 msgr2=0x7fea8419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109b90 0x7fea8419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 -- 172.21.15.2:0/46068632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84109240 msgr2=0x7fea8419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84109240 0x7fea8419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 -- 172.21.15.2:0/46068632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea841a0190 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea8259c640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d950 tx=0x7fea7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea737fe640 1 -- 172.21.15.2:0/46068632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74017030 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.409+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea841a0480 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.410+0000 7fea737fe640 1 -- 172.21.15.2:0/46068632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea74004020 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.410+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841a6be0 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.410+0000 7fea737fe640 1 -- 172.21.15.2:0/46068632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740047a0 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.412+0000 7fea8f3b5740 1 Processor -- start 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.412+0000 7fea8f3b5740 1 -- start start 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.412+0000 7fea737fe640 1 -- 172.21.15.2:0/46068632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fea74004940 con 0x7fea84103900 2024-08-31T04:27:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da04850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 0x557e4da04d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557e4d97b680 con 0x557e4d65f070 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557e4d96ac10 con 0x557e4d63e390 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557e4d96ebc0 con 0x557e4d6361b0 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36222/0 (socket says 172.21.15.2:36222) 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 -- 172.21.15.2:0/286091771 learned_addr learned my addr 172.21.15.2:0/286091771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8259c640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da04850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea81d9b640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 0x557e4da04d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 -- 172.21.15.2:0/286091771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 msgr2=0x557e4da04850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da04850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 -- 172.21.15.2:0/286091771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 msgr2=0x557e4da04d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 0x557e4da04d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 -- 172.21.15.2:0/286091771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d6ca650 con 0x557e4d65f070 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea81d9b640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 0x557e4da04d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea737fe640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 0x7fea6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea82d9d640 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0098b0 tx=0x7fea7c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2e85c007e698f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.413+0000 7fea8259c640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 0x7fea6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.414+0000 7fea737fe640 1 -- 172.21.15.2:0/46068632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fea740e53f0 con 0x7fea84103900 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.414+0000 7fea70ff9640 1 -- 172.21.15.2:0/286091771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c031cf0 con 0x557e4d65f070 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.414+0000 7fea70ff9640 1 -- 172.21.15.2:0/286091771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7c036030 con 0x557e4d65f070 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.414+0000 7fea70ff9640 1 -- 172.21.15.2:0/286091771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0042a0 con 0x557e4d65f070 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- 172.21.15.2:0/286091771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 msgr2=0x557e4da04310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0098b0 tx=0x7fea7c0098e0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8259c640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 0x7fea6c0b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fea740e27d0 tx=0x7fea740e8f40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- 172.21.15.2:0/286091771 shutdown_connections 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d63e390 0x557e4da04d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da04850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/286091771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d65f070 0x557e4da04310 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- 172.21.15.2:0/286091771 >> 172.21.15.2:0/286091771 conn(0x557e4d653460 msgr2=0x557e4da02200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- 172.21.15.2:0/286091771 shutdown_connections 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- 172.21.15.2:0/286091771 wait complete. 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 -- start start 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.415+0000 7fea8f3b5740 1 Processor -- start 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da0fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da1bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557e4d7cd700 con 0x557e4d63e390 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557e4d8f1750 con 0x557e4d65f070 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557e4da12910 con 0x557e4d6361b0 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 10 client.0 _ll_register_callbacks cb 0x557e4d920e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36238/0 (socket says 172.21.15.2:36238) 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 -- 172.21.15.2:0/2250986664 learned_addr learned my addr 172.21.15.2:0/2250986664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea82d9d640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da0fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea82d9d640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da1bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 -- 172.21.15.2:0/2250986664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 msgr2=0x557e4da0fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da0fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 -- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 msgr2=0x557e4da1bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da1bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 -- 172.21.15.2:0/2250986664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4d92a900 con 0x557e4d63e390 2024-08-31T04:27:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea82d9d640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da0fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea81d9b640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b9c0 tx=0x7fea7800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bdc4a4707d788d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7801b440 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fea7801b5e0 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.416+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea7c036030 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea7801b7e0 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 10 client.15891 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e4da1e770 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7c036030 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fea78019020 con 0x557e4d63e390 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 10 client.15891 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 10 client.15891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 20 client.15891 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:41.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d61d9f0 0x557e4da21cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 4 client.15891 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.417+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e4d97d5d0 con 0x557e4d61d9f0 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.418+0000 7fea82d9d640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d61d9f0 0x557e4da21cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.418+0000 7fea82d9d640 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d61d9f0 0x557e4da21cc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adf0f390944c18e1 server_cookie=b2844657ca3e21be in_seq=0 out_seq=0 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.418+0000 7fea69ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea69ffb640 1 -- 172.21.15.2:0/2250986664 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e4d97d5d0 con 0x557e4d61d9f0 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea69ffb640 10 client.15891 handle_command_reply: tid=0 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 client.15891 shutdown 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 msgr2=0x557e4da10000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b9c0 tx=0x7fea7800be80 comp rx=0 tx=0).stop 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 shutdown_connections 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d61d9f0 0x557e4da21cc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da10000 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da1bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/2250986664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da0fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 >> 172.21.15.2:0/2250986664 conn(0x557e4d653460 msgr2=0x557e4da074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea69ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 shutdown_connections 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 1 -- 172.21.15.2:0/2250986664 wait complete. 2024-08-31T04:27:41.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.419+0000 7fea8f3b5740 20 client.15891 trim_cache size 0 max 16384 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.432+0000 7fea8f3b5740 1 Processor -- start 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.432+0000 7fea8f3b5740 1 -- start start 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 0x557e4da0ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d65f070 0x557e4da1c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea841b3740 con 0x557e4d63e390 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea841b1010 con 0x557e4d6361b0 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea841aee60 con 0x557e4d65f070 2024-08-31T04:27:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36244/0 (socket says 172.21.15.2:36244) 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 -- 172.21.15.2:0/374442066 learned_addr learned my addr 172.21.15.2:0/374442066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea82d9d640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 0x557e4da0ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea82d9d640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d65f070 0x557e4da1c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 -- 172.21.15.2:0/374442066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d65f070 msgr2=0x557e4da1c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d65f070 0x557e4da1c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 -- 172.21.15.2:0/374442066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 msgr2=0x557e4da0ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 0x557e4da0ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 -- 172.21.15.2:0/374442066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4da10d80 con 0x557e4d63e390 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea82d9d640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 0x557e4da0ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea81d9b640 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fea78004400 tx=0x7fea780059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e582fb025e525222 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea6bfff640 1 -- 172.21.15.2:0/374442066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7802c070 con 0x557e4d63e390 2024-08-31T04:27:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea6bfff640 1 -- 172.21.15.2:0/374442066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7801b440 con 0x557e4d63e390 2024-08-31T04:27:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.433+0000 7fea6bfff640 1 -- 172.21.15.2:0/374442066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78028420 con 0x557e4d63e390 2024-08-31T04:27:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 -- 172.21.15.2:0/374442066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 msgr2=0x557e4da1bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fea78004400 tx=0x7fea780059b0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 -- 172.21.15.2:0/374442066 shutdown_connections 2024-08-31T04:27:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da1bb00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d65f070 0x557e4da1c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/374442066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d6361b0 0x557e4da0ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 -- 172.21.15.2:0/374442066 >> 172.21.15.2:0/374442066 conn(0x557e4d653460 msgr2=0x557e4da0f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 -- 172.21.15.2:0/374442066 shutdown_connections 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.434+0000 7fea8f3b5740 1 -- 172.21.15.2:0/374442066 wait complete. 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 -- start start 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 Processor -- start 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da13bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da14640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea841af4d0 con 0x557e4d63e390 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea841b0940 con 0x557e4d65f070 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea841afba0 con 0x557e4d6361b0 2024-08-31T04:27:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea8f3b5740 10 client.0 _ll_register_callbacks cb 0x7fea78004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36246/0 (socket says 172.21.15.2:36246) 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea81d9b640 1 -- 172.21.15.2:0/215681898 learned_addr learned my addr 172.21.15.2:0/215681898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea82d9d640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da14640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea82d9d640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da13bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea81d9b640 1 -- 172.21.15.2:0/215681898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 msgr2=0x557e4da13bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.435+0000 7fea81d9b640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da13bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea81d9b640 1 -- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 msgr2=0x557e4da14640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea81d9b640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da14640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea81d9b640 1 -- 172.21.15.2:0/215681898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4da8b6c0 con 0x557e4d63e390 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea82d9d640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da13bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea81d9b640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fea78004010 tx=0x7fea78005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe86722bdf4d5bef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7802c040 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fea78034a10 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea7801b440 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea7801b980 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea8f3b5740 10 client.15897 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e4da8c940 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.436+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7801b440 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fea78019040 con 0x557e4d63e390 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 10 client.15897 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 10 client.15897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 20 client.15897 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d5f2da0 0x557e4da8ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 4 client.15897 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:27:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e4d979070 con 0x557e4d5f2da0 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea82d9d640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d5f2da0 0x557e4da8ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea82d9d640 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d5f2da0 0x557e4da8ef30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d3bc6e52a0f5ee4 server_cookie=c40cd2e8bba54a4b in_seq=0 out_seq=0 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.437+0000 7fea69ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea69ffb640 1 -- 172.21.15.2:0/215681898 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e4d979070 con 0x557e4d5f2da0 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea69ffb640 10 client.15897 handle_command_reply: tid=0 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 client.15897 shutdown 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 msgr2=0x557e4da14100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fea78004010 tx=0x7fea78005bb0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 shutdown_connections 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557e4d5f2da0 0x557e4da8ef30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4d63e390 0x557e4da14100 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e4d65f070 0x557e4da14640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 --2- 172.21.15.2:0/215681898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557e4d6361b0 0x557e4da13bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 >> 172.21.15.2:0/215681898 conn(0x557e4d653460 msgr2=0x557e4da01aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea69ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 shutdown_connections 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 1 -- 172.21.15.2:0/215681898 wait complete. 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea8f3b5740 20 client.15897 trim_cache size 0 max 16384 2024-08-31T04:27:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 msgr2=0x7fea6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 0x7fea6c0b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fea740e27d0 tx=0x7fea740e8f40 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 msgr2=0x7fea8419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d950 tx=0x7fea7400de10 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.438+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 shutdown_connections 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea84109b90 0x7fea8419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea84109240 0x7fea8419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea6c0b4ca0 0x7fea6c0b71b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 --2- 172.21.15.2:0/46068632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea84103900 0x7fea8419a220 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 >> 172.21.15.2:0/46068632 conn(0x7fea8407b5f0 msgr2=0x7fea841072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 shutdown_connections 2024-08-31T04:27:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:41.439+0000 7fea88e40640 1 -- 172.21.15.2:0/46068632 wait complete. 2024-08-31T04:27:41.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 88527 8.10 MB/sec warmup 61 sec latency 1530.099 ms 2024-08-31T04:27:42.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:27:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:42.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 88527 7.97 MB/sec warmup 62 sec latency 2530.189 ms 2024-08-31T04:27:43.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:42 smithi002 ceph-mon[18656]: pgmap v407: 129 pgs: 129 active+clean; 65 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 146 op/s 2024-08-31T04:27:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:42 smithi064 ceph-mon[22007]: pgmap v407: 129 pgs: 129 active+clean; 65 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 146 op/s 2024-08-31T04:27:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:42 smithi132 ceph-mon[22335]: pgmap v407: 129 pgs: 129 active+clean; 65 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 146 op/s 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 -- 172.21.15.2:0/1009366550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724109b90 msgr2=0x7f27241103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 --2- 172.21.15.2:0/1009366550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724109b90 0x7f27241103c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f271c009ca0 tx=0x7f271c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 -- 172.21.15.2:0/1009366550 shutdown_connections 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 --2- 172.21.15.2:0/1009366550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724109b90 0x7f27241103c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 --2- 172.21.15.2:0/1009366550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109240 0x7f2724109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 --2- 172.21.15.2:0/1009366550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724103900 0x7f2724103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 -- 172.21.15.2:0/1009366550 >> 172.21.15.2:0/1009366550 conn(0x7f272407b5f0 msgr2=0x7f272407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 -- 172.21.15.2:0/1009366550 shutdown_connections 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.109+0000 7f272ad15640 1 -- 172.21.15.2:0/1009366550 wait complete. 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 Processor -- start 2024-08-31T04:27:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 -- start start 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724109240 0x7f272419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109b90 0x7f272419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2724113850 con 0x7f2724103900 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27241136d0 con 0x7f2724109b90 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f272ad15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27241139d0 con 0x7f2724109240 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36270/0 (socket says 172.21.15.2:36270) 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 -- 172.21.15.2:0/1437924772 learned_addr learned my addr 172.21.15.2:0/1437924772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f27292b2640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109b90 0x7f272419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f271bfff640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724109240 0x7f272419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 -- 172.21.15.2:0/1437924772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724109240 msgr2=0x7f272419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724109240 0x7f272419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 -- 172.21.15.2:0/1437924772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109b90 msgr2=0x7f272419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109b90 0x7f272419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.110+0000 7f2728ab1640 1 -- 172.21.15.2:0/1437924772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27241a0150 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f2728ab1640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f272000c890 tx=0x7f272000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f2719ffb640 1 -- 172.21.15.2:0/1437924772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720004220 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f2719ffb640 1 -- 172.21.15.2:0/1437924772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27200043c0 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27241a0440 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f2719ffb640 1 -- 172.21.15.2:0/1437924772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720004a00 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.111+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27241a6ba0 con 0x7f2724103900 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.114+0000 7f273128a740 1 Processor -- start 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.114+0000 7f273128a740 1 -- start start 2024-08-31T04:27:43.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.114+0000 7f2719ffb640 1 -- 172.21.15.2:0/1437924772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f27200079b0 con 0x7f2724103900 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 0x55b765514850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765514d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b76548b680 con 0x55b76516f070 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b76547ac10 con 0x55b76514e390 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f273128a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b76547ebc0 con 0x55b7651461b0 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36272/0 (socket says 172.21.15.2:36272) 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 -- 172.21.15.2:0/2471470551 learned_addr learned my addr 172.21.15.2:0/2471470551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f271bfff640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765514d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f2728ab1640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 0x55b765514850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 -- 172.21.15.2:0/2471470551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 msgr2=0x55b765514850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 0x55b765514850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 -- 172.21.15.2:0/2471470551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 msgr2=0x55b765514d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765514d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 -- 172.21.15.2:0/2471470551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7651da650 con 0x55b76516f070 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f271bfff640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765514d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f2728ab1640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 0x55b765514850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.115+0000 7f27292b2640 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f271c009920 tx=0x7f271c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80977ab02f93d652 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f270affd640 1 -- 172.21.15.2:0/2471470551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c031e30 con 0x55b76516f070 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f2719ffb640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 0x7f270c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f270affd640 1 -- 172.21.15.2:0/2471470551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f271c036030 con 0x55b76516f070 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f270affd640 1 -- 172.21.15.2:0/2471470551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c004280 con 0x55b76516f070 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f2728ab1640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 0x7f270c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.116+0000 7f2719ffb640 1 -- 172.21.15.2:0/1437924772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f27200e5640 con 0x7f2724103900 2024-08-31T04:27:43.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- 172.21.15.2:0/2471470551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 msgr2=0x55b765514310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f271c009920 tx=0x7f271c009950 comp rx=0 tx=0).stop 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f2728ab1640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 0x7f270c0b71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27200e2a20 tx=0x7f2720000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- 172.21.15.2:0/2471470551 shutdown_connections 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765514d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b7651461b0 0x55b765514850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 --2- 172.21.15.2:0/2471470551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b765514310 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- 172.21.15.2:0/2471470551 >> 172.21.15.2:0/2471470551 conn(0x55b765163460 msgr2=0x55b765512200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- 172.21.15.2:0/2471470551 shutdown_connections 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- 172.21.15.2:0/2471470551 wait complete. 2024-08-31T04:27:43.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 -- start start 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.117+0000 7f273128a740 1 Processor -- start 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b7651461b0 0x55b76551faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76551ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b7652dd700 con 0x55b76516f070 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b765401750 con 0x55b7651461b0 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b765522910 con 0x55b76514e390 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f273128a740 10 client.0 _ll_register_callbacks cb 0x55b765430e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36280/0 (socket says 172.21.15.2:36280) 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 -- 172.21.15.2:0/792466773 learned_addr learned my addr 172.21.15.2:0/792466773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b7651461b0 0x55b76551faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f271bfff640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76551ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 -- 172.21.15.2:0/792466773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 msgr2=0x55b76551ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76551ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 -- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b7651461b0 msgr2=0x55b76551faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b7651461b0 0x55b76551faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 -- 172.21.15.2:0/792466773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76543a900 con 0x55b76516f070 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f271bfff640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76551ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f27292b2640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55b7655222f0 tx=0x7f271c003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0796d0ee5eb99ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.118+0000 7f2703fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c058060 con 0x55b76516f070 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f271c031450 con 0x55b76516f070 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f271c036030 con 0x55b76516f070 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f271c031650 con 0x55b76516f070 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 10 client.15909 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:43.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b76552e660 con 0x55b76516f070 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f271c036030 con 0x55b76516f070 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f271c050070 con 0x55b76516f070 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 10 client.15909 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 20 client.15909 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b76512d9f0 0x55b7655319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 4 client.15909 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.119+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b76548d5d0 con 0x55b76512d9f0 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.120+0000 7f271bfff640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b76512d9f0 0x55b7655319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.120+0000 7f271bfff640 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b76512d9f0 0x55b7655319c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdca2f9752d01ec1 server_cookie=c54f4bb99caf2b00 in_seq=0 out_seq=0 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.120+0000 7f2703fff640 10 client.15909 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f2703fff640 1 -- 172.21.15.2:0/792466773 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b76548d5d0 con 0x55b76512d9f0 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f2703fff640 10 client.15909 handle_command_reply: tid=0 2024-08-31T04:27:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 client.15909 shutdown 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 msgr2=0x55b76552bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55b7655222f0 tx=0x7f271c003e20 comp rx=0 tx=0).stop 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 shutdown_connections 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b76512d9f0 0x55b7655319c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b76516f070 0x55b76552bc00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76551ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f2703fff640 0 client.15909 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 --2- 172.21.15.2:0/792466773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b7651461b0 0x55b76551faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 >> 172.21.15.2:0/792466773 conn(0x55b765163460 msgr2=0x55b7655174f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 shutdown_connections 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 1 -- 172.21.15.2:0/792466773 wait complete. 2024-08-31T04:27:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.121+0000 7f273128a740 20 client.15909 trim_cache size 0 max 16384 2024-08-31T04:27:43.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.134+0000 7f273128a740 1 Processor -- start 2024-08-31T04:27:43.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.134+0000 7f273128a740 1 -- start start 2024-08-31T04:27:43.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76552bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76516f070 0x55b76552c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27241b3670 con 0x55b7651461b0 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27241b0f40 con 0x55b76516f070 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f273128a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27241aed90 con 0x55b76514e390 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36282/0 (socket says 172.21.15.2:36282) 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 -- 172.21.15.2:0/3882417060 learned_addr learned my addr 172.21.15.2:0/3882417060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f271bfff640 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76552bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76516f070 0x55b76552c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 -- 172.21.15.2:0/3882417060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 msgr2=0x55b76552bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76552bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 -- 172.21.15.2:0/3882417060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76516f070 msgr2=0x55b76552c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76516f070 0x55b76552c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 -- 172.21.15.2:0/3882417060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b765531d30 con 0x55b7651461b0 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f27292b2640 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f271c006010 tx=0x7f271c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ddf98100d7d8bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.135+0000 7f270a7fc640 1 -- 172.21.15.2:0/3882417060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c058070 con 0x55b7651461b0 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f270a7fc640 1 -- 172.21.15.2:0/3882417060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f271c036040 con 0x55b7651461b0 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f270a7fc640 1 -- 172.21.15.2:0/3882417060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c004230 con 0x55b7651461b0 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 -- 172.21.15.2:0/3882417060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 msgr2=0x55b765517b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f271c006010 tx=0x7f271c009800 comp rx=0 tx=0).stop 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 -- 172.21.15.2:0/3882417060 shutdown_connections 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76516f070 0x55b76552c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76514e390 0x55b76552bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 --2- 172.21.15.2:0/3882417060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b765517b20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 -- 172.21.15.2:0/3882417060 >> 172.21.15.2:0/3882417060 conn(0x55b765163460 msgr2=0x55b765517410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 -- 172.21.15.2:0/3882417060 shutdown_connections 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.136+0000 7f273128a740 1 -- 172.21.15.2:0/3882417060 wait complete. 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 -- start start 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 Processor -- start 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765524800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76516f070 0x55b76559b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27241af400 con 0x55b7651461b0 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27241b0870 con 0x55b76514e390 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27241afad0 con 0x55b76516f070 2024-08-31T04:27:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f273128a740 10 client.0 _ll_register_callbacks cb 0x7f271c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.137+0000 7f27292b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36284/0 (socket says 172.21.15.2:36284) 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 -- 172.21.15.2:0/874041071 learned_addr learned my addr 172.21.15.2:0/874041071 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f271bfff640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765524800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76516f070 0x55b76559b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 -- 172.21.15.2:0/874041071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76516f070 msgr2=0x55b76559b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76516f070 0x55b76559b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 -- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 msgr2=0x55b765524800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765524800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 -- 172.21.15.2:0/874041071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76559b700 con 0x55b7651461b0 2024-08-31T04:27:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f27292b2640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f271c030740 tx=0x7f271c0307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87277fa047bc1a6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f2703fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c058070 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f271c004d40 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f271c036040 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f271c003b80 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f273128a740 10 client.15915 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.138+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b76559c930 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f271c036040 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f271c050070 con 0x55b7651461b0 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 10 client.15915 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 20 client.15915 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b765102da0 0x55b76559eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 4 client.15915 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:27:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b765489070 con 0x55b765102da0 2024-08-31T04:27:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.139+0000 7f271bfff640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b765102da0 0x55b76559eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f271bfff640 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b765102da0 0x55b76559eea0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c223b0ba61c39b64 server_cookie=315f4d188a008886 in_seq=0 out_seq=0 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f2703fff640 10 client.15915 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f2703fff640 1 -- 172.21.15.2:0/874041071 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b765489070 con 0x55b765102da0 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f2703fff640 10 client.15915 handle_command_reply: tid=0 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 client.15915 shutdown 2024-08-31T04:27:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 msgr2=0x55b7655242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f271c030740 tx=0x7f271c0307f0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 shutdown_connections 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55b765102da0 0x55b76559eea0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b76516f070 0x55b76559b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b76514e390 0x55b765524800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 --2- 172.21.15.2:0/874041071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7651461b0 0x55b7655242c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f2703fff640 0 client.15915 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 >> 172.21.15.2:0/874041071 conn(0x55b765163460 msgr2=0x55b765515340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 shutdown_connections 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 1 -- 172.21.15.2:0/874041071 wait complete. 2024-08-31T04:27:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.140+0000 7f273128a740 20 client.15915 trim_cache size 0 max 16384 2024-08-31T04:27:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:27:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 msgr2=0x7f270c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 0x7f270c0b71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27200e2a20 tx=0x7f2720000bc0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 msgr2=0x7f272419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f272000c890 tx=0x7f272000cd50 comp rx=0 tx=0).stop 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 shutdown_connections 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2724109b90 0x7f272419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2724109240 0x7f272419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f270c0b4ca0 0x7f270c0b71b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 --2- 172.21.15.2:0/1437924772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2724103900 0x7f272419a1e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 >> 172.21.15.2:0/1437924772 conn(0x7f272407b5f0 msgr2=0x7f2724107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 shutdown_connections 2024-08-31T04:27:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:43.141+0000 7f272ad15640 1 -- 172.21.15.2:0/1437924772 wait complete. 2024-08-31T04:27:43.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 88527 7.85 MB/sec warmup 63 sec latency 3530.241 ms 2024-08-31T04:27:44.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 90682 7.88 MB/sec warmup 64 sec latency 3605.395 ms 2024-08-31T04:27:44.986 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:27:44.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:27:45.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:44 smithi002 ceph-mon[18656]: pgmap v408: 129 pgs: 129 active+clean; 64 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-08-31T04:27:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:44 smithi064 ceph-mon[22007]: pgmap v408: 129 pgs: 129 active+clean; 64 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-08-31T04:27:45.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:44 smithi132 ceph-mon[22335]: pgmap v408: 129 pgs: 129 active+clean; 64 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-08-31T04:27:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:45.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 92074 7.90 MB/sec warmup 65 sec latency 640.246 ms 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/866833563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102820 msgr2=0x7f8a78102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/866833563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102820 0x7f8a78102c30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009900 tx=0x7f8a6802a410 comp rx=0 tx=0).stop 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/866833563 shutdown_connections 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/866833563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78108ab0 0x7f8a7810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/866833563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108160 0x7f8a78108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/866833563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102820 0x7f8a78102c30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/866833563 >> 172.21.15.2:0/866833563 conn(0x7f8a780794e0 msgr2=0x7f8a780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/866833563 shutdown_connections 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.722+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/866833563 wait complete. 2024-08-31T04:27:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 Processor -- start 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 -- start start 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78102820 0x7f8a78199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 0x7f8a7819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78112730 con 0x7f8a78108160 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781125b0 con 0x7f8a78108ab0 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a7dc0a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781128b0 con 0x7f8a78102820 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.723+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33620/0 (socket says 172.21.15.2:33620) 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2467185971 learned_addr learned my addr 172.21.15.2:0/2467185971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78102820 0x7f8a78199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 0x7f8a7819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2467185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78102820 msgr2=0x7f8a78199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78102820 0x7f8a78199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2467185971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 msgr2=0x7f8a7819e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 0x7f8a7819e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2467185971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7819f0f0 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 0x7f8a7819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005fd0 tx=0x7f8a6c009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a74ff9640 1 -- 172.21.15.2:0/2467185971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00d020 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a74ff9640 1 -- 172.21.15.2:0/2467185971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c00d1c0 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7819f3e0 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a74ff9640 1 -- 172.21.15.2:0/2467185971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c003850 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.724+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7806b8e0 con 0x7f8a78108160 2024-08-31T04:27:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.727+0000 7f8a8417f740 1 Processor -- start 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.727+0000 7f8a8417f740 1 -- start start 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a74ff9640 1 -- 172.21.15.2:0/2467185971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8a6c01f020 con 0x7f8a78108160 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 0x560c8360a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 0x560c8360acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 0x560c8360b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c835805f0 con 0x560c83243670 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c8356fb80 con 0x560c83264350 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a8417f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560c83573b30 con 0x560c8323b490 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 0x560c8360b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 0x560c8360a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 0x560c8360b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33628/0 (socket says 172.21.15.2:33628) 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 0x560c8360a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:50158/0 (socket says 172.21.15.2:50158) 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a76ffd640 1 -- 172.21.15.2:0/1298190065 learned_addr learned my addr 172.21.15.2:0/1298190065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 0x560c8360acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 -- 172.21.15.2:0/1298190065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 msgr2=0x560c8360a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 0x560c8360a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 -- 172.21.15.2:0/1298190065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 msgr2=0x560c8360b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 0x560c8360b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.728+0000 7f8a777fe640 1 -- 172.21.15.2:0/1298190065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c832cf930 con 0x560c8323b490 2024-08-31T04:27:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 0x560c8360acc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009230 tx=0x7f8a68032cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=660625b4a313f492 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a74ff9640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 0x7f8a600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 0x7f8a600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a74ff9640 1 -- 172.21.15.2:0/2467185971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8a6c0e6cf0 con 0x7f8a78108160 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a5dffb640 1 -- 172.21.15.2:0/1298190065 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68040070 con 0x560c8323b490 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a5dffb640 1 -- 172.21.15.2:0/1298190065 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a68032e40 con 0x560c8323b490 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.729+0000 7f8a5dffb640 1 -- 172.21.15.2:0/1298190065 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68035040 con 0x560c8323b490 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 -- 172.21.15.2:0/1298190065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 msgr2=0x560c8360acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 0x7f8a600b71b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a70009780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 0x560c8360acc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009230 tx=0x7f8a68032cd0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 -- 172.21.15.2:0/1298190065 shutdown_connections 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c83243670 0x560c8360b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c8323b490 0x560c8360acc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1298190065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83264350 0x560c8360a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 -- 172.21.15.2:0/1298190065 >> 172.21.15.2:0/1298190065 conn(0x560c83258740 msgr2=0x560c83608670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 -- 172.21.15.2:0/1298190065 shutdown_connections 2024-08-31T04:27:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.730+0000 7f8a8417f740 1 -- 172.21.15.2:0/1298190065 wait complete. 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 -- start start 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 Processor -- start 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 0x560c836221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c833d2890 con 0x560c8323b490 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c834f6790 con 0x560c83243670 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560c83618f00 con 0x560c83264350 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.731+0000 7f8a8417f740 10 client.0 _ll_register_callbacks cb 0x560c8327bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:50160/0 (socket says 172.21.15.2:50160) 2024-08-31T04:27:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33642/0 (socket says 172.21.15.2:33642) 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a76ffd640 1 -- 172.21.15.2:0/1672165860 learned_addr learned my addr 172.21.15.2:0/1672165860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a77fff640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 0x560c836221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 -- 172.21.15.2:0/1672165860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 msgr2=0x560c836221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 0x560c836221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 -- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 msgr2=0x560c83616430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a777fe640 1 -- 172.21.15.2:0/1672165860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8352df30 con 0x560c8323b490 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.732+0000 7f8a77fff640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 0x560c836221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a777fe640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a6802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d628ade8b8cb1ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68035040 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8a68004030 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c83582540 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a68056050 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 10 client.15927 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c83624cd0 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560c83582540 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8a68003bc0 con 0x560c8323b490 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 10 client.15927 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 20 client.15927 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83222cd0 0x560c83628030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 4 client.15927 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.733+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c8357dfe0 con 0x560c83222cd0 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.734+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83222cd0 0x560c83628030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.734+0000 7f8a56ffd640 10 client.15927 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.734+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83222cd0 0x560c83628030 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c069d16344bf8579 server_cookie=b41e4f57935f7bbd in_seq=0 out_seq=0 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a56ffd640 1 -- 172.21.15.2:0/1672165860 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c8357dfe0 con 0x560c83222cd0 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a56ffd640 10 client.15927 handle_command_reply: tid=0 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 client.15927 shutdown 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 msgr2=0x560c83615ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a6802a410 comp rx=0 tx=0).stop 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 shutdown_connections 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83222cd0 0x560c83628030 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83264350 0x560c836221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83616430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a56ffd640 0 client.15927 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:45.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 --2- 172.21.15.2:0/1672165860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83615ef0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 >> 172.21.15.2:0/1672165860 conn(0x560c83258740 msgr2=0x560c8360d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 shutdown_connections 2024-08-31T04:27:45.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 1 -- 172.21.15.2:0/1672165860 wait complete. 2024-08-31T04:27:45.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.735+0000 7f8a8417f740 20 client.15927 trim_cache size 0 max 16384 2024-08-31T04:27:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.753+0000 7f8a8417f740 1 Processor -- start 2024-08-31T04:27:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.753+0000 7f8a8417f740 1 -- start start 2024-08-31T04:27:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 0x560c8360bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 0x560c836081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781b1600 con 0x560c8323b490 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781aeed0 con 0x560c83222cd0 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a8417f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781acd20 con 0x560c83243670 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33656/0 (socket says 172.21.15.2:33656) 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2125004414 learned_addr learned my addr 172.21.15.2:0/2125004414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 0x560c8360bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 0x560c836081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2125004414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 msgr2=0x560c836081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 0x560c836081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2125004414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 msgr2=0x560c8360bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 0x560c8360bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2125004414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8360d5e0 con 0x560c8323b490 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 0x560c836081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 0x560c8360bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.754+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0e40d0 tx=0x7f8a6c0e6ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a601d2336b19d4dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a5d7fa640 1 -- 172.21.15.2:0/2125004414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c01c040 con 0x560c8323b490 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a5d7fa640 1 -- 172.21.15.2:0/2125004414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c0acad0 con 0x560c8323b490 2024-08-31T04:27:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a5d7fa640 1 -- 172.21.15.2:0/2125004414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0078f0 con 0x560c8323b490 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 -- 172.21.15.2:0/2125004414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 msgr2=0x560c83607ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0e40d0 tx=0x7f8a6c0e6ef0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 -- 172.21.15.2:0/2125004414 shutdown_connections 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83607ca0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83243670 0x560c836081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2125004414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83222cd0 0x560c8360bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 -- 172.21.15.2:0/2125004414 >> 172.21.15.2:0/2125004414 conn(0x560c83258740 msgr2=0x560c8360b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.755+0000 7f8a8417f740 1 -- 172.21.15.2:0/2125004414 shutdown_connections 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 -- 172.21.15.2:0/2125004414 wait complete. 2024-08-31T04:27:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 -- start start 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 Processor -- start 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 0x560c836291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83629c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781ad390 con 0x560c8323b490 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781ae800 con 0x560c83243670 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.756+0000 7f8a8417f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781ada60 con 0x560c83222cd0 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a8417f740 10 client.0 _ll_register_callbacks cb 0x7f8a6c0ea710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33670/0 (socket says 172.21.15.2:33670) 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2016148073 learned_addr learned my addr 172.21.15.2:0/2016148073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a777fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 0x560c836291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83629c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2016148073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 msgr2=0x560c836291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 0x560c836291d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 msgr2=0x560c83629c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83629c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 -- 172.21.15.2:0/2016148073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c83691930 con 0x560c8323b490 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 0x560c836291d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a77fff640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83629c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a76ffd640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c004770 tx=0x7f8a6c0a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278a4c05b2e175f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c01c040 con 0x560c8323b490 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8a6c0981b0 con 0x560c8323b490 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a6c0acad0 con 0x560c8323b490 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a6c0ad6c0 con 0x560c8323b490 2024-08-31T04:27:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a8417f740 10 client.15933 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.757+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c83692bf0 con 0x560c8323b490 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c0acad0 con 0x560c8323b490 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8a6c00c020 con 0x560c8323b490 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 10 client.15933 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 20 client.15933 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83264350 0x560c83695380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 4 client.15933 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c8357b720 con 0x560c83264350 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83264350 0x560c83695380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a56ffd640 10 client.15933 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.758+0000 7f8a777fe640 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83264350 0x560c83695380 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe44501af4c0cfc1 server_cookie=5d8470a1cdecdb5a in_seq=0 out_seq=0 2024-08-31T04:27:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a56ffd640 1 -- 172.21.15.2:0/2016148073 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c8357b720 con 0x560c83264350 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a56ffd640 10 client.15933 handle_command_reply: tid=0 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 client.15933 shutdown 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 msgr2=0x560c83629710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c004770 tx=0x7f8a6c0a9500 comp rx=0 tx=0).stop 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 shutdown_connections 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560c83264350 0x560c83695380 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c8323b490 0x560c83629710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c83243670 0x560c83629c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 --2- 172.21.15.2:0/2016148073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c83222cd0 0x560c836291d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a56ffd640 0 client.15933 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.760+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 >> 172.21.15.2:0/2016148073 conn(0x560c83258740 msgr2=0x560c8360c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 shutdown_connections 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a8417f740 1 -- 172.21.15.2:0/2016148073 wait complete. 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a8417f740 20 client.15933 trim_cache size 0 max 16384 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "ae485ec2-e173-4061-b0ea-b4326eeb8680", 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:27:45.767 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 msgr2=0x7f8a600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 0x7f8a600b71b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a70009780 comp rx=0 tx=0).stop 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 msgr2=0x7f8a78199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005fd0 tx=0x7f8a6c009e00 comp rx=0 tx=0).stop 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 shutdown_connections 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8a600b4ca0 0x7f8a600b71b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78108160 0x7f8a78199720 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a78108ab0 0x7f8a7819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 --2- 172.21.15.2:0/2467185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a78102820 0x7f8a78199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 >> 172.21.15.2:0/2467185971 conn(0x7f8a780794e0 msgr2=0x7f8a78101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.761+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 shutdown_connections 2024-08-31T04:27:45.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:45.762+0000 7f8a7dc0a640 1 -- 172.21.15.2:0/2467185971 wait complete. 2024-08-31T04:27:46.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:27:46.664 INFO:tasks.workunit.client.0.smithi002.stdout: 1 93436 7.88 MB/sec warmup 66 sec latency 782.141 ms 2024-08-31T04:27:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:47.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:46 smithi002 ceph-mon[18656]: pgmap v409: 129 pgs: 129 active+clean; 65 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-08-31T04:27:47.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:46 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:27:47.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:46 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:46 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:27:47.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:46 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:46 smithi064 ceph-mon[22007]: pgmap v409: 129 pgs: 129 active+clean; 65 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:46 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:46 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:46 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:46 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:46 smithi132 ceph-mon[22335]: pgmap v409: 129 pgs: 129 active+clean; 65 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-08-31T04:27:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:46 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:27:47.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:46 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:46 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:27:47.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:46 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:47.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 96185 8.02 MB/sec warmup 67 sec latency 25.009 ms 2024-08-31T04:27:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 -- 172.21.15.2:0/241107352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 msgr2=0x7fc20c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 --2- 172.21.15.2:0/241107352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c1103c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc204009ca0 tx=0x7fc20402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 -- 172.21.15.2:0/241107352 shutdown_connections 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 --2- 172.21.15.2:0/241107352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c1103c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 --2- 172.21.15.2:0/241107352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 --2- 172.21.15.2:0/241107352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 -- 172.21.15.2:0/241107352 >> 172.21.15.2:0/241107352 conn(0x7fc20c07b5f0 msgr2=0x7fc20c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 -- 172.21.15.2:0/241107352 shutdown_connections 2024-08-31T04:27:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.696+0000 7fc211dd3640 1 -- 172.21.15.2:0/241107352 wait complete. 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 Processor -- start 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 -- start start 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c113850 con 0x7fc20c109b90 2024-08-31T04:27:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1136d0 con 0x7fc20c109240 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.697+0000 7fc211dd3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1139d0 con 0x7fc20c103900 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:40010/0 (socket says 172.21.15.2:40010) 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1221235518 learned_addr learned my addr 172.21.15.2:0/1221235518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20bfff640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1221235518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 msgr2=0x7fc20c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 msgr2=0x7fc20c19fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c19fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1221235518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c1a0190 con 0x7fc20c103900 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20affd640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00e9f0 tx=0x7fc1fc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc208ff9640 1 -- 172.21.15.2:0/1221235518 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00cd80 con 0x7fc20c103900 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc208ff9640 1 -- 172.21.15.2:0/1221235518 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1fc0054d0 con 0x7fc20c103900 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.698+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c1a0480 con 0x7fc20c103900 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.699+0000 7fc208ff9640 1 -- 172.21.15.2:0/1221235518 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc010690 con 0x7fc20c103900 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.699+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c075390 con 0x7fc20c103900 2024-08-31T04:27:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.701+0000 7fc208ff9640 1 -- 172.21.15.2:0/1221235518 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc1fc004e90 con 0x7fc20c103900 2024-08-31T04:27:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.701+0000 7fc218348740 1 Processor -- start 2024-08-31T04:27:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 -- start start 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 0x5616b47d7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b44091b0 0x5616b47d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5616b474e630 con 0x5616b4411390 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5616b473dbc0 con 0x5616b4432070 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc218348740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5616b4741b70 con 0x5616b44091b0 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc208ff9640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 0x7fc1f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 0x5616b47d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 0x5616b47d7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:50200/0 (socket says 172.21.15.2:50200) 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20bfff640 1 -- 172.21.15.2:0/2076785209 learned_addr learned my addr 172.21.15.2:0/2076785209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b44091b0 0x5616b47d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20bfff640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 0x7fc1f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20affd640 1 -- 172.21.15.2:0/2076785209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b44091b0 msgr2=0x5616b47d7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.702+0000 7fc20affd640 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b44091b0 0x5616b47d7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc20affd640 1 -- 172.21.15.2:0/2076785209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 msgr2=0x5616b47d7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc20affd640 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 0x5616b47d7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc20affd640 1 -- 172.21.15.2:0/2076785209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b449d650 con 0x5616b4411390 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc208ff9640 1 -- 172.21.15.2:0/1221235518 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc1fc0e5db0 con 0x7fc20c103900 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc20affd640 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47d7d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06c500 tx=0x7fc2000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d52182d5c4c14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc1f1ffb640 1 -- 172.21.15.2:0/2076785209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200004030 con 0x5616b4411390 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc1f1ffb640 1 -- 172.21.15.2:0/2076785209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000054d0 con 0x5616b4411390 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc20bfff640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 0x7fc1f40b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc20402f500 tx=0x7fc2040095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.703+0000 7fc1f1ffb640 1 -- 172.21.15.2:0/2076785209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200004ce0 con 0x5616b4411390 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 -- 172.21.15.2:0/2076785209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 msgr2=0x5616b47d7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47d7d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06c500 tx=0x7fc2000118d0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 -- 172.21.15.2:0/2076785209 shutdown_connections 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47d7d80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b44091b0 0x5616b47d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 --2- 172.21.15.2:0/2076785209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4432070 0x5616b47d7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 -- 172.21.15.2:0/2076785209 >> 172.21.15.2:0/2076785209 conn(0x5616b4426460 msgr2=0x5616b47d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 -- 172.21.15.2:0/2076785209 shutdown_connections 2024-08-31T04:27:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.704+0000 7fc218348740 1 -- 172.21.15.2:0/2076785209 wait complete. 2024-08-31T04:27:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 -- start start 2024-08-31T04:27:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 Processor -- start 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 0x5616b47e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b4432070 0x5616b47eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5616b45a0700 con 0x5616b44091b0 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5616b46c4700 con 0x5616b4411390 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5616b47e5ae0 con 0x5616b4432070 2024-08-31T04:27:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc218348740 10 client.0 _ll_register_callbacks cb 0x5616b46f3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33702/0 (socket says 172.21.15.2:33702) 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc20b7fe640 1 -- 172.21.15.2:0/3796780756 learned_addr learned my addr 172.21.15.2:0/3796780756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.705+0000 7fc20affd640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 0x5616b47e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20bfff640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b4432070 0x5616b47eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 -- 172.21.15.2:0/3796780756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b4432070 msgr2=0x5616b47eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b4432070 0x5616b47eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 -- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 msgr2=0x5616b47e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 0x5616b47e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 -- 172.21.15.2:0/3796780756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b46fd8b0 con 0x5616b44091b0 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20affd640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 0x5616b47e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0e3140 tx=0x7fc1fc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4284d615b3f42d8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc1eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0abb90 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc1fc0ab2e0 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2000054d0 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1fc005680 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc218348740 10 client.15945 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.706+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5616b47f18d0 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000054d0 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1fc0a79f0 con 0x5616b44091b0 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 10 client.15945 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 20 client.15945 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b43f09f0 0x5616b47f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 4 client.15945 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616b4750580 con 0x5616b43f09f0 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc20affd640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b43f09f0 0x5616b47f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc20affd640 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b43f09f0 0x5616b47f4da0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=298f50ffd9e117ee server_cookie=cd73120545823b8 in_seq=0 out_seq=0 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.707+0000 7fc1eaffd640 10 client.15945 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.708+0000 7fc1eaffd640 1 -- 172.21.15.2:0/3796780756 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616b4750580 con 0x5616b43f09f0 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.708+0000 7fc1eaffd640 10 client.15945 handle_command_reply: tid=0 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.708+0000 7fc218348740 1 client.15945 shutdown 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.708+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 msgr2=0x5616b47e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.708+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0e3140 tx=0x7fc1fc009310 comp rx=0 tx=0).stop 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 shutdown_connections 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b43f09f0 0x5616b47f4da0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc1eaffd640 0 client.15945 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b4432070 0x5616b47eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b4411390 0x5616b47e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 --2- 172.21.15.2:0/3796780756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b44091b0 0x5616b47e29f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 >> 172.21.15.2:0/3796780756 conn(0x5616b4426460 msgr2=0x5616b47da4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 shutdown_connections 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 1 -- 172.21.15.2:0/3796780756 wait complete. 2024-08-31T04:27:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.709+0000 7fc218348740 20 client.15945 trim_cache size 0 max 16384 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.727+0000 7fc218348740 1 Processor -- start 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.727+0000 7fc218348740 1 -- start start 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.727+0000 7fc218348740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.727+0000 7fc218348740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc218348740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc218348740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b59c0 con 0x5616b4411390 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc218348740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b3290 con 0x5616b44091b0 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc218348740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b10e0 con 0x5616b43f09f0 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:50216/0 (socket says 172.21.15.2:50216) 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 -- 172.21.15.2:0/2473996911 learned_addr learned my addr 172.21.15.2:0/2473996911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20bfff640 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 -- 172.21.15.2:0/2473996911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 msgr2=0x5616b47eecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47eecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 -- 172.21.15.2:0/2473996911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 msgr2=0x5616b47e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 -- 172.21.15.2:0/2473996911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b47e3cb0 con 0x5616b44091b0 2024-08-31T04:27:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.728+0000 7fc20affd640 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc200009380 tx=0x7fc2000118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce11b63aa1620046 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.731+0000 7fc1f17fa640 1 -- 172.21.15.2:0/2473996911 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20001d040 con 0x5616b44091b0 2024-08-31T04:27:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.731+0000 7fc1f17fa640 1 -- 172.21.15.2:0/2473996911 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc200030070 con 0x5616b44091b0 2024-08-31T04:27:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.731+0000 7fc1f17fa640 1 -- 172.21.15.2:0/2473996911 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20000f760 con 0x5616b44091b0 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 -- 172.21.15.2:0/2473996911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 msgr2=0x5616b47dfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc200009380 tx=0x7fc2000118d0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 -- 172.21.15.2:0/2473996911 shutdown_connections 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b47e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47dfbe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 --2- 172.21.15.2:0/2473996911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47eecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 -- 172.21.15.2:0/2473996911 >> 172.21.15.2:0/2473996911 conn(0x5616b4426460 msgr2=0x5616b47e1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 -- 172.21.15.2:0/2473996911 shutdown_connections 2024-08-31T04:27:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.732+0000 7fc218348740 1 -- 172.21.15.2:0/2473996911 wait complete. 2024-08-31T04:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.733+0000 7fc218348740 1 -- start start 2024-08-31T04:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.733+0000 7fc218348740 1 Processor -- start 2024-08-31T04:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b485e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b1750 con 0x5616b4411390 2024-08-31T04:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b2bc0 con 0x5616b44091b0 2024-08-31T04:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c1b1e20 con 0x5616b43f09f0 2024-08-31T04:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b485e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:40046/0 (socket says 172.21.15.2:40046) 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc218348740 10 client.0 _ll_register_callbacks cb 0x7fc1fc00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1003298852 learned_addr learned my addr 172.21.15.2:0/1003298852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b485e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33722/0 (socket says 172.21.15.2:33722) 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 msgr2=0x5616b47e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1003298852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 msgr2=0x5616b485e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b485e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.734+0000 7fc20b7fe640 1 -- 172.21.15.2:0/1003298852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b485eb80 con 0x5616b43f09f0 2024-08-31T04:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.735+0000 7fc20b7fe640 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0a8840 tx=0x7fc1fc0a86d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1690793bf3cd1824 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.735+0000 7fc1eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0a7f40 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc1fc0ab4e0 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc200030070 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1fc0abb90 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 10 client.25531 fetch_fsmap learned FSMap version 27 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5616b485fd10 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc200030070 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1fc0b1a80 con 0x5616b43f09f0 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 10 client.25531 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 10 client.25531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 20 client.25531 populate_metadata read hostname 'smithi002' 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b4432070 0x5616b4862370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 4 client.25531 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616b474c020 con 0x5616b4432070 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.739+0000 7fc20affd640 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b4432070 0x5616b4862370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.740+0000 7fc1eaffd640 10 client.25531 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.740+0000 7fc20affd640 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b4432070 0x5616b4862370 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cad30b929ffc3a9 server_cookie=cb8dd89e6cdd1a9a in_seq=0 out_seq=0 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc1eaffd640 1 -- 172.21.15.2:0/1003298852 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x5616b474c020 con 0x5616b4432070 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc1eaffd640 10 client.25531 handle_command_reply: tid=0 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 client.25531 shutdown 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 msgr2=0x5616b47e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0a8840 tx=0x7fc1fc0a86d0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 shutdown_connections 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5616b4432070 0x5616b4862370 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616b4411390 0x5616b485e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc1eaffd640 0 client.25531 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5616b44091b0 0x5616b47e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 --2- 172.21.15.2:0/1003298852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5616b43f09f0 0x5616b47e7130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 >> 172.21.15.2:0/1003298852 conn(0x5616b4426460 msgr2=0x5616b47d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 shutdown_connections 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 1 -- 172.21.15.2:0/1003298852 wait complete. 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.742+0000 7fc218348740 20 client.25531 trim_cache size 0 max 16384 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:27:47.745 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "ae485ec2-e173-4061-b0ea-b4326eeb8680", 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:47.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:47.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:47.748 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 msgr2=0x7fc1f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 0x7fc1f40b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc20402f500 tx=0x7fc2040095c0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 msgr2=0x7fc20c19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00e9f0 tx=0x7fc1fc00edf0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 shutdown_connections 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1f40b4ca0 0x7fc1f40b71b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc20c109b90 0x7fc20c19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc20c109240 0x7fc20c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 --2- 172.21.15.2:0/1221235518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc20c103900 0x7fc20c19a220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 >> 172.21.15.2:0/1221235518 conn(0x7fc20c07b5f0 msgr2=0x7fc20c105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 shutdown_connections 2024-08-31T04:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:27:47.743+0000 7fc211dd3640 1 -- 172.21.15.2:0/1221235518 wait complete. 2024-08-31T04:27:48.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:47 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:27:48.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:47 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:47 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:27:48.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:47 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:47 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:27:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:47 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:27:48.543 INFO:tasks.cephfs.filesystem:scrub status for tag:ae485ec2-e173-4061-b0ea-b4326eeb8680 - {'path': '/', 'tag': 'ae485ec2-e173-4061-b0ea-b4326eeb8680', 'options': 'recursive,force'} 2024-08-31T04:27:48.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 98839 8.09 MB/sec warmup 68 sec latency 38.480 ms 2024-08-31T04:27:49.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:48 smithi064 ceph-mon[22007]: pgmap v410: 129 pgs: 129 active+clean; 67 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-08-31T04:27:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:48 smithi132 ceph-mon[22335]: pgmap v410: 129 pgs: 129 active+clean; 67 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-08-31T04:27:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:48 smithi002 ceph-mon[18656]: pgmap v410: 129 pgs: 129 active+clean; 67 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-08-31T04:27:49.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 101056 8.14 MB/sec warmup 69 sec latency 27.138 ms 2024-08-31T04:27:50.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 103608 8.23 MB/sec warmup 70 sec latency 42.897 ms 2024-08-31T04:27:51.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:50 smithi064 ceph-mon[22007]: pgmap v411: 129 pgs: 129 active+clean; 67 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 125 op/s 2024-08-31T04:27:51.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:50 smithi132 ceph-mon[22335]: pgmap v411: 129 pgs: 129 active+clean; 67 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 125 op/s 2024-08-31T04:27:51.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:50 smithi002 ceph-mon[18656]: pgmap v411: 129 pgs: 129 active+clean; 67 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 125 op/s 2024-08-31T04:27:51.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 106687 8.37 MB/sec warmup 71 sec latency 18.134 ms 2024-08-31T04:27:52.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 109474 8.43 MB/sec warmup 72 sec latency 27.608 ms 2024-08-31T04:27:53.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:52 smithi064 ceph-mon[22007]: pgmap v412: 129 pgs: 129 active+clean; 70 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-08-31T04:27:53.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:52 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:27:53.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:52 smithi132 ceph-mon[22335]: pgmap v412: 129 pgs: 129 active+clean; 70 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-08-31T04:27:53.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:52 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:27:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:52 smithi002 ceph-mon[18656]: pgmap v412: 129 pgs: 129 active+clean; 70 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-08-31T04:27:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:52 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:27:53.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 111252 8.44 MB/sec warmup 73 sec latency 65.230 ms 2024-08-31T04:27:54.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:53 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:27:54.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:53 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:27:54.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:53 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:27:54.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 114165 8.55 MB/sec warmup 74 sec latency 28.152 ms 2024-08-31T04:27:55.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:54 smithi064 ceph-mon[22007]: pgmap v413: 129 pgs: 129 active+clean; 74 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-08-31T04:27:55.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:54 smithi132 ceph-mon[22335]: pgmap v413: 129 pgs: 129 active+clean; 74 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-08-31T04:27:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:54 smithi002 ceph-mon[18656]: pgmap v413: 129 pgs: 129 active+clean; 74 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-08-31T04:27:55.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 117316 8.69 MB/sec warmup 75 sec latency 9.049 ms 2024-08-31T04:27:56.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 120089 8.74 MB/sec warmup 76 sec latency 28.006 ms 2024-08-31T04:27:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:56 smithi064 ceph-mon[22007]: pgmap v414: 129 pgs: 129 active+clean; 75 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 209 op/s 2024-08-31T04:27:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:56 smithi132 ceph-mon[22335]: pgmap v414: 129 pgs: 129 active+clean; 75 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 209 op/s 2024-08-31T04:27:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:56 smithi002 ceph-mon[18656]: pgmap v414: 129 pgs: 129 active+clean; 75 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 209 op/s 2024-08-31T04:27:57.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 122208 8.78 MB/sec warmup 77 sec latency 42.147 ms 2024-08-31T04:27:58.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 124608 8.85 MB/sec warmup 78 sec latency 89.198 ms 2024-08-31T04:27:59.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:27:58 smithi064 ceph-mon[22007]: pgmap v415: 129 pgs: 129 active+clean; 79 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-08-31T04:27:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:27:58 smithi132 ceph-mon[22335]: pgmap v415: 129 pgs: 129 active+clean; 79 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-08-31T04:27:59.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:27:58 smithi002 ceph-mon[18656]: pgmap v415: 129 pgs: 129 active+clean; 79 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-08-31T04:27:59.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 127726 8.96 MB/sec warmup 79 sec latency 24.987 ms 2024-08-31T04:28:00.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128335 8.87 MB/sec warmup 80 sec latency 553.284 ms 2024-08-31T04:28:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:00 smithi064 ceph-mon[22007]: pgmap v416: 129 pgs: 129 active+clean; 79 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-08-31T04:28:01.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:00 smithi132 ceph-mon[22335]: pgmap v416: 129 pgs: 129 active+clean; 79 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-08-31T04:28:01.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:00 smithi002 ceph-mon[18656]: pgmap v416: 129 pgs: 129 active+clean; 79 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-08-31T04:28:01.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128335 8.76 MB/sec warmup 81 sec latency 1553.360 ms 2024-08-31T04:28:02.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:02.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:02.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:02.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:28:02.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:02.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:02.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:02.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:28:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:28:02.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128335 8.65 MB/sec warmup 82 sec latency 2553.470 ms 2024-08-31T04:28:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:02 smithi064 ceph-mon[22007]: pgmap v417: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-08-31T04:28:03.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:02 smithi132 ceph-mon[22335]: pgmap v417: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-08-31T04:28:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:02 smithi002 ceph-mon[18656]: pgmap v417: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-08-31T04:28:03.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128335 8.55 MB/sec warmup 83 sec latency 3553.585 ms 2024-08-31T04:28:04.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128762 8.47 MB/sec warmup 84 sec latency 3634.815 ms 2024-08-31T04:28:05.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:04 smithi064 ceph-mon[22007]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 288 op/s 2024-08-31T04:28:05.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:04 smithi132 ceph-mon[22335]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 288 op/s 2024-08-31T04:28:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:04 smithi002 ceph-mon[18656]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 288 op/s 2024-08-31T04:28:05.665 INFO:tasks.workunit.client.0.smithi002.stdout: 1 131537 8.57 MB/sec warmup 85 sec latency 53.679 ms 2024-08-31T04:28:06.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 134205 8.62 MB/sec warmup 86 sec latency 43.603 ms 2024-08-31T04:28:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:06 smithi064 ceph-mon[22007]: pgmap v419: 129 pgs: 129 active+clean; 85 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 218 op/s 2024-08-31T04:28:07.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:06 smithi132 ceph-mon[22335]: pgmap v419: 129 pgs: 129 active+clean; 85 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 218 op/s 2024-08-31T04:28:07.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:06 smithi002 ceph-mon[18656]: pgmap v419: 129 pgs: 129 active+clean; 85 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 218 op/s 2024-08-31T04:28:07.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 136379 8.65 MB/sec warmup 87 sec latency 29.782 ms 2024-08-31T04:28:08.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 138936 8.71 MB/sec warmup 88 sec latency 16.477 ms 2024-08-31T04:28:09.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:08 smithi064 ceph-mon[22007]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-31T04:28:09.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:08 smithi132 ceph-mon[22335]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-31T04:28:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:08 smithi002 ceph-mon[18656]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-31T04:28:09.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 142044 8.82 MB/sec warmup 89 sec latency 47.080 ms 2024-08-31T04:28:10.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 144506 8.82 MB/sec warmup 90 sec latency 40.258 ms 2024-08-31T04:28:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:10 smithi064 ceph-mon[22007]: pgmap v421: 129 pgs: 129 active+clean; 87 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:11.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:10 smithi132 ceph-mon[22335]: pgmap v421: 129 pgs: 129 active+clean; 87 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:10 smithi002 ceph-mon[18656]: pgmap v421: 129 pgs: 129 active+clean; 87 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:11.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 146717 8.87 MB/sec warmup 91 sec latency 30.682 ms 2024-08-31T04:28:12.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 149571 8.96 MB/sec warmup 92 sec latency 19.147 ms 2024-08-31T04:28:13.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:12 smithi064 ceph-mon[22007]: pgmap v422: 129 pgs: 129 active+clean; 88 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 211 op/s 2024-08-31T04:28:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:12 smithi132 ceph-mon[22335]: pgmap v422: 129 pgs: 129 active+clean; 88 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 211 op/s 2024-08-31T04:28:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:12 smithi002 ceph-mon[18656]: pgmap v422: 129 pgs: 129 active+clean; 88 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 211 op/s 2024-08-31T04:28:13.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 152621 9.05 MB/sec warmup 93 sec latency 27.987 ms 2024-08-31T04:28:14.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 155145 9.06 MB/sec warmup 94 sec latency 30.015 ms 2024-08-31T04:28:15.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:14 smithi064 ceph-mon[22007]: pgmap v423: 129 pgs: 129 active+clean; 95 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-08-31T04:28:15.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:14 smithi132 ceph-mon[22335]: pgmap v423: 129 pgs: 129 active+clean; 95 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-08-31T04:28:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:14 smithi002 ceph-mon[18656]: pgmap v423: 129 pgs: 129 active+clean; 95 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-08-31T04:28:15.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 157510 9.13 MB/sec warmup 95 sec latency 26.348 ms 2024-08-31T04:28:16.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 160323 9.18 MB/sec warmup 96 sec latency 25.152 ms 2024-08-31T04:28:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:16 smithi064 ceph-mon[22007]: pgmap v424: 129 pgs: 129 active+clean; 95 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 205 op/s 2024-08-31T04:28:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:16 smithi132 ceph-mon[22335]: pgmap v424: 129 pgs: 129 active+clean; 95 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 205 op/s 2024-08-31T04:28:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:16 smithi002 ceph-mon[18656]: pgmap v424: 129 pgs: 129 active+clean; 95 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 205 op/s 2024-08-31T04:28:17.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 163343 9.27 MB/sec warmup 97 sec latency 10.295 ms 2024-08-31T04:28:18.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:28:18.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 165323 9.25 MB/sec warmup 98 sec latency 58.078 ms 2024-08-31T04:28:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:18.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:18 smithi002 ceph-mon[18656]: pgmap v425: 129 pgs: 129 active+clean; 103 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 280 op/s 2024-08-31T04:28:19.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:18 smithi064 ceph-mon[22007]: pgmap v425: 129 pgs: 129 active+clean; 103 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 280 op/s 2024-08-31T04:28:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:18 smithi132 ceph-mon[22335]: pgmap v425: 129 pgs: 129 active+clean; 103 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 280 op/s 2024-08-31T04:28:19.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 -- 172.21.15.2:0/3387973298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 msgr2=0x7fadc01100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 --2- 172.21.15.2:0/3387973298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc01100d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009ca0 tx=0x7fadb802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 -- 172.21.15.2:0/3387973298 shutdown_connections 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 --2- 172.21.15.2:0/3387973298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc01100d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 --2- 172.21.15.2:0/3387973298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc01050b0 0x7fadc010d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 --2- 172.21.15.2:0/3387973298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc0104680 0x7fadc0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 -- 172.21.15.2:0/3387973298 >> 172.21.15.2:0/3387973298 conn(0x7fadc0079500 msgr2=0x7fadc0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 -- 172.21.15.2:0/3387973298 shutdown_connections 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.567+0000 7fadc7752640 1 -- 172.21.15.2:0/3387973298 wait complete. 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 Processor -- start 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 -- start start 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc0104680 0x7fadc019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01138b0 con 0x7fadc010dc30 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc0113730 con 0x7fadc01050b0 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc7752640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fadc0113a30 con 0x7fadc0104680 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36436/0 (socket says 172.21.15.2:36436) 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc5cef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc4ced640 1 -- 172.21.15.2:0/336389049 learned_addr learned my addr 172.21.15.2:0/336389049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.568+0000 7fadc54ee640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc0104680 0x7fadc019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 -- 172.21.15.2:0/336389049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc0104680 msgr2=0x7fadc019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc0104680 0x7fadc019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 -- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 msgr2=0x7fadc019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 -- 172.21.15.2:0/336389049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc01a02b0 con 0x7fadc01050b0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc4ced640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e9c0 tx=0x7fadb000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadb67fc640 1 -- 172.21.15.2:0/336389049 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000ccc0 con 0x7fadc01050b0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc01a05a0 con 0x7fadc01050b0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadb67fc640 1 -- 172.21.15.2:0/336389049 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb00054d0 con 0x7fadc01050b0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadb67fc640 1 -- 172.21.15.2:0/336389049 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0010430 con 0x7fadc01050b0 2024-08-31T04:28:19.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.569+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc01a6d00 con 0x7fadc01050b0 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 Processor -- start 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadb67fc640 1 -- 172.21.15.2:0/336389049 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fadb0005020 con 0x7fadc01050b0 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 -- start start 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961c97d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c961c0e630 con 0x55c9618d1390 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c961bfdbc0 con 0x55c9618f2070 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c961c01b70 con 0x55c9618c91b0 2024-08-31T04:28:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc5cef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc54ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961c97d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc5cef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36452/0 (socket says 172.21.15.2:36452) 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc5cef640 1 -- 172.21.15.2:0/4156237257 learned_addr learned my addr 172.21.15.2:0/4156237257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.572+0000 7fadc54ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33076/0 (socket says 172.21.15.2:33076) 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 -- 172.21.15.2:0/4156237257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 msgr2=0x55c961c97840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 -- 172.21.15.2:0/4156237257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 msgr2=0x55c961c97d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961c97d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 -- 172.21.15.2:0/4156237257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c96195d650 con 0x55c9618f2070 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc54ee640 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadb67fc640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 0x7fadac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009ca0 tx=0x7fadb8009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad47e367e05d035 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadc54ee640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 0x7fadac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadb67fc640 1 -- 172.21.15.2:0/336389049 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadb00e5c20 con 0x7fadc01050b0 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadab7fe640 1 -- 172.21.15.2:0/4156237257 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8031cf0 con 0x55c9618f2070 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadab7fe640 1 -- 172.21.15.2:0/4156237257 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb8036030 con 0x55c9618f2070 2024-08-31T04:28:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.573+0000 7fadab7fe640 1 -- 172.21.15.2:0/4156237257 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80042a0 con 0x55c9618f2070 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4156237257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 msgr2=0x55c961c97300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009ca0 tx=0x7fadb8009430 comp rx=0 tx=0).stop 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadc54ee640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 0x7fadac0b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55c961c95f80 tx=0x7fadbc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4156237257 shutdown_connections 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961c97d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618c91b0 0x55c961c97840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4156237257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618f2070 0x55c961c97300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4156237257 >> 172.21.15.2:0/4156237257 conn(0x55c9618e6460 msgr2=0x55c961c951f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4156237257 shutdown_connections 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.574+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4156237257 wait complete. 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 -- start start 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 Processor -- start 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618c91b0 0x55c961ca2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 0x55c961cb3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c961a60700 con 0x55c9618d1390 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c961b84700 con 0x55c9618c91b0 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c961ca9d10 con 0x55c9618f2070 2024-08-31T04:28:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadcdcc7740 10 client.0 _ll_register_callbacks cb 0x55c961bb3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.575+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 0x55c961cb3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44034/0 (socket says 172.21.15.2:44034) 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc4ced640 1 -- 172.21.15.2:0/4078500260 learned_addr learned my addr 172.21.15.2:0/4078500260 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc54ee640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618c91b0 0x55c961ca2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 -- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618c91b0 msgr2=0x55c961ca2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618c91b0 0x55c961ca2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 -- 172.21.15.2:0/4078500260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 msgr2=0x55c961ca2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 -- 172.21.15.2:0/4078500260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c961bbd8b0 con 0x55c9618f2070 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc4ced640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadc5cef640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 0x55c961cb3030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadb802aeb0 tx=0x7fadb80094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d07d108c46fef3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fada8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb804a040 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb8036030 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.576+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadb8031650 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadb8003970 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 10 client.25543 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c961cb5b40 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb8036030 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fadb804d030 con 0x55c9618f2070 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 10 client.25543 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 10 client.25543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 20 client.25543 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618b09f0 0x55c961cb8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 4 client.25543 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.577+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c961c10580 con 0x55c9618b09f0 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.578+0000 7fadc54ee640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618b09f0 0x55c961cb8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.578+0000 7fadc54ee640 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618b09f0 0x55c961cb8ea0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a09a405b5b93a91 server_cookie=df7976b7c0dfeee8 in_seq=0 out_seq=0 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.578+0000 7fada8ff9640 10 client.25543 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fada8ff9640 1 -- 172.21.15.2:0/4078500260 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c961c10580 con 0x55c9618b09f0 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fada8ff9640 10 client.25543 handle_command_reply: tid=0 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 client.25543 shutdown 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 msgr2=0x55c961cb3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 0x55c961cb3030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadb802aeb0 tx=0x7fadb80094a0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 shutdown_connections 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618b09f0 0x55c961cb8ea0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618d1390 0x55c961ca2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618f2070 0x55c961cb3030 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fada8ff9640 0 client.25543 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/4078500260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618c91b0 0x55c961ca2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 >> 172.21.15.2:0/4078500260 conn(0x55c9618e6460 msgr2=0x55c961c9a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 shutdown_connections 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 1 -- 172.21.15.2:0/4078500260 wait complete. 2024-08-31T04:28:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.579+0000 7fadcdcc7740 20 client.25543 trim_cache size 0 max 16384 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 Processor -- start 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 -- start start 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618b09f0 0x55c961c98a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 0x55c961c9fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01b1590 con 0x55c9618c91b0 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01aee60 con 0x55c9618b09f0 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01accb0 con 0x55c9618d1390 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.598+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44048/0 (socket says 172.21.15.2:44048) 2024-08-31T04:28:19.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc5cef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 0x55c961c9fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 -- 172.21.15.2:0/2163386850 learned_addr learned my addr 172.21.15.2:0/2163386850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc54ee640 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618b09f0 0x55c961c98a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 -- 172.21.15.2:0/2163386850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 msgr2=0x55c961c9fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 0x55c961c9fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 -- 172.21.15.2:0/2163386850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618b09f0 msgr2=0x55c961c98a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618b09f0 0x55c961c98a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 -- 172.21.15.2:0/2163386850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c961c99b10 con 0x55c9618c91b0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc5cef640 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 0x55c961c9fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadc4ced640 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fadb00e2ef0 tx=0x7fadb0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d88d2b12d5f32c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadaaffd640 1 -- 172.21.15.2:0/2163386850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb00ab840 con 0x55c9618c91b0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadaaffd640 1 -- 172.21.15.2:0/2163386850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb0005310 con 0x55c9618c91b0 2024-08-31T04:28:19.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.599+0000 7fadaaffd640 1 -- 172.21.15.2:0/2163386850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000ce60 con 0x55c9618c91b0 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- 172.21.15.2:0/2163386850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 msgr2=0x55c961cb2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fadb00e2ef0 tx=0x7fadb0009310 comp rx=0 tx=0).stop 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- 172.21.15.2:0/2163386850 shutdown_connections 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cb2fa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618d1390 0x55c961c9fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/2163386850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618b09f0 0x55c961c98a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- 172.21.15.2:0/2163386850 >> 172.21.15.2:0/2163386850 conn(0x55c9618e6460 msgr2=0x55c961c98330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- 172.21.15.2:0/2163386850 shutdown_connections 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- 172.21.15.2:0/2163386850 wait complete. 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 -- start start 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.601+0000 7fadcdcc7740 1 Processor -- start 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 0x55c961cba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618d1390 0x55c961d22620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01ad320 con 0x55c9618c91b0 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01ae790 con 0x55c9618d1390 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01ad9f0 con 0x55c9618b09f0 2024-08-31T04:28:19.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadcdcc7740 10 client.0 _ll_register_callbacks cb 0x7fadb00e9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc4ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44054/0 (socket says 172.21.15.2:44054) 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 0x55c961cba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc4ced640 1 -- 172.21.15.2:0/1057996879 learned_addr learned my addr 172.21.15.2:0/1057996879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc5cef640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618d1390 0x55c961d22620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 -- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618d1390 msgr2=0x55c961d22620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618d1390 0x55c961d22620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 -- 172.21.15.2:0/1057996879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 msgr2=0x55c961cbad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc54ee640 1 -- 172.21.15.2:0/1057996879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c961d22c90 con 0x55c9618b09f0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.602+0000 7fadc4ced640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fadc54ee640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 0x55c961cba750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c961ca5300 tx=0x7fadbc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f97bc3fa76e013 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:19.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fada8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01de50 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadbc02b400 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c961c0c020 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadbc03e050 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fadcdcc7740 10 client.25549 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.603+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c961d23f80 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c961c0c020 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fadbc0307c0 con 0x55c9618b09f0 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 10 client.25549 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 10 client.25549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 20 client.25549 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618f2070 0x55c961d26770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:19.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 4 client.25549 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c961c09760 con 0x55c9618f2070 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadc4ced640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618f2070 0x55c961d26770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 10 client.25549 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadc4ced640 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618f2070 0x55c961d26770 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08242ef4deafc0a server_cookie=73b368ae406f4cde in_seq=0 out_seq=0 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 1 -- 172.21.15.2:0/1057996879 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55c961c09760 con 0x55c9618f2070 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 10 client.25549 handle_command_reply: tid=0 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 client.25549 shutdown 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 msgr2=0x55c961cba750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 0x55c961cba750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c961ca5300 tx=0x7fadbc0046c0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 shutdown_connections 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55c9618f2070 0x55c961d26770 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9618c91b0 0x55c961cbad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c9618d1390 0x55c961d22620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 --2- 172.21.15.2:0/1057996879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c9618b09f0 0x55c961cba750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 >> 172.21.15.2:0/1057996879 conn(0x55c9618e6460 msgr2=0x55c961c98cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.605+0000 7fada8ff9640 0 client.25549 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.606+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 shutdown_connections 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.606+0000 7fadcdcc7740 1 -- 172.21.15.2:0/1057996879 wait complete. 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.606+0000 7fadcdcc7740 20 client.25549 trim_cache size 0 max 16384 2024-08-31T04:28:19.613 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:19.614 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:19.615 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:28:19.616 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 msgr2=0x7fadac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 0x7fadac0b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55c961c95f80 tx=0x7fadbc005f90 comp rx=0 tx=0).stop 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 msgr2=0x7fadc019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e9c0 tx=0x7fadb000ee80 comp rx=0 tx=0).stop 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 shutdown_connections 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadac0b4ca0 0x7fadac0b71b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc010dc30 0x7fadc019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01050b0 0x7fadc019a8e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 --2- 172.21.15.2:0/336389049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadc0104680 0x7fadc019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:19.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 >> 172.21.15.2:0/336389049 conn(0x7fadc0079500 msgr2=0x7fadc01004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:19.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 shutdown_connections 2024-08-31T04:28:19.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:19.607+0000 7fadc7752640 1 -- 172.21.15.2:0/336389049 wait complete. 2024-08-31T04:28:19.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 167487 9.29 MB/sec warmup 99 sec latency 40.561 ms 2024-08-31T04:28:20.446 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:28:20.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:28:20.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 170570 9.39 MB/sec warmup 100 sec latency 13.156 ms 2024-08-31T04:28:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:21.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:20 smithi064 ceph-mon[22007]: pgmap v426: 129 pgs: 129 active+clean; 104 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:21.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:20 smithi132 ceph-mon[22335]: pgmap v426: 129 pgs: 129 active+clean; 104 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:21.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:20 smithi002 ceph-mon[18656]: pgmap v426: 129 pgs: 129 active+clean; 104 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2024-08-31T04:28:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/3222793230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 msgr2=0x7fe1e010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/3222793230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e010f2c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009900 tx=0x7fe1d802a410 comp rx=0 tx=0).stop 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/3222793230 shutdown_connections 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/3222793230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e010f2c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/3222793230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 0x7fe1e0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/3222793230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/3222793230 >> 172.21.15.2:0/3222793230 conn(0x7fe1e00794d0 msgr2=0x7fe1e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/3222793230 shutdown_connections 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.190+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/3222793230 wait complete. 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.191+0000 7fe1e5bf0640 1 Processor -- start 2024-08-31T04:28:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.191+0000 7fe1e5bf0640 1 -- start start 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e00ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 0x7fe1e00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e00ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0112710 con 0x7fe1e0108a90 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0112590 con 0x7fe1e0108140 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1e5bf0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0112890 con 0x7fe1e0102800 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e00ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e00ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e00ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44072/0 (socket says 172.21.15.2:44072) 2024-08-31T04:28:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1dffff640 1 -- 172.21.15.2:0/1224214530 learned_addr learned my addr 172.21.15.2:0/1224214530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1deffd640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 0x7fe1e00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 -- 172.21.15.2:0/1224214530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 msgr2=0x7fe1e00ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 0x7fe1e00ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 -- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 msgr2=0x7fe1e00ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e00ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 -- 172.21.15.2:0/1224214530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e01a8490 con 0x7fe1e0102800 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1df7fe640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e00ff410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000e9f0 tx=0x7fe1d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.192+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000ccc0 con 0x7fe1e0102800 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.193+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e01a8780 con 0x7fe1e0102800 2024-08-31T04:28:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.193+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d0005020 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.193+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004a00 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.193+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01a8cc0 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.193+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e0102c10 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.195+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe1d0004ba0 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.196+0000 7fe1dcff9640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 0x7fe1c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.196+0000 7fe1deffd640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 0x7fe1c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.196+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe1d00e59c0 con 0x7fe1e0102800 2024-08-31T04:28:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.196+0000 7fe1deffd640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 0x7fe1c80b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0102350 tx=0x7fe1d4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.199+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe1d00ac3c0 con 0x7fe1e0102800 2024-08-31T04:28:21.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.435+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1e0100710 con 0x7fe1e0102800 2024-08-31T04:28:21.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.436+0000 7fe1dcff9640 1 -- 172.21.15.2:0/1224214530 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11898 (secure 0 0 0) 0x7fe1d00abcc0 con 0x7fe1e0102800 2024-08-31T04:28:21.438 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:28:21.438 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-08-31T04:26:43:286328+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:26:42.517875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:28:21.438 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-08-31T04:28:21.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 msgr2=0x7fe1c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 0x7fe1c80b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0102350 tx=0x7fe1d4009500 comp rx=0 tx=0).stop 2024-08-31T04:28:21.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 msgr2=0x7fe1e00ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e00ff410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000e9f0 tx=0x7fe1d000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 shutdown_connections 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe1c80b4ca0 0x7fe1c80b71b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e0108a90 0x7fe1e00ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e0108140 0x7fe1e00ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 --2- 172.21.15.2:0/1224214530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e0102800 0x7fe1e00ff410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 >> 172.21.15.2:0/1224214530 conn(0x7fe1e00794d0 msgr2=0x7fe1e006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 shutdown_connections 2024-08-31T04:28:21.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:21.439+0000 7fe1e5bf0640 1 -- 172.21.15.2:0/1224214530 wait complete. 2024-08-31T04:28:21.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 173274 9.42 MB/sec warmup 101 sec latency 33.360 ms 2024-08-31T04:28:22.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:21 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1224214530' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:28:22.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:21 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1224214530' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:28:22.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:21 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1224214530' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:28:22.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 175315 9.44 MB/sec warmup 102 sec latency 26.571 ms 2024-08-31T04:28:22.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:28:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:22 smithi064 ceph-mon[22007]: pgmap v427: 129 pgs: 129 active+clean; 109 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-08-31T04:28:23.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:22 smithi132 ceph-mon[22335]: pgmap v427: 129 pgs: 129 active+clean; 109 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-08-31T04:28:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:22 smithi002 ceph-mon[18656]: pgmap v427: 129 pgs: 129 active+clean; 109 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1033951397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a70075550 msgr2=0x7f0a70075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1033951397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a70075550 0x7f0a70075960 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009900 tx=0x7f0a6c02a410 comp rx=0 tx=0).stop 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1033951397 shutdown_connections 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1033951397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a7010fe70 0x7f0a701122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1033951397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 0x7f0a7010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1033951397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a70075550 0x7f0a70075960 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.563+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1033951397 >> 172.21.15.2:0/1033951397 conn(0x7f0a700ff380 msgr2=0x7f0a701017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.564+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1033951397 shutdown_connections 2024-08-31T04:28:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.564+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1033951397 wait complete. 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.564+0000 7f0a77c7d640 1 Processor -- start 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 -- start start 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 0x7f0a7019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7010fe70 0x7f0a701a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70115a20 con 0x7f0a7010fe70 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701158a0 con 0x7f0a70075ea0 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a77c7d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70115ba0 con 0x7f0a70075550 2024-08-31T04:28:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a75a19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a75a19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33122/0 (socket says 172.21.15.2:33122) 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a75a19640 1 -- 172.21.15.2:0/1902058920 learned_addr learned my addr 172.21.15.2:0/1902058920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.565+0000 7f0a75218640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 0x7f0a7019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a7621a640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7010fe70 0x7f0a701a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a75a19640 1 -- 172.21.15.2:0/1902058920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 msgr2=0x7f0a7019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a75a19640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 0x7f0a7019c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a75a19640 1 -- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7010fe70 msgr2=0x7f0a701a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a75a19640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7010fe70 0x7f0a701a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.566+0000 7f0a75a19640 1 -- 172.21.15.2:0/1902058920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a701a2320 con 0x7f0a70075550 2024-08-31T04:28:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.567+0000 7f0a75a19640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005940 tx=0x7f0a6c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.568+0000 7f0a66ffd640 1 -- 172.21.15.2:0/1902058920 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c03f030 con 0x7f0a70075550 2024-08-31T04:28:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.568+0000 7f0a66ffd640 1 -- 172.21.15.2:0/1902058920 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a6c0044c0 con 0x7f0a70075550 2024-08-31T04:28:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.568+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a701a25b0 con 0x7f0a70075550 2024-08-31T04:28:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.568+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a701a8d70 con 0x7f0a70075550 2024-08-31T04:28:23.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.569+0000 7f0a66ffd640 1 -- 172.21.15.2:0/1902058920 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c035070 con 0x7f0a70075550 2024-08-31T04:28:23.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.572+0000 7f0a7e1f2740 1 Processor -- start 2024-08-31T04:28:23.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 -- start start 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8901b0 0x55fbffc670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff898390 0x55fbffc675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbffbd5680 con 0x55fbff8901b0 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fbffbc4c10 con 0x55fbff898390 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.573+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fbffbc8bc0 con 0x55fbff8b9070 2024-08-31T04:28:23.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33128/0 (socket says 172.21.15.2:33128) 2024-08-31T04:28:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 -- 172.21.15.2:0/92044520 learned_addr learned my addr 172.21.15.2:0/92044520 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 -- 172.21.15.2:0/92044520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff898390 msgr2=0x55fbffc675e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff898390 0x55fbffc675e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 -- 172.21.15.2:0/92044520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8901b0 msgr2=0x55fbffc670a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8901b0 0x55fbffc670a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.574+0000 7f0a7621a640 1 -- 172.21.15.2:0/92044520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbff924650 con 0x55fbff8b9070 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.575+0000 7f0a66ffd640 1 -- 172.21.15.2:0/1902058920 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0a6c042030 con 0x7f0a70075550 2024-08-31T04:28:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.575+0000 7f0a7621a640 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009fd0 tx=0x7f0a680118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54c7ddbb483e6843 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.576+0000 7f0a5bfff640 1 -- 172.21.15.2:0/92044520 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004d20 con 0x55fbff8b9070 2024-08-31T04:28:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.576+0000 7f0a66ffd640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 0x7f0a5c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.576+0000 7f0a5bfff640 1 -- 172.21.15.2:0/92044520 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a68004050 con 0x55fbff8b9070 2024-08-31T04:28:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.576+0000 7f0a66ffd640 1 -- 172.21.15.2:0/1902058920 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0a6c105c00 con 0x7f0a70075550 2024-08-31T04:28:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.576+0000 7f0a5bfff640 1 -- 172.21.15.2:0/92044520 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68005280 con 0x55fbff8b9070 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/92044520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 msgr2=0x55fbffc66b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009fd0 tx=0x7f0a680118d0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a75a19640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 0x7f0a5c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/92044520 shutdown_connections 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8901b0 0x55fbffc670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff898390 0x55fbffc675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/92044520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc66b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/92044520 >> 172.21.15.2:0/92044520 conn(0x55fbff8ad460 msgr2=0x55fbffc64a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/92044520 shutdown_connections 2024-08-31T04:28:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.577+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/92044520 wait complete. 2024-08-31T04:28:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.578+0000 7f0a75a19640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 0x7f0a5c0b7380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fbffc657e0 tx=0x7f0a6c0092d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.578+0000 7f0a7e1f2740 1 -- start start 2024-08-31T04:28:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.578+0000 7f0a7e1f2740 1 Processor -- start 2024-08-31T04:28:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8b9070 0x55fbffc7e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbffa27700 con 0x55fbff8b9070 2024-08-31T04:28:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fbffb4b750 con 0x55fbff8901b0 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fbffc753e0 con 0x55fbff898390 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.579+0000 7f0a7e1f2740 10 client.0 _ll_register_callbacks cb 0x55fbffb7ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33136/0 (socket says 172.21.15.2:33136) 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 -- 172.21.15.2:0/3034094974 learned_addr learned my addr 172.21.15.2:0/3034094974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8b9070 0x55fbffc7e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 -- 172.21.15.2:0/3034094974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 msgr2=0x55fbffc72250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 -- 172.21.15.2:0/3034094974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8b9070 msgr2=0x55fbffc7e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8b9070 0x55fbffc7e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.580+0000 7f0a75218640 1 -- 172.21.15.2:0/3034094974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbffb84900 con 0x55fbff898390 2024-08-31T04:28:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.581+0000 7f0a75218640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a600116f0 tx=0x7f0a60011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c891fce4ae9ea0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.581+0000 7f0a597fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.581+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000fd90 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.581+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a68004050 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.581+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0a60004030 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a60024050 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a7e1f2740 10 client.25567 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbffc81220 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a60004230 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0a60011ce0 con 0x55fbff898390 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a7e1f2740 10 client.25567 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.582+0000 7f0a7e1f2740 10 client.25567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:28:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.583+0000 7f0a7e1f2740 20 client.25567 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.583+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff8779f0 0x55fbffc84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.583+0000 7f0a7e1f2740 4 client.25567 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.583+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0a68004050 con 0x55fbff8779f0 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.583+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff8779f0 0x55fbffc84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.585+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff8779f0 0x55fbffc84770 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf7caecb277f7aef server_cookie=619f50123e080795 in_seq=0 out_seq=0 2024-08-31T04:28:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.585+0000 7f0a597fa640 10 client.25567 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:28:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.586+0000 7f0a597fa640 1 -- 172.21.15.2:0/3034094974 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0a68004050 con 0x55fbff8779f0 2024-08-31T04:28:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.586+0000 7f0a597fa640 10 client.25567 handle_command_reply: tid=0 2024-08-31T04:28:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.586+0000 7f0a7e1f2740 1 client.25567 shutdown 2024-08-31T04:28:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.586+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 msgr2=0x55fbffc72790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.586+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a600116f0 tx=0x7f0a60011bb0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 shutdown_connections 2024-08-31T04:28:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff8779f0 0x55fbffc84770 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff8b9070 0x55fbffc7e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff898390 0x55fbffc72790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3034094974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a597fa640 0 client.25567 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 >> 172.21.15.2:0/3034094974 conn(0x55fbff8ad460 msgr2=0x55fbffc69cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 shutdown_connections 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.588+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3034094974 wait complete. 2024-08-31T04:28:23.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.589+0000 7f0a7e1f2740 20 client.25567 trim_cache size 0 max 16384 2024-08-31T04:28:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.614+0000 7f0a7e1f2740 1 Processor -- start 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.614+0000 7f0a7e1f2740 1 -- start start 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc7e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc6f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701b1550 con 0x55fbff898390 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701aee20 con 0x55fbff8901b0 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701acd10 con 0x55fbff8b9070 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36540/0 (socket says 172.21.15.2:36540) 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 -- 172.21.15.2:0/237004269 learned_addr learned my addr 172.21.15.2:0/237004269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc6f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a75218640 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc7e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 -- 172.21.15.2:0/237004269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 msgr2=0x55fbffc6f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc6f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 -- 172.21.15.2:0/237004269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 msgr2=0x55fbffc7e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc7e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.615+0000 7f0a7621a640 1 -- 172.21.15.2:0/237004269 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbffc73510 con 0x55fbff8901b0 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.616+0000 7f0a7621a640 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009560 tx=0x7f0a680118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49301b9dc60ae5b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.616+0000 7f0a5b7fe640 1 -- 172.21.15.2:0/237004269 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68003c30 con 0x55fbff8901b0 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.616+0000 7f0a5b7fe640 1 -- 172.21.15.2:0/237004269 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a68003dd0 con 0x55fbff8901b0 2024-08-31T04:28:23.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.616+0000 7f0a5b7fe640 1 -- 172.21.15.2:0/237004269 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680286b0 con 0x55fbff8901b0 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/237004269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 msgr2=0x55fbffc72710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009560 tx=0x7f0a680118d0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/237004269 shutdown_connections 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc7e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8b9070 0x55fbffc6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/237004269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8901b0 0x55fbffc72710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/237004269 >> 172.21.15.2:0/237004269 conn(0x55fbff8ad460 msgr2=0x55fbffc72000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/237004269 shutdown_connections 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.617+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/237004269 wait complete. 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 -- start start 2024-08-31T04:28:23.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 Processor -- start 2024-08-31T04:28:23.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8901b0 0x55fbffc7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 0x55fbffc76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ad360 con 0x55fbff898390 2024-08-31T04:28:23.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ae750 con 0x55fbff8b9070 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ad9b0 con 0x55fbff8901b0 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7e1f2740 10 client.0 _ll_register_callbacks cb 0x7f0a600097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a75218640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a7621a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 0x55fbffc76920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a75218640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44112/0 (socket says 172.21.15.2:44112) 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.618+0000 7f0a75218640 1 -- 172.21.15.2:0/3702361749 learned_addr learned my addr 172.21.15.2:0/3702361749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8901b0 0x55fbffc7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 -- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8901b0 msgr2=0x55fbffc7aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8901b0 0x55fbffc7aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 -- 172.21.15.2:0/3702361749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 msgr2=0x55fbffc76920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 0x55fbffc76920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 -- 172.21.15.2:0/3702361749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbffc770b0 con 0x55fbff898390 2024-08-31T04:28:23.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 0x55fbffc76920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a75218640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0a60019730 tx=0x7f0a60005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc5d1e94bc3fa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a597fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60019af0 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0a60019c90 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a68003dd0 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a6003a050 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a7e1f2740 10 client.15990 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.619+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbffcef0e0 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a68003dd0 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0a60011ce0 con 0x55fbff898390 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 10 client.15990 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 10 client.15990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 20 client.15990 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff84cda0 0x55fbffcf1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 4 client.15990 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbffbd75d0 con 0x55fbff84cda0 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.620+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff84cda0 0x55fbffcf1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a597fa640 10 client.15990 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7621a640 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff84cda0 0x55fbffcf1870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bc76226cedd14e4 server_cookie=243b9084f42d849 in_seq=0 out_seq=0 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a597fa640 1 -- 172.21.15.2:0/3702361749 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbffbd75d0 con 0x55fbff84cda0 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a597fa640 10 client.15990 handle_command_reply: tid=0 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 client.15990 shutdown 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 msgr2=0x55fbffc76380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0a60019730 tx=0x7f0a60005f10 comp rx=0 tx=0).stop 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 shutdown_connections 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fbff84cda0 0x55fbffcf1870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbff898390 0x55fbffc76380 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbff8b9070 0x55fbffc76920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a597fa640 0 client.15990 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 --2- 172.21.15.2:0/3702361749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fbff8901b0 0x55fbffc7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 >> 172.21.15.2:0/3702361749 conn(0x55fbff8ad460 msgr2=0x55fbffc736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 shutdown_connections 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 1 -- 172.21.15.2:0/3702361749 wait complete. 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.621+0000 7f0a7e1f2740 20 client.15990 trim_cache size 0 max 16384 2024-08-31T04:28:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 msgr2=0x7f0a5c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 0x7f0a5c0b7380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fbffc657e0 tx=0x7f0a6c0092d0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 msgr2=0x7f0a7019c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005940 tx=0x7f0a6c0040c0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 shutdown_connections 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0a5c0b4e70 0x7f0a5c0b7380 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7010fe70 0x7f0a701a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a70075ea0 0x7f0a7019c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 --2- 172.21.15.2:0/1902058920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a70075550 0x7f0a7019c3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 >> 172.21.15.2:0/1902058920 conn(0x7f0a700ff380 msgr2=0x7f0a70100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 shutdown_connections 2024-08-31T04:28:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:23.622+0000 7f0a77c7d640 1 -- 172.21.15.2:0/1902058920 wait complete. 2024-08-31T04:28:23.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 177685 9.48 MB/sec warmup 103 sec latency 96.775 ms 2024-08-31T04:28:24.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:28:24.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 180296 9.52 MB/sec warmup 104 sec latency 23.707 ms 2024-08-31T04:28:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:25.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:24 smithi002 ceph-mon[18656]: pgmap v428: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.4 MiB/s wr, 304 op/s 2024-08-31T04:28:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:24 smithi064 ceph-mon[22007]: pgmap v428: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.4 MiB/s wr, 304 op/s 2024-08-31T04:28:25.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:24 smithi132 ceph-mon[22335]: pgmap v428: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.4 MiB/s wr, 304 op/s 2024-08-31T04:28:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 -- 172.21.15.2:0/556673228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c1045f0 msgr2=0x7f072c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 --2- 172.21.15.2:0/556673228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c1045f0 0x7f072c104a00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f071c009ca0 tx=0x7f071c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 -- 172.21.15.2:0/556673228 shutdown_connections 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 --2- 172.21.15.2:0/556673228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c10dba0 0x7f072c1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 --2- 172.21.15.2:0/556673228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c105020 0x7f072c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 --2- 172.21.15.2:0/556673228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c1045f0 0x7f072c104a00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 -- 172.21.15.2:0/556673228 >> 172.21.15.2:0/556673228 conn(0x7f072c0794d0 msgr2=0x7f072c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 -- 172.21.15.2:0/556673228 shutdown_connections 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.291+0000 7f0731958640 1 -- 172.21.15.2:0/556673228 wait complete. 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 Processor -- start 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 -- start start 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 0x7f072c19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 0x7f072c19fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f072c113840 con 0x7f072c105020 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1136c0 con 0x7f072c1045f0 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.292+0000 7f0731958640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1139c0 con 0x7f072c10dba0 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36576/0 (socket says 172.21.15.2:36576) 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 -- 172.21.15.2:0/3210922350 learned_addr learned my addr 172.21.15.2:0/3210922350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072b7fe640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 0x7f072c19fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072a7fc640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 0x7f072c19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 -- 172.21.15.2:0/3210922350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 msgr2=0x7f072c19fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 0x7f072c19fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 -- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 msgr2=0x7f072c19a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 0x7f072c19a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 -- 172.21.15.2:0/3210922350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c1a0260 con 0x7f072c1045f0 2024-08-31T04:28:25.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072a7fc640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 0x7f072c19a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:25.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072b7fe640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 0x7f072c19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:25.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f072affd640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f071c033040 tx=0x7f071c0316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.293+0000 7f0730956640 1 -- 172.21.15.2:0/3210922350 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c003b70 con 0x7f072c1045f0 2024-08-31T04:28:25.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.294+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c1a04f0 con 0x7f072c1045f0 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.294+0000 7f0730956640 1 -- 172.21.15.2:0/3210922350 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f071c0318e0 con 0x7f072c1045f0 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.294+0000 7f0730956640 1 -- 172.21.15.2:0/3210922350 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c02f950 con 0x7f072c1045f0 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.294+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c1a6cb0 con 0x7f072c1045f0 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.296+0000 7f0730956640 1 -- 172.21.15.2:0/3210922350 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f071c02faf0 con 0x7f072c1045f0 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.296+0000 7f0737ecd740 1 Processor -- start 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.296+0000 7f0737ecd740 1 -- start start 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e66e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e66ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55580e5e5680 con 0x55580e2a8390 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55580e5d4c10 con 0x55580e2c9070 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0737ecd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55580e5d8bc0 con 0x55580e2a01b0 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36588/0 (socket says 172.21.15.2:36588) 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 -- 172.21.15.2:0/573794138 learned_addr learned my addr 172.21.15.2:0/573794138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e66ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0730956640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 0x7f07180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 0x7f07180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072affd640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e66e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f0730956640 1 -- 172.21.15.2:0/3210922350 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f071c106a60 con 0x7f072c1045f0 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 -- 172.21.15.2:0/573794138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 msgr2=0x55580e66e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e66e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 -- 172.21.15.2:0/573794138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 msgr2=0x55580e66ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e66ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072b7fe640 1 -- 172.21.15.2:0/573794138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55580e334650 con 0x55580e2c9070 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072affd640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e66e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.297+0000 7f072a7fc640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e66ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.298+0000 7f072b7fe640 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0724013be0 tx=0x7f072400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9cbe859ecd9f360 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.298+0000 7f0721ffb640 1 -- 172.21.15.2:0/573794138 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724023020 con 0x55580e2c9070 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.298+0000 7f072b7fe640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 0x7f07180b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0724024000 tx=0x7f0724022000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.298+0000 7f0721ffb640 1 -- 172.21.15.2:0/573794138 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0724013530 con 0x55580e2c9070 2024-08-31T04:28:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.298+0000 7f0721ffb640 1 -- 172.21.15.2:0/573794138 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724027610 con 0x55580e2c9070 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- 172.21.15.2:0/573794138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 msgr2=0x55580e66e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0724013be0 tx=0x7f072400f790 comp rx=0 tx=0).stop 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- 172.21.15.2:0/573794138 shutdown_connections 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e66ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e66e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 --2- 172.21.15.2:0/573794138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e66e310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- 172.21.15.2:0/573794138 >> 172.21.15.2:0/573794138 conn(0x55580e2bd460 msgr2=0x55580e66c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- 172.21.15.2:0/573794138 shutdown_connections 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- 172.21.15.2:0/573794138 wait complete. 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.299+0000 7f0737ecd740 1 -- start start 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 Processor -- start 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e679b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e67a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55580e437700 con 0x55580e2c9070 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55580e55b750 con 0x55580e2a8390 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55580e67caf0 con 0x55580e2a01b0 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f0737ecd740 10 client.0 _ll_register_callbacks cb 0x55580e58ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f072a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e67a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44154/0 (socket says 172.21.15.2:44154) 2024-08-31T04:28:25.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f072b7fe640 1 -- 172.21.15.2:0/3734656071 learned_addr learned my addr 172.21.15.2:0/3734656071 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.300+0000 7f072affd640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e679b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 -- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 msgr2=0x55580e67a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e67a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 -- 172.21.15.2:0/3734656071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 msgr2=0x55580e685de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 -- 172.21.15.2:0/3734656071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55580e594900 con 0x55580e2a01b0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072a7fc640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e67a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072b7fe640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f072affd640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e679b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f071c103d90 tx=0x7f071c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7d4f663bdd87ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f070affd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ccd30 con 0x55580e2a01b0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0724013530 con 0x55580e2a01b0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f071c0c8fc0 con 0x55580e2a01b0 2024-08-31T04:28:25.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f071c0d15a0 con 0x55580e2a01b0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f0737ecd740 10 client.25582 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.301+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55580e6888c0 con 0x55580e2a01b0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0724013530 con 0x55580e2a01b0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f071c1040a0 con 0x55580e2a01b0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 10 client.25582 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 10 client.25582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 20 client.25582 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e2879f0 0x55580e68be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 4 client.25582 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55580e5e75d0 con 0x55580e2879f0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.302+0000 7f072a7fc640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e2879f0 0x55580e68be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.303+0000 7f070affd640 10 client.25582 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.303+0000 7f072a7fc640 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e2879f0 0x55580e68be40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7c90e60427cf73a server_cookie=573359217b75483a in_seq=0 out_seq=0 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f070affd640 1 -- 172.21.15.2:0/3734656071 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55580e5e75d0 con 0x55580e2879f0 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f070affd640 10 client.25582 handle_command_reply: tid=0 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 client.25582 shutdown 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 msgr2=0x55580e679b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e679b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f071c103d90 tx=0x7f071c0095c0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 shutdown_connections 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e2879f0 0x55580e68be40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e67a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f070affd640 0 client.25582 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:28:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 --2- 172.21.15.2:0/3734656071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e679b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 >> 172.21.15.2:0/3734656071 conn(0x55580e2bd460 msgr2=0x55580e6714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 shutdown_connections 2024-08-31T04:28:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 1 -- 172.21.15.2:0/3734656071 wait complete. 2024-08-31T04:28:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.304+0000 7f0737ecd740 20 client.25582 trim_cache size 0 max 16384 2024-08-31T04:28:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 Processor -- start 2024-08-31T04:28:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 -- start start 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1b37e0 con 0x55580e2c9070 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1b10b0 con 0x55580e2a8390 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f0737ecd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1aef00 con 0x55580e2a01b0 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54946/0 (socket says 172.21.15.2:54946) 2024-08-31T04:28:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57642/0 (socket says 172.21.15.2:57642) 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072a7fc640 1 -- 172.21.15.2:0/1034039278 learned_addr learned my addr 172.21.15.2:0/1034039278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.318+0000 7f072b7fe640 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 -- 172.21.15.2:0/1034039278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 msgr2=0x55580e67ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 -- 172.21.15.2:0/1034039278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 msgr2=0x55580e685ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 -- 172.21.15.2:0/1034039278 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55580e6708d0 con 0x55580e2a8390 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.319+0000 7f072a7fc640 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f072c06b460 tx=0x7f0714005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37468e6d1547ae81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.320+0000 7f07217fa640 1 -- 172.21.15.2:0/1034039278 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140120d0 con 0x55580e2a8390 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.320+0000 7f07217fa640 1 -- 172.21.15.2:0/1034039278 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0714012270 con 0x55580e2a8390 2024-08-31T04:28:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.320+0000 7f07217fa640 1 -- 172.21.15.2:0/1034039278 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140047a0 con 0x55580e2a8390 2024-08-31T04:28:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- 172.21.15.2:0/1034039278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 msgr2=0x55580e66fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f072c06b460 tx=0x7f0714005f90 comp rx=0 tx=0).stop 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- 172.21.15.2:0/1034039278 shutdown_connections 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2c9070 0x55580e685ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2a8390 0x55580e66fa50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 --2- 172.21.15.2:0/1034039278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- 172.21.15.2:0/1034039278 >> 172.21.15.2:0/1034039278 conn(0x55580e2bd460 msgr2=0x55580e66f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- 172.21.15.2:0/1034039278 shutdown_connections 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- 172.21.15.2:0/1034039278 wait complete. 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.321+0000 7f0737ecd740 1 -- start start 2024-08-31T04:28:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 Processor -- start 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e680390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1af570 con 0x55580e2a8390 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1b09e0 con 0x55580e2c9070 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1afc40 con 0x55580e2a01b0 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f0737ecd740 10 client.0 _ll_register_callbacks cb 0x7f071c009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f072a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e680390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f072affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54954/0 (socket says 172.21.15.2:54954) 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.322+0000 7f072b7fe640 1 -- 172.21.15.2:0/509028845 learned_addr learned my addr 172.21.15.2:0/509028845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 -- 172.21.15.2:0/509028845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 msgr2=0x55580e67fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 -- 172.21.15.2:0/509028845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 msgr2=0x55580e680390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e680390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 -- 172.21.15.2:0/509028845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55580e671170 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f072b7fe640 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0724013df0 tx=0x7f07240123c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce42093f69f82d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f070affd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724023070 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f07240275b0 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0714012270 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f072403f050 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f0737ecd740 10 client.25727 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.323+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55580e6fadb0 con 0x55580e2c9070 2024-08-31T04:28:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0714012270 con 0x55580e2c9070 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f072401fce0 con 0x55580e2c9070 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 10 client.25727 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 10 client.25727 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 20 client.25727 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e25cda0 0x55580e6fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 4 client.25727 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55580e5e3070 con 0x55580e25cda0 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f072affd640 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e25cda0 0x55580e6fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.324+0000 7f070affd640 10 client.25727 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:28:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f072affd640 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e25cda0 0x55580e6fd420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e2cc13dbfd40d88 server_cookie=34ae8d1b8caa95c9 in_seq=0 out_seq=0 2024-08-31T04:28:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f070affd640 1 -- 172.21.15.2:0/509028845 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55580e5e3070 con 0x55580e25cda0 2024-08-31T04:28:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f070affd640 10 client.25727 handle_command_reply: tid=0 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 client.25727 shutdown 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 msgr2=0x55580e6808d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0724013df0 tx=0x7f07240123c0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 shutdown_connections 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55580e25cda0 0x55580e6fd420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55580e2a8390 0x55580e680390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55580e2c9070 0x55580e6808d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 --2- 172.21.15.2:0/509028845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55580e2a01b0 0x55580e67fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f070affd640 0 client.25727 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 >> 172.21.15.2:0/509028845 conn(0x55580e2bd460 msgr2=0x55580e66f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 shutdown_connections 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 1 -- 172.21.15.2:0/509028845 wait complete. 2024-08-31T04:28:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.325+0000 7f0737ecd740 20 client.25727 trim_cache size 0 max 16384 2024-08-31T04:28:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:28:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 msgr2=0x7f07180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 0x7f07180b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0724024000 tx=0x7f0724022000 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 msgr2=0x7f072c19a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f071c033040 tx=0x7f071c0316f0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 shutdown_connections 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f07180b4ca0 0x7f07180b71b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072c105020 0x7f072c19a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f072c10dba0 0x7f072c19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 --2- 172.21.15.2:0/3210922350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f072c1045f0 0x7f072c19a2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 >> 172.21.15.2:0/3210922350 conn(0x7f072c0794d0 msgr2=0x7f072c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 shutdown_connections 2024-08-31T04:28:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:25.326+0000 7f0731958640 1 -- 172.21.15.2:0/3210922350 wait complete. 2024-08-31T04:28:25.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 182313 9.54 MB/sec warmup 105 sec latency 25.312 ms 2024-08-31T04:28:26.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:28:26.309 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:26.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 185016 9.58 MB/sec warmup 106 sec latency 13.111 ms 2024-08-31T04:28:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 -- 172.21.15.2:0/896507992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108a90 msgr2=0x7fc16810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 --2- 172.21.15.2:0/896507992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108a90 0x7fc16810f2c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc160009ca0 tx=0x7fc16002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 -- 172.21.15.2:0/896507992 shutdown_connections 2024-08-31T04:28:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 --2- 172.21.15.2:0/896507992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108a90 0x7fc16810f2c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 --2- 172.21.15.2:0/896507992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168108140 0x7fc168108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 --2- 172.21.15.2:0/896507992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168102800 0x7fc168102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 -- 172.21.15.2:0/896507992 >> 172.21.15.2:0/896507992 conn(0x7fc1680794d0 msgr2=0x7fc1680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 -- 172.21.15.2:0/896507992 shutdown_connections 2024-08-31T04:28:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.841+0000 7fc16ef64640 1 -- 172.21.15.2:0/896507992 wait complete. 2024-08-31T04:28:26.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.842+0000 7fc16ef64640 1 Processor -- start 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.842+0000 7fc16ef64640 1 -- start start 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168102800 0x7fc16819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 0x7fc1681a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681126f0 con 0x7fc168108140 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112570 con 0x7fc168108a90 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16ef64640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112870 con 0x7fc168102800 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46118/0 (socket says 172.21.15.2:46118) 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc167fff640 1 -- 172.21.15.2:0/3365338299 learned_addr learned my addr 172.21.15.2:0/3365338299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 0x7fc1681a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16cd00640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168102800 0x7fc16819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 -- 172.21.15.2:0/3365338299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168102800 msgr2=0x7fc16819c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168102800 0x7fc16819c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 -- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 msgr2=0x7fc16819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc16d501640 1 -- 172.21.15.2:0/3365338299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1681a2330 con 0x7fc168108a90 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.843+0000 7fc167fff640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 0x7fc1681a1c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc16002ade0 tx=0x7fc160031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc165ffb640 1 -- 172.21.15.2:0/3365338299 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160003b70 con 0x7fc168108a90 2024-08-31T04:28:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1681a25c0 con 0x7fc168108a90 2024-08-31T04:28:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc165ffb640 1 -- 172.21.15.2:0/3365338299 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc160031910 con 0x7fc168108a90 2024-08-31T04:28:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc165ffb640 1 -- 172.21.15.2:0/3365338299 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16002f950 con 0x7fc168108a90 2024-08-31T04:28:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.844+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1681a8d80 con 0x7fc168108a90 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.847+0000 7fc1754d9740 1 Processor -- start 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.847+0000 7fc165ffb640 1 -- 172.21.15.2:0/3365338299 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc16002faf0 con 0x7fc168108a90 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.847+0000 7fc1754d9740 1 -- start start 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d6d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d6d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d76ce4680 con 0x564d769a7390 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564d76cd3c10 con 0x564d769c8070 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc1754d9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d76cd7bc0 con 0x564d7699f1b0 2024-08-31T04:28:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46128/0 (socket says 172.21.15.2:46128) 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 -- 172.21.15.2:0/2848835952 learned_addr learned my addr 172.21.15.2:0/2848835952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc16cd00640 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d6d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d6d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc165ffb640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 0x7fc1500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 -- 172.21.15.2:0/2848835952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 msgr2=0x564d76d6d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d6d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 -- 172.21.15.2:0/2848835952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 msgr2=0x564d76d6d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d6d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.848+0000 7fc167fff640 1 -- 172.21.15.2:0/2848835952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d76a33650 con 0x564d769a7390 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc165ffb640 1 -- 172.21.15.2:0/3365338299 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc160106a50 con 0x7fc168108a90 2024-08-31T04:28:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 0x7fc1500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc167fff640 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc158013cb0 tx=0x7fc158005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e58ababe57d329 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc14effd640 1 -- 172.21.15.2:0/2848835952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158013da0 con 0x564d769a7390 2024-08-31T04:28:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc14effd640 1 -- 172.21.15.2:0/2848835952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc158011c70 con 0x564d769a7390 2024-08-31T04:28:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.849+0000 7fc14effd640 1 -- 172.21.15.2:0/2848835952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1580053a0 con 0x564d769a7390 2024-08-31T04:28:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc16d501640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 0x7fc1500b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc1600c8da0 tx=0x7fc160003f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 -- 172.21.15.2:0/2848835952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 msgr2=0x564d76d6ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc158013cb0 tx=0x7fc158005f90 comp rx=0 tx=0).stop 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 -- 172.21.15.2:0/2848835952 shutdown_connections 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769a7390 0x564d76d6ddd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d6d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2848835952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d6d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 -- 172.21.15.2:0/2848835952 >> 172.21.15.2:0/2848835952 conn(0x564d769bc460 msgr2=0x564d76d6b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.850+0000 7fc1754d9740 1 -- 172.21.15.2:0/2848835952 shutdown_connections 2024-08-31T04:28:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.851+0000 7fc1754d9740 1 -- 172.21.15.2:0/2848835952 wait complete. 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.851+0000 7fc1754d9740 1 -- start start 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.851+0000 7fc1754d9740 1 Processor -- start 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d78f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769c8070 0x564d76d84e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d76b36700 con 0x564d769c8070 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564d76c5a750 con 0x564d769a7390 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d76d7bb30 con 0x564d7699f1b0 2024-08-31T04:28:26.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc1754d9740 10 client.0 _ll_register_callbacks cb 0x564d76c89e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57686/0 (socket says 172.21.15.2:57686) 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 -- 172.21.15.2:0/2319487793 learned_addr learned my addr 172.21.15.2:0/2319487793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769c8070 0x564d76d84e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc16cd00640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d78f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 -- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 msgr2=0x564d76d78f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d78f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 -- 172.21.15.2:0/2319487793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769c8070 msgr2=0x564d76d84e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769c8070 0x564d76d84e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.852+0000 7fc167fff640 1 -- 172.21.15.2:0/2319487793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d76c93900 con 0x564d7699f1b0 2024-08-31T04:28:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc167fff640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097f0 tx=0x7fc1580133f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c69ddd2a31edfdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc147fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158029040 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc158011c70 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc158005600 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc158004250 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc1754d9740 10 client.25600 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d76d87870 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.853+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc158011c70 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1580035f0 con 0x564d7699f1b0 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 10 client.25600 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 20 client.25600 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d769869f0 0x564d76d8abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 4 client.25600 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d76ce65d0 con 0x564d769869f0 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.854+0000 7fc16cd00640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d769869f0 0x564d76d8abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.855+0000 7fc147fff640 10 client.25600 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.855+0000 7fc16cd00640 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d769869f0 0x564d76d8abd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2735e335e90fdbf server_cookie=5a58f25da1bd8c72 in_seq=0 out_seq=0 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc147fff640 1 -- 172.21.15.2:0/2319487793 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d76ce65d0 con 0x564d769869f0 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc147fff640 10 client.25600 handle_command_reply: tid=0 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 client.25600 shutdown 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 msgr2=0x564d76d78a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097f0 tx=0x7fc1580133f0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 shutdown_connections 2024-08-31T04:28:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d769869f0 0x564d76d8abd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d769c8070 0x564d76d84e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d78f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc147fff640 0 client.25600 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 --2- 172.21.15.2:0/2319487793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d7699f1b0 0x564d76d78a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.857+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 >> 172.21.15.2:0/2319487793 conn(0x564d769bc460 msgr2=0x564d76d704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.858+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 shutdown_connections 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.858+0000 7fc1754d9740 1 -- 172.21.15.2:0/2319487793 wait complete. 2024-08-31T04:28:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.858+0000 7fc1754d9740 20 client.25600 trim_cache size 0 max 16384 2024-08-31T04:28:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.872+0000 7fc1754d9740 1 Processor -- start 2024-08-31T04:28:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.872+0000 7fc1754d9740 1 -- start start 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769a7390 0x564d76d6ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d75c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b58e0 con 0x564d7699f1b0 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b31b0 con 0x564d769c8070 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc1754d9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b1000 con 0x564d769a7390 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46142/0 (socket says 172.21.15.2:46142) 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 -- 172.21.15.2:0/1339127001 learned_addr learned my addr 172.21.15.2:0/1339127001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc16cd00640 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769a7390 0x564d76d6ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d75c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 -- 172.21.15.2:0/1339127001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769a7390 msgr2=0x564d76d6ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769a7390 0x564d76d6ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 -- 172.21.15.2:0/1339127001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 msgr2=0x564d76d75c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d75c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 -- 172.21.15.2:0/1339127001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d76d6be00 con 0x564d7699f1b0 2024-08-31T04:28:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc167fff640 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc158006010 tx=0x7fc15801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821f82edbd4322e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.873+0000 7fc14e7fc640 1 -- 172.21.15.2:0/1339127001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158039070 con 0x564d7699f1b0 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc14e7fc640 1 -- 172.21.15.2:0/1339127001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc158003d30 con 0x564d7699f1b0 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc14e7fc640 1 -- 172.21.15.2:0/1339127001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158020910 con 0x564d7699f1b0 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 -- 172.21.15.2:0/1339127001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 msgr2=0x564d76d84dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc158006010 tx=0x7fc15801c040 comp rx=0 tx=0).stop 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 -- 172.21.15.2:0/1339127001 shutdown_connections 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769c8070 0x564d76d75c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769a7390 0x564d76d6ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 --2- 172.21.15.2:0/1339127001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d84dc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.874+0000 7fc1754d9740 1 -- 172.21.15.2:0/1339127001 >> 172.21.15.2:0/1339127001 conn(0x564d769bc460 msgr2=0x564d76d6e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- 172.21.15.2:0/1339127001 shutdown_connections 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- 172.21.15.2:0/1339127001 wait complete. 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- start start 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 Processor -- start 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d8c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769c8070 0x564d76df4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b1670 con 0x564d7699f1b0 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b2ae0 con 0x564d769a7390 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b1d40 con 0x564d769c8070 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.875+0000 7fc1754d9740 10 client.0 _ll_register_callbacks cb 0x7fc1580054c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc167fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d8c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:55022/0 (socket says 172.21.15.2:55022) 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 -- 172.21.15.2:0/814902509 learned_addr learned my addr 172.21.15.2:0/814902509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc167fff640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769c8070 0x564d76df4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 -- 172.21.15.2:0/814902509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769c8070 msgr2=0x564d76df4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769c8070 0x564d76df4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 -- 172.21.15.2:0/814902509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 msgr2=0x564d76d8c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d8c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 -- 172.21.15.2:0/814902509 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d76df4890 con 0x564d769a7390 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc167fff640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc16cd00640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000c00 tx=0x7fc15c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc14e04a8cd2c9be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.876+0000 7fc147fff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c028030 con 0x564d769a7390 2024-08-31T04:28:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc15c004240 con 0x564d769a7390 2024-08-31T04:28:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc158003d30 con 0x564d769a7390 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc15c004440 con 0x564d769a7390 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc1754d9740 10 client.25745 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d76df5b30 con 0x564d769a7390 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.877+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc158003d30 con 0x564d769a7390 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc15c005450 con 0x564d769a7390 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 10 client.25745 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 10 client.25745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 20 client.25745 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d7695bda0 0x564d76df83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 4 client.25745 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d76ce2070 con 0x564d7695bda0 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc167fff640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d7695bda0 0x564d76df83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc147fff640 10 client.25745 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.878+0000 7fc167fff640 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d7695bda0 0x564d76df83a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc96231557949a server_cookie=9f224e4e8dff7e9d in_seq=0 out_seq=0 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc147fff640 1 -- 172.21.15.2:0/814902509 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d76ce2070 con 0x564d7695bda0 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc147fff640 10 client.25745 handle_command_reply: tid=0 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 client.25745 shutdown 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 msgr2=0x564d76d8c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000c00 tx=0x7fc15c010c10 comp rx=0 tx=0).stop 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 shutdown_connections 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564d7695bda0 0x564d76df83a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d769c8070 0x564d76df4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc147fff640 0 client.25745 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564d769a7390 0x564d76d8c810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 --2- 172.21.15.2:0/814902509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d7699f1b0 0x564d76d8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 >> 172.21.15.2:0/814902509 conn(0x564d769bc460 msgr2=0x564d76d6e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 shutdown_connections 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 1 -- 172.21.15.2:0/814902509 wait complete. 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.879+0000 7fc1754d9740 20 client.25745 trim_cache size 0 max 16384 2024-08-31T04:28:26.885 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 msgr2=0x7fc1500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 0x7fc1500b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc1600c8da0 tx=0x7fc160003f10 comp rx=0 tx=0).stop 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 msgr2=0x7fc1681a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 0x7fc1681a1c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc16002ade0 tx=0x7fc160031660 comp rx=0 tx=0).stop 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 shutdown_connections 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc1500b4ca0 0x7fc1500b71b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc168108140 0x7fc16819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc168108a90 0x7fc1681a1c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 --2- 172.21.15.2:0/3365338299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc168102800 0x7fc16819c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 >> 172.21.15.2:0/3365338299 conn(0x7fc1680794d0 msgr2=0x7fc168105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 shutdown_connections 2024-08-31T04:28:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:26.880+0000 7fc16ef64640 1 -- 172.21.15.2:0/3365338299 wait complete. 2024-08-31T04:28:27.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:26 smithi064 ceph-mon[22007]: pgmap v429: 129 pgs: 129 active+clean; 111 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-31T04:28:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:26 smithi132 ceph-mon[22335]: pgmap v429: 129 pgs: 129 active+clean; 111 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-31T04:28:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:26 smithi002 ceph-mon[18656]: pgmap v429: 129 pgs: 129 active+clean; 111 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-31T04:28:27.666 INFO:tasks.workunit.client.0.smithi002.stdout: 1 188073 9.65 MB/sec warmup 107 sec latency 26.201 ms 2024-08-31T04:28:28.640 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:28:28.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:28:28.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 189921 9.63 MB/sec warmup 108 sec latency 79.203 ms 2024-08-31T04:28:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:29.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:28 smithi002 ceph-mon[18656]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 322 op/s 2024-08-31T04:28:29.066 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:28 smithi064 ceph-mon[22007]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 322 op/s 2024-08-31T04:28:29.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:28 smithi132 ceph-mon[22335]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 322 op/s 2024-08-31T04:28:29.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.413+0000 7fac14de6640 1 -- 172.21.15.2:0/358912687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00004a00 con 0x7fac10108140 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.414+0000 7fac1804c640 1 -- 172.21.15.2:0/358912687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108140 msgr2=0x7fac10108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.414+0000 7fac1804c640 1 --2- 172.21.15.2:0/358912687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108140 0x7fac10108550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fac0000fb10 tx=0x7fac0002a160 comp rx=0 tx=0).stop 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.414+0000 7fac1804c640 1 -- 172.21.15.2:0/358912687 shutdown_connections 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 --2- 172.21.15.2:0/358912687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108140 0x7fac10108550 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 --2- 172.21.15.2:0/358912687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108a90 0x7fac1010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 --2- 172.21.15.2:0/358912687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 -- 172.21.15.2:0/358912687 >> 172.21.15.2:0/358912687 conn(0x7fac100794d0 msgr2=0x7fac100798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 -- 172.21.15.2:0/358912687 shutdown_connections 2024-08-31T04:28:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 -- 172.21.15.2:0/358912687 wait complete. 2024-08-31T04:28:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 Processor -- start 2024-08-31T04:28:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.415+0000 7fac1804c640 1 -- start start 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108140 0x7fac101985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac101115f0 con 0x7fac10108a90 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac10111470 con 0x7fac10108140 2024-08-31T04:28:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac1804c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac10111770 con 0x7fac10102800 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac15de8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac155e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108140 0x7fac101985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46160/0 (socket says 172.21.15.2:46160) 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac15de8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57740/0 (socket says 172.21.15.2:57740) 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 -- 172.21.15.2:0/4175710859 learned_addr learned my addr 172.21.15.2:0/4175710859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 -- 172.21.15.2:0/4175710859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 msgr2=0x7fac10198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 -- 172.21.15.2:0/4175710859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108140 msgr2=0x7fac101985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108140 0x7fac101985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 -- 172.21.15.2:0/4175710859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1019df70 con 0x7fac10108a90 2024-08-31T04:28:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac15de8640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.416+0000 7fac165e9640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fac0800eb10 tx=0x7fac0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.417+0000 7fac06ffd640 1 -- 172.21.15.2:0/4175710859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08004b20 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.417+0000 7fac06ffd640 1 -- 172.21.15.2:0/4175710859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac08004cc0 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.417+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1019e260 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.417+0000 7fac06ffd640 1 -- 172.21.15.2:0/4175710859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08010670 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.417+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101a49c0 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.420+0000 7fac1e5c1740 1 Processor -- start 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.420+0000 7fac06ffd640 1 -- 172.21.15.2:0/4175710859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fac08005020 con 0x7fac10108a90 2024-08-31T04:28:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.420+0000 7fac1e5c1740 1 -- start start 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1ccc7350 0x558d1d06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d06e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d1cfe35f0 con 0x558d1ccc7350 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558d1cfd2b80 con 0x558d1cca6670 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558d1cfd6b30 con 0x558d1cc9e490 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac155e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1ccc7350 0x558d1d06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57746/0 (socket says 172.21.15.2:57746) 2024-08-31T04:28:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 -- 172.21.15.2:0/3582734560 learned_addr learned my addr 172.21.15.2:0/3582734560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac155e7640 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac06ffd640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 0x7fabfc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 -- 172.21.15.2:0/3582734560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 msgr2=0x558d1d06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d06e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 -- 172.21.15.2:0/3582734560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1ccc7350 msgr2=0x558d1d06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1ccc7350 0x558d1d06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac15de8640 1 -- 172.21.15.2:0/3582734560 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1cd32930 con 0x558d1cc9e490 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.421+0000 7fac06ffd640 1 -- 172.21.15.2:0/4175710859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac080e5eb0 con 0x7fac10108a90 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.422+0000 7fac165e9640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 0x7fabfc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.422+0000 7fac15de8640 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b870 tx=0x7fac0c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=943d4b9fb76d1fda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.422+0000 7fabfbfff640 1 -- 172.21.15.2:0/3582734560 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0077a0 con 0x558d1cc9e490 2024-08-31T04:28:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.422+0000 7fabfbfff640 1 -- 172.21.15.2:0/3582734560 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac0c024070 con 0x558d1cc9e490 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.422+0000 7fabfbfff640 1 -- 172.21.15.2:0/3582734560 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c01fe10 con 0x558d1cc9e490 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- 172.21.15.2:0/3582734560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 msgr2=0x558d1d06dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b870 tx=0x7fac0c005f90 comp rx=0 tx=0).stop 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac165e9640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 0x7fabfc0b7230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fac080a8200 tx=0x7fac08078380 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- 172.21.15.2:0/3582734560 shutdown_connections 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cc9e490 0x558d1d06dcc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/3582734560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1ccc7350 0x558d1d06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- 172.21.15.2:0/3582734560 >> 172.21.15.2:0/3582734560 conn(0x558d1ccbb740 msgr2=0x558d1d06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- 172.21.15.2:0/3582734560 shutdown_connections 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- 172.21.15.2:0/3582734560 wait complete. 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.423+0000 7fac1e5c1740 1 -- start start 2024-08-31T04:28:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 Processor -- start 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 0x558d1d078f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d085280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d1ce35890 con 0x558d1cca6670 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558d1cf59790 con 0x558d1cc9e490 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558d1d07bf60 con 0x558d1ccc7350 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac1e5c1740 10 client.0 _ll_register_callbacks cb 0x558d1ccdeba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac15de8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac155e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 0x558d1d078f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac15de8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46164/0 (socket says 172.21.15.2:46164) 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac15de8640 1 -- 172.21.15.2:0/2703345510 learned_addr learned my addr 172.21.15.2:0/2703345510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.424+0000 7fac155e7640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d085280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 -- 172.21.15.2:0/2703345510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 msgr2=0x558d1d085280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d085280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 -- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 msgr2=0x558d1d078f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 0x558d1d078f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 -- 172.21.15.2:0/2703345510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1cf90f30 con 0x558d1cca6670 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac155e7640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 0x558d1d078f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac15de8640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fac0c004600 tx=0x7fac0c01f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6b3dfe2dbc4691 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fabf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c020ea0 con 0x558d1cca6670 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac0c005040 con 0x558d1cca6670 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac0c024070 con 0x558d1cca6670 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac0c005240 con 0x558d1cca6670 2024-08-31T04:28:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac1e5c1740 10 client.16038 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d1d087d20 con 0x558d1cca6670 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.425+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac0c024070 con 0x558d1cca6670 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fac0c0047e0 con 0x558d1cca6670 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 10 client.16038 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 20 client.16038 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc85cd0 0x558d1d08b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 4 client.16038 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d1cfe5540 con 0x558d1cc85cd0 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac155e7640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc85cd0 0x558d1d08b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fabf97fa640 10 client.16038 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.426+0000 7fac155e7640 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc85cd0 0x558d1d08b190 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8614dfa170a4295 server_cookie=15eb669c4b8e16e0 in_seq=0 out_seq=0 2024-08-31T04:28:29.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.427+0000 7fabf97fa640 1 -- 172.21.15.2:0/2703345510 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d1cfe5540 con 0x558d1cc85cd0 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fabf97fa640 10 client.16038 handle_command_reply: tid=0 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 client.16038 shutdown 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 msgr2=0x558d1d079450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fac0c004600 tx=0x7fac0c01f880 comp rx=0 tx=0).stop 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 shutdown_connections 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc85cd0 0x558d1d08b190 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cca6670 0x558d1d079450 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d085280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fabf97fa640 0 client.16038 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/2703345510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cc9e490 0x558d1d078f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 >> 172.21.15.2:0/2703345510 conn(0x558d1ccbb740 msgr2=0x558d1d070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 shutdown_connections 2024-08-31T04:28:29.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 1 -- 172.21.15.2:0/2703345510 wait complete. 2024-08-31T04:28:29.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.428+0000 7fac1e5c1740 20 client.16038 trim_cache size 0 max 16384 2024-08-31T04:28:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 Processor -- start 2024-08-31T04:28:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 -- start start 2024-08-31T04:28:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cca6670 0x558d1d0851f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1ccc7350 0x558d1d08e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac101b14f0 con 0x558d1cc9e490 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac101aedc0 con 0x558d1ccc7350 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac101acc10 con 0x558d1cca6670 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac155e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac155e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46166/0 (socket says 172.21.15.2:46166) 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac155e7640 1 -- 172.21.15.2:0/1190596048 learned_addr learned my addr 172.21.15.2:0/1190596048 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac155e7640 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1ccc7350 0x558d1d08e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.447+0000 7fac15de8640 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cca6670 0x558d1d0851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 -- 172.21.15.2:0/1190596048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cca6670 msgr2=0x558d1d0851f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cca6670 0x558d1d0851f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 -- 172.21.15.2:0/1190596048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1ccc7350 msgr2=0x558d1d08e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1ccc7350 0x558d1d08e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 -- 172.21.15.2:0/1190596048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1d07be40 con 0x558d1cc9e490 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fac155e7640 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fac00005e90 tx=0x7fac00005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89eeb2cf04b70b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fabfb7fe640 1 -- 172.21.15.2:0/1190596048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00004050 con 0x558d1cc9e490 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fabfb7fe640 1 -- 172.21.15.2:0/1190596048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac00050070 con 0x558d1cc9e490 2024-08-31T04:28:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.448+0000 7fabfb7fe640 1 -- 172.21.15.2:0/1190596048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000035f0 con 0x558d1cc9e490 2024-08-31T04:28:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- 172.21.15.2:0/1190596048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 msgr2=0x558d1d07ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fac00005e90 tx=0x7fac00005d70 comp rx=0 tx=0).stop 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- 172.21.15.2:0/1190596048 shutdown_connections 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1ccc7350 0x558d1d08e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1cca6670 0x558d1d0851f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/1190596048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d07ab40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- 172.21.15.2:0/1190596048 >> 172.21.15.2:0/1190596048 conn(0x558d1ccbb740 msgr2=0x558d1d07a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- 172.21.15.2:0/1190596048 shutdown_connections 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- 172.21.15.2:0/1190596048 wait complete. 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 -- start start 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.449+0000 7fac1e5c1740 1 Processor -- start 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d0ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d0eba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac101ad280 con 0x558d1cc9e490 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac101ae6f0 con 0x558d1cca6670 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac101ad950 con 0x558d1ccc7350 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac1e5c1740 10 client.0 _ll_register_callbacks cb 0x7fac0c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46178/0 (socket says 172.21.15.2:46178) 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 -- 172.21.15.2:0/365508162 learned_addr learned my addr 172.21.15.2:0/365508162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac15de8640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d0ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 -- 172.21.15.2:0/365508162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 msgr2=0x558d1d0eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d0eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 -- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 msgr2=0x558d1d0ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d0ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 -- 172.21.15.2:0/365508162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1d0ec0f0 con 0x558d1cc9e490 2024-08-31T04:28:29.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fac155e7640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fac0002a680 tx=0x7fac00005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0ab03209435180 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.450+0000 7fabf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0005a060 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac0000e660 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac00050070 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac00037040 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 10 client.16044 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d1d0f6740 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac00050070 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fac00032420 con 0x558d1cc9e490 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 10 client.16044 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 20 client.16044 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc5b080 0x558d1d0f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:29.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 4 client.16044 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:28:29.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558d1cfe0fe0 con 0x558d1cc5b080 2024-08-31T04:28:29.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.451+0000 7fac15de8640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc5b080 0x558d1d0f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:29.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.452+0000 7fabf97fa640 10 client.16044 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:29.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.452+0000 7fac15de8640 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc5b080 0x558d1d0f8e00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967b4e2318a2e504 server_cookie=4846782e73dfd9ad in_seq=0 out_seq=0 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fabf97fa640 1 -- 172.21.15.2:0/365508162 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fac0c024080 con 0x558d1cc5b080 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fabf97fa640 10 client.16044 handle_command_reply: tid=0 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 client.16044 shutdown 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 msgr2=0x558d1d0eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fac0002a680 tx=0x7fac00005510 comp rx=0 tx=0).stop 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 shutdown_connections 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x558d1cc5b080 0x558d1d0f8e00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558d1ccc7350 0x558d1d0eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d1cca6670 0x558d1d0ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fabf97fa640 0 client.16044 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 --2- 172.21.15.2:0/365508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d1cc9e490 0x558d1d0eccb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 >> 172.21.15.2:0/365508162 conn(0x558d1ccbb740 msgr2=0x558d1d07ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.454+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 shutdown_connections 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1e5c1740 1 -- 172.21.15.2:0/365508162 wait complete. 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1e5c1740 20 client.16044 trim_cache size 0 max 16384 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1", 2024-08-31T04:28:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:28:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:28:29.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 msgr2=0x7fabfc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 0x7fabfc0b7230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fac080a8200 tx=0x7fac08078380 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 msgr2=0x7fac1019d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fac0800eb10 tx=0x7fac0800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 shutdown_connections 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fabfc0b4d20 0x7fabfc0b7230 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac10108a90 0x7fac1019d840 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac10108140 0x7fac101985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 --2- 172.21.15.2:0/4175710859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac10102800 0x7fac10198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 >> 172.21.15.2:0/4175710859 conn(0x7fac100794d0 msgr2=0x7fac101041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 shutdown_connections 2024-08-31T04:28:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:29.455+0000 7fac1804c640 1 -- 172.21.15.2:0/4175710859 wait complete. 2024-08-31T04:28:29.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 191990 9.67 MB/sec warmup 109 sec latency 116.943 ms 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:29 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:29 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:29 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:29 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:29 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:29 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:28:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:29 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:29 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:28:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:29 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:28:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:29 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:29 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:28:30.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:29 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:29 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:28:30.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:29 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:28:30.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:29 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:28:30.479 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:28:30.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 194898 9.71 MB/sec warmup 110 sec latency 17.909 ms 2024-08-31T04:28:30.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:30 smithi002 ceph-mon[18656]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 263 op/s 2024-08-31T04:28:30.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:30 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 -- 172.21.15.2:0/3306404752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8103930 msgr2=0x7fe4a8103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 --2- 172.21.15.2:0/3306404752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8103930 0x7fe4a8103d40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe498009900 tx=0x7fe49802a410 comp rx=0 tx=0).stop 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 -- 172.21.15.2:0/3306404752 shutdown_connections 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 --2- 172.21.15.2:0/3306404752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8109bc0 0x7fe4a81103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 --2- 172.21.15.2:0/3306404752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a8109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 --2- 172.21.15.2:0/3306404752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8103930 0x7fe4a8103d40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 -- 172.21.15.2:0/3306404752 >> 172.21.15.2:0/3306404752 conn(0x7fe4a80ff3a0 msgr2=0x7fe4a81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 -- 172.21.15.2:0/3306404752 shutdown_connections 2024-08-31T04:28:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.958+0000 7fe4add17640 1 -- 172.21.15.2:0/3306404752 wait complete. 2024-08-31T04:28:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 Processor -- start 2024-08-31T04:28:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 -- start start 2024-08-31T04:28:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8109bc0 0x7fe4a819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8113880 con 0x7fe4a8109bc0 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8113700 con 0x7fe4a8103930 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4add17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8113a00 con 0x7fe4a8109270 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8109bc0 0x7fe4a819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4a77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4a77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:55098/0 (socket says 172.21.15.2:55098) 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.959+0000 7fe4a77fe640 1 -- 172.21.15.2:0/1632383568 learned_addr learned my addr 172.21.15.2:0/1632383568 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 -- 172.21.15.2:0/1632383568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 msgr2=0x7fe4a819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 -- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8109bc0 msgr2=0x7fe4a819fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8109bc0 0x7fe4a819fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 -- 172.21.15.2:0/1632383568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a81a01c0 con 0x7fe4a8103930 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe498005940 tx=0x7fe4980040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1632383568 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49803f030 con 0x7fe4a8103930 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a81a0450 con 0x7fe4a8103930 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1632383568 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4980044c0 con 0x7fe4a8103930 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1632383568 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498035070 con 0x7fe4a8103930 2024-08-31T04:28:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.960+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81a6c10 con 0x7fe4a8103930 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 Processor -- start 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 -- start start 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1632383568 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe498042030 con 0x7fe4a8103930 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc04221630 con 0x55fc03edc1b0 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fc04210bc0 con 0x55fc03f05070 2024-08-31T04:28:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4b428c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fc04214b70 con 0x55fc03ee4390 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46202/0 (socket says 172.21.15.2:46202) 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a77fe640 1 -- 172.21.15.2:0/3200409519 learned_addr learned my addr 172.21.15.2:0/3200409519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.963+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 -- 172.21.15.2:0/3200409519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 msgr2=0x55fc042aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 -- 172.21.15.2:0/3200409519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 msgr2=0x55fc042aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 -- 172.21.15.2:0/3200409519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc03f70650 con 0x55fc03f05070 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042aa2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009f00 tx=0x7fe4a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2927a45c2e91441b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a4ff9640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 0x7fe4900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe48dffb640 1 -- 172.21.15.2:0/3200409519 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0004d20 con 0x55fc03f05070 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 0x7fe4900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe48dffb640 1 -- 172.21.15.2:0/3200409519 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4a0004030 con 0x55fc03f05070 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe48dffb640 1 -- 172.21.15.2:0/3200409519 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0005220 con 0x55fc03f05070 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.964+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1632383568 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe498105d40 con 0x7fe4a8103930 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 -- 172.21.15.2:0/3200409519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 msgr2=0x55fc042aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4a77fe640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 0x7fe4900b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe4980cbdc0 tx=0x7fe498109890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042aa2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009f00 tx=0x7fe4a0011810 comp rx=0 tx=0).stop 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 -- 172.21.15.2:0/3200409519 shutdown_connections 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 --2- 172.21.15.2:0/3200409519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042aa2c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 -- 172.21.15.2:0/3200409519 >> 172.21.15.2:0/3200409519 conn(0x55fc03ef9460 msgr2=0x55fc042a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 -- 172.21.15.2:0/3200409519 shutdown_connections 2024-08-31T04:28:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.965+0000 7fe4b428c740 1 -- 172.21.15.2:0/3200409519 wait complete. 2024-08-31T04:28:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 -- start start 2024-08-31T04:28:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 Processor -- start 2024-08-31T04:28:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc04073700 con 0x55fc03edc1b0 2024-08-31T04:28:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fc04197700 con 0x55fc03f05070 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fc042b8aa0 con 0x55fc03ee4390 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4b428c740 10 client.0 _ll_register_callbacks cb 0x55fc041c6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46206/0 (socket says 172.21.15.2:46206) 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4a7fff640 1 -- 172.21.15.2:0/486221192 learned_addr learned my addr 172.21.15.2:0/486221192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.966+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 -- 172.21.15.2:0/486221192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 msgr2=0x55fc042b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 -- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 msgr2=0x55fc042c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 -- 172.21.15.2:0/486221192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc041d08b0 con 0x55fc03edc1b0 2024-08-31T04:28:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55fc042b86f0 tx=0x7fe4a0004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b42e65d7d3ac9eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe486ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a002d060 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe4a0003d80 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a0004030 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe4a0034050 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4b428c740 10 client.16056 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.967+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc042c4810 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4a0004030 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe4a0024040 con 0x55fc03edc1b0 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 10 client.16056 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 20 client.16056 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03ec39f0 0x55fc042c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 4 client.16056 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc04223580 con 0x55fc03ec39f0 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03ec39f0 0x55fc042c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe486ffd640 10 client.16056 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.968+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03ec39f0 0x55fc042c7c80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d74f4a7dd031d9e server_cookie=2dc48798cc332f79 in_seq=0 out_seq=0 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe486ffd640 1 -- 172.21.15.2:0/486221192 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc04223580 con 0x55fc03ec39f0 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe486ffd640 10 client.16056 handle_command_reply: tid=0 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 client.16056 shutdown 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 msgr2=0x55fc042b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55fc042b86f0 tx=0x7fe4a0004840 comp rx=0 tx=0).stop 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 shutdown_connections 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03ec39f0 0x55fc042c7c80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03ee4390 0x55fc042b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 --2- 172.21.15.2:0/486221192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03edc1b0 0x55fc042b5a80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 >> 172.21.15.2:0/486221192 conn(0x55fc03ef9460 msgr2=0x55fc042ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.970+0000 7fe486ffd640 0 client.16056 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.971+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 shutdown_connections 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.971+0000 7fe4b428c740 1 -- 172.21.15.2:0/486221192 wait complete. 2024-08-31T04:28:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.971+0000 7fe4b428c740 20 client.16056 trim_cache size 0 max 16384 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.989+0000 7fe4b428c740 1 Processor -- start 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.989+0000 7fe4b428c740 1 -- start start 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.989+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.989+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4b428c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81b3720 con 0x55fc03ee4390 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4b428c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81b0ff0 con 0x55fc03f05070 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4b428c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81aee40 con 0x55fc03edc1b0 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46210/0 (socket says 172.21.15.2:46210) 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57804/0 (socket says 172.21.15.2:57804) 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a6ffd640 1 -- 172.21.15.2:0/4044055073 learned_addr learned my addr 172.21.15.2:0/4044055073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 -- 172.21.15.2:0/4044055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 msgr2=0x55fc042ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 -- 172.21.15.2:0/4044055073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 msgr2=0x55fc042c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 -- 172.21.15.2:0/4044055073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc042b49e0 con 0x55fc03edc1b0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0002230 tx=0x7fe4a0005cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb4093482c0b79b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.990+0000 7fe48d7fa640 1 -- 172.21.15.2:0/4044055073 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a002d020 con 0x55fc03edc1b0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe48d7fa640 1 -- 172.21.15.2:0/4044055073 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4a0004030 con 0x55fc03edc1b0 2024-08-31T04:28:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe48d7fa640 1 -- 172.21.15.2:0/4044055073 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000f6c0 con 0x55fc03edc1b0 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 -- 172.21.15.2:0/4044055073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 msgr2=0x55fc042a8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0002230 tx=0x7fe4a0005cf0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 -- 172.21.15.2:0/4044055073 shutdown_connections 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 --2- 172.21.15.2:0/4044055073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042a8200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 -- 172.21.15.2:0/4044055073 >> 172.21.15.2:0/4044055073 conn(0x55fc03ef9460 msgr2=0x55fc042a7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 -- 172.21.15.2:0/4044055073 shutdown_connections 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.991+0000 7fe4b428c740 1 -- 172.21.15.2:0/4044055073 wait complete. 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 -- start start 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 Processor -- start 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81af4b0 con 0x55fc03ee4390 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81b0920 con 0x55fc03f05070 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81afb80 con 0x55fc03edc1b0 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4b428c740 10 client.0 _ll_register_callbacks cb 0x7fe498109760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:30.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.992+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46216/0 (socket says 172.21.15.2:46216) 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 -- 172.21.15.2:0/829363199 learned_addr learned my addr 172.21.15.2:0/829363199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:57820/0 (socket says 172.21.15.2:57820) 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 -- 172.21.15.2:0/829363199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 msgr2=0x55fc042be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 -- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 msgr2=0x55fc042b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042b9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 -- 172.21.15.2:0/829363199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc042ba190 con 0x55fc03ee4390 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4a6ffd640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806b850 tx=0x7fe49c020400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6957f9267823409 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:30.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe486ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c02c020 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fe49c020d00 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a0004030 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe49c037050 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4b428c740 10 client.16062 fetch_fsmap learned FSMap version 27 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.993+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc04332190 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4a0004030 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe49c0035f0 con 0x55fc03ee4390 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 10 client.16062 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 20 client.16062 populate_metadata read hostname 'smithi002' 2024-08-31T04:28:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03e98da0 0x55fc04334950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 4 client.16062 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc0421f020 con 0x55fc03e98da0 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.994+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03e98da0 0x55fc04334950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe486ffd640 10 client.16062 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03e98da0 0x55fc04334950 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20c23d385d79ff16 server_cookie=a85d7c00017c91e4 in_seq=0 out_seq=0 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe486ffd640 1 -- 172.21.15.2:0/829363199 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55fc0421f020 con 0x55fc03e98da0 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe486ffd640 10 client.16062 handle_command_reply: tid=0 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 client.16062 shutdown 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 msgr2=0x55fc042b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806b850 tx=0x7fe49c020400 comp rx=0 tx=0).stop 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 shutdown_connections 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fc03e98da0 0x55fc04334950 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc03ee4390 0x55fc042b9710 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc03f05070 0x55fc042b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 --2- 172.21.15.2:0/829363199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fc03edc1b0 0x55fc042be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 >> 172.21.15.2:0/829363199 conn(0x55fc03ef9460 msgr2=0x55fc042ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe486ffd640 0 client.16062 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 shutdown_connections 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 1 -- 172.21.15.2:0/829363199 wait complete. 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.995+0000 7fe4b428c740 20 client.16062 trim_cache size 0 max 16384 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:28:31.002 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1", 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:31.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:28:31.004 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:28:31.005 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:28:31.006 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 msgr2=0x7fe4900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 0x7fe4900b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe4980cbdc0 tx=0x7fe498109890 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 msgr2=0x7fe4a819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe498005940 tx=0x7fe4980040c0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 shutdown_connections 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe4900b4ca0 0x7fe4900b71b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a8109bc0 0x7fe4a819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a8109270 0x7fe4a819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 --2- 172.21.15.2:0/1632383568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4a8103930 0x7fe4a819a250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:31.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 >> 172.21.15.2:0/1632383568 conn(0x7fe4a80ff3a0 msgr2=0x7fe4a81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:31.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 shutdown_connections 2024-08-31T04:28:31.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:28:30.996+0000 7fe4add17640 1 -- 172.21.15.2:0/1632383568 wait complete. 2024-08-31T04:28:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:30 smithi064 ceph-mon[22007]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 263 op/s 2024-08-31T04:28:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:30 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:31.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:30 smithi132 ceph-mon[22335]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 263 op/s 2024-08-31T04:28:31.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:30 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:28:31.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 196957 9.71 MB/sec warmup 111 sec latency 25.474 ms 2024-08-31T04:28:31.826 INFO:tasks.cephfs.filesystem:scrub status for tag:9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1 - {'path': '/', 'tag': '9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1', 'options': 'recursive,force'} 2024-08-31T04:28:32.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 199371 9.75 MB/sec warmup 112 sec latency 30.884 ms 2024-08-31T04:28:33.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:32 smithi064 ceph-mon[22007]: pgmap v432: 129 pgs: 129 active+clean; 121 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.5 MiB/s wr, 265 op/s 2024-08-31T04:28:33.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:32 smithi132 ceph-mon[22335]: pgmap v432: 129 pgs: 129 active+clean; 121 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.5 MiB/s wr, 265 op/s 2024-08-31T04:28:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:32 smithi002 ceph-mon[18656]: pgmap v432: 129 pgs: 129 active+clean; 121 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.5 MiB/s wr, 265 op/s 2024-08-31T04:28:33.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 202407 9.83 MB/sec warmup 113 sec latency 10.955 ms 2024-08-31T04:28:34.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 204904 9.84 MB/sec warmup 114 sec latency 17.930 ms 2024-08-31T04:28:35.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:34 smithi064 ceph-mon[22007]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T04:28:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:34 smithi132 ceph-mon[22335]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T04:28:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:34 smithi002 ceph-mon[18656]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T04:28:35.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 207010 9.85 MB/sec warmup 115 sec latency 25.593 ms 2024-08-31T04:28:36.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 209881 9.91 MB/sec warmup 116 sec latency 16.931 ms 2024-08-31T04:28:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:36 smithi064 ceph-mon[22007]: pgmap v434: 129 pgs: 129 active+clean; 126 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:28:37.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:36 smithi132 ceph-mon[22335]: pgmap v434: 129 pgs: 129 active+clean; 126 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:28:37.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:36 smithi002 ceph-mon[18656]: pgmap v434: 129 pgs: 129 active+clean; 126 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:28:37.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 212961 9.97 MB/sec warmup 117 sec latency 27.823 ms 2024-08-31T04:28:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:37 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:28:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:37 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:28:38.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:37 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:28:38.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:37 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:28:38.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:37 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:28:38.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:37 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:28:38.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 215752 10.00 MB/sec warmup 118 sec latency 26.642 ms 2024-08-31T04:28:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:38 smithi064 ceph-mon[22007]: pgmap v435: 129 pgs: 129 active+clean; 127 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-31T04:28:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:38 smithi132 ceph-mon[22335]: pgmap v435: 129 pgs: 129 active+clean; 127 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-31T04:28:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:38 smithi002 ceph-mon[18656]: pgmap v435: 129 pgs: 129 active+clean; 127 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-31T04:28:39.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 217412 9.99 MB/sec warmup 119 sec latency 57.242 ms 2024-08-31T04:28:41.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:40 smithi064 ceph-mon[22007]: pgmap v436: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-08-31T04:28:41.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:40 smithi132 ceph-mon[22335]: pgmap v436: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-08-31T04:28:41.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:40 smithi002 ceph-mon[18656]: pgmap v436: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-08-31T04:28:41.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 223470 17.41 MB/sec execute 1 sec latency 21.524 ms 2024-08-31T04:28:42.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 225903 13.07 MB/sec execute 2 sec latency 26.003 ms 2024-08-31T04:28:43.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:42 smithi002 ceph-mon[18656]: pgmap v437: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-08-31T04:28:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:42 smithi064 ceph-mon[22007]: pgmap v437: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-08-31T04:28:43.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:42 smithi132 ceph-mon[22335]: pgmap v437: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-08-31T04:28:43.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 227979 13.02 MB/sec execute 3 sec latency 25.900 ms 2024-08-31T04:28:44.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 230739 14.01 MB/sec execute 4 sec latency 63.825 ms 2024-08-31T04:28:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:44 smithi002 ceph-mon[18656]: pgmap v438: 129 pgs: 129 active+clean; 136 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-08-31T04:28:45.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:44 smithi064 ceph-mon[22007]: pgmap v438: 129 pgs: 129 active+clean; 136 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-08-31T04:28:45.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:44 smithi132 ceph-mon[22335]: pgmap v438: 129 pgs: 129 active+clean; 136 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-08-31T04:28:45.667 INFO:tasks.workunit.client.0.smithi002.stdout: 1 233000 12.88 MB/sec execute 5 sec latency 26.872 ms 2024-08-31T04:28:46.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 234880 12.80 MB/sec execute 6 sec latency 84.955 ms 2024-08-31T04:28:47.119 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:46 smithi132 ceph-mon[22335]: pgmap v439: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-08-31T04:28:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:46 smithi002 ceph-mon[18656]: pgmap v439: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-08-31T04:28:47.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:46 smithi064 ceph-mon[22007]: pgmap v439: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-08-31T04:28:47.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 237904 13.61 MB/sec execute 7 sec latency 8.891 ms 2024-08-31T04:28:48.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 240624 13.52 MB/sec execute 8 sec latency 25.093 ms 2024-08-31T04:28:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:48 smithi002 ceph-mon[18656]: pgmap v440: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-08-31T04:28:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:48 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:28:49.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:48 smithi064 ceph-mon[22007]: pgmap v440: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-08-31T04:28:49.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:48 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:28:49.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:48 smithi132 ceph-mon[22335]: pgmap v440: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-08-31T04:28:49.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:48 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:28:49.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 242165 12.84 MB/sec execute 9 sec latency 107.551 ms 2024-08-31T04:28:50.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 245032 13.35 MB/sec execute 10 sec latency 22.361 ms 2024-08-31T04:28:51.118 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:50 smithi064 ceph-mon[22007]: pgmap v441: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2024-08-31T04:28:51.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:50 smithi002 ceph-mon[18656]: pgmap v441: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2024-08-31T04:28:51.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:50 smithi132 ceph-mon[22335]: pgmap v441: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2024-08-31T04:28:51.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 247954 13.36 MB/sec execute 11 sec latency 25.792 ms 2024-08-31T04:28:52.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 250033 13.19 MB/sec execute 12 sec latency 26.076 ms 2024-08-31T04:28:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:52 smithi002 ceph-mon[18656]: pgmap v442: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 285 op/s 2024-08-31T04:28:53.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:52 smithi064 ceph-mon[22007]: pgmap v442: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 285 op/s 2024-08-31T04:28:53.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:52 smithi132 ceph-mon[22335]: pgmap v442: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 285 op/s 2024-08-31T04:28:53.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 252602 13.26 MB/sec execute 13 sec latency 27.014 ms 2024-08-31T04:28:54.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 255429 13.54 MB/sec execute 14 sec latency 49.467 ms 2024-08-31T04:28:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:54 smithi002 ceph-mon[18656]: pgmap v443: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 326 op/s 2024-08-31T04:28:55.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:54 smithi064 ceph-mon[22007]: pgmap v443: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 326 op/s 2024-08-31T04:28:55.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:54 smithi132 ceph-mon[22335]: pgmap v443: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 326 op/s 2024-08-31T04:28:55.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 257875 13.22 MB/sec execute 15 sec latency 26.087 ms 2024-08-31T04:28:56.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 259883 13.19 MB/sec execute 16 sec latency 40.060 ms 2024-08-31T04:28:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:56 smithi002 ceph-mon[18656]: pgmap v444: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 268 op/s 2024-08-31T04:28:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:56 smithi064 ceph-mon[22007]: pgmap v444: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 268 op/s 2024-08-31T04:28:57.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:56 smithi132 ceph-mon[22335]: pgmap v444: 129 pgs: 129 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 268 op/s 2024-08-31T04:28:57.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 262894 13.50 MB/sec execute 17 sec latency 9.597 ms 2024-08-31T04:28:58.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 265733 13.49 MB/sec execute 18 sec latency 25.833 ms 2024-08-31T04:28:59.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:28:58 smithi002 ceph-mon[18656]: pgmap v445: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.6 MiB/s wr, 339 op/s 2024-08-31T04:28:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:28:58 smithi064 ceph-mon[22007]: pgmap v445: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.6 MiB/s wr, 339 op/s 2024-08-31T04:28:59.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:28:58 smithi132 ceph-mon[22335]: pgmap v445: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.6 MiB/s wr, 339 op/s 2024-08-31T04:28:59.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 267513 13.35 MB/sec execute 19 sec latency 85.238 ms 2024-08-31T04:29:00.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 270060 13.38 MB/sec execute 20 sec latency 23.946 ms 2024-08-31T04:29:01.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:00 smithi002 ceph-mon[18656]: pgmap v446: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-08-31T04:29:01.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:00 smithi064 ceph-mon[22007]: pgmap v446: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-08-31T04:29:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:00 smithi132 ceph-mon[22335]: pgmap v446: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-08-31T04:29:01.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 270636 12.83 MB/sec execute 21 sec latency 57.842 ms 2024-08-31T04:29:01.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:29:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:02.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:02.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:02.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:29:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3718494153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f010dc50 msgr2=0x7fb4f0110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3718494153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f010dc50 0x7fb4f0110120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009ca0 tx=0x7fb4e802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3718494153 shutdown_connections 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3718494153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f010dc50 0x7fb4f0110120 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3718494153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01050d0 0x7fb4f010d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3718494153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f01046a0 0x7fb4f0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3718494153 >> 172.21.15.2:0/3718494153 conn(0x7fb4f0079510 msgr2=0x7fb4f0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3718494153 shutdown_connections 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3718494153 wait complete. 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.609+0000 7fb4f65d8640 1 Processor -- start 2024-08-31T04:29:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 -- start start 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 0x7fb4f0102af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f010dc50 0x7fb4f0103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0113890 con 0x7fb4f01050d0 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0113710 con 0x7fb4f010dc50 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f65d8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0113a10 con 0x7fb4f01046a0 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 0x7fb4f0102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:42186/0 (socket says 172.21.15.2:42186) 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 0x7fb4f0102af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52514/0 (socket says 172.21.15.2:52514) 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 -- 172.21.15.2:0/3201142885 learned_addr learned my addr 172.21.15.2:0/3201142885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4f4b75640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f010dc50 0x7fb4f0103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 -- 172.21.15.2:0/3201142885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f010dc50 msgr2=0x7fb4f0103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f010dc50 0x7fb4f0103030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 -- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 msgr2=0x7fb4f0102af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.610+0000 7fb4effff640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 0x7fb4f0102af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4effff640 1 -- 172.21.15.2:0/3201142885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f01a8500 con 0x7fb4f01046a0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4effff640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e9f0 tx=0x7fb4e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4ed7fa640 1 -- 172.21.15.2:0/3201142885 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000cd80 con 0x7fb4f01046a0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f01a87f0 con 0x7fb4f01046a0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4ed7fa640 1 -- 172.21.15.2:0/3201142885 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e00108e0 con 0x7fb4f01046a0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4ed7fa640 1 -- 172.21.15.2:0/3201142885 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0018980 con 0x7fb4f01046a0 2024-08-31T04:29:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.611+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f01a8d30 con 0x7fb4f01046a0 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4ed7fa640 1 -- 172.21.15.2:0/3201142885 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb4e0010430 con 0x7fb4f01046a0 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 Processor -- start 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 -- start start 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf446800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf446d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564edf3bd630 con 0x564edf080390 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564edf3acbc0 con 0x564edf0781b0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.614+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564edf3b0b70 con 0x564edf0a1070 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf446800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:42190/0 (socket says 172.21.15.2:42190) 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3347402446 learned_addr learned my addr 172.21.15.2:0/3347402446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4ed7fa640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 0x7fb4d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4ef7fe640 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf446d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 0x7fb4d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4ed7fa640 1 -- 172.21.15.2:0/3201142885 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb4e00e5c70 con 0x7fb4f01046a0 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3347402446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 msgr2=0x564edf446800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf446800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3347402446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 msgr2=0x564edf446d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf446d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3347402446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edf10c650 con 0x564edf0a1070 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4effff640 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf446800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8031d90 tx=0x7fb4e8031dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c23a21f1e43bc98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.615+0000 7fb4d67fc640 1 -- 172.21.15.2:0/3347402446 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8004d40 con 0x564edf0a1070 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 0x7fb4d80b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb4e804e000 tx=0x7fb4e804c000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4d67fc640 1 -- 172.21.15.2:0/3347402446 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e8036070 con 0x564edf0a1070 2024-08-31T04:29:02.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4d67fc640 1 -- 172.21.15.2:0/3347402446 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80045b0 con 0x564edf0a1070 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3347402446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 msgr2=0x564edf4462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8031d90 tx=0x7fb4e8031dc0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3347402446 shutdown_connections 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf446d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf446800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3347402446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0a1070 0x564edf4462c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.616+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3347402446 >> 172.21.15.2:0/3347402446 conn(0x564edf095460 msgr2=0x564edf4441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3347402446 shutdown_connections 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3347402446 wait complete. 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 -- start start 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 Processor -- start 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.617+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0a1070 0x564edf45dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564edf20f700 con 0x564edf080390 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564edf333700 con 0x564edf0a1070 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564edf454920 con 0x564edf0781b0 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4fcb4d740 10 client.0 _ll_register_callbacks cb 0x564edf362dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52530/0 (socket says 172.21.15.2:52530) 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4ef7fe640 1 -- 172.21.15.2:0/2989710597 learned_addr learned my addr 172.21.15.2:0/2989710597 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:42202/0 (socket says 172.21.15.2:42202) 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0a1070 0x564edf45dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 -- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0a1070 msgr2=0x564edf45dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0a1070 0x564edf45dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 -- 172.21.15.2:0/2989710597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 msgr2=0x564edf452040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 -- 172.21.15.2:0/2989710597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edf36c8b0 con 0x564edf0781b0 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4ef7fe640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4effff640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00e2fa0 tx=0x7fb4e0010cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5a05a1aceb0ac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00e3430 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb4e00ab250 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.618+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4e8036070 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4e00abb00 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 10 client.25651 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564edf460830 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e8036070 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb4e00971a0 con 0x564edf0781b0 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 10 client.25651 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 10 client.25651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 20 client.25651 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf05f9f0 0x564edf463c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 4 client.25651 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564edf3bf580 con 0x564edf05f9f0 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.619+0000 7fb4ef7fe640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf05f9f0 0x564edf463c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.620+0000 7fb4cf7fe640 10 client.25651 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.620+0000 7fb4ef7fe640 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf05f9f0 0x564edf463c70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ff1191abbc373a server_cookie=eca4856317d3fc7d in_seq=0 out_seq=0 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/2989710597 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564edf3bf580 con 0x564edf05f9f0 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4cf7fe640 10 client.25651 handle_command_reply: tid=0 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 client.25651 shutdown 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 msgr2=0x564edf451ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00e2fa0 tx=0x7fb4e0010cc0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 shutdown_connections 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf05f9f0 0x564edf463c70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf452040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0a1070 0x564edf45dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4cf7fe640 0 client.25651 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/2989710597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf451ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 >> 172.21.15.2:0/2989710597 conn(0x564edf095460 msgr2=0x564edf4494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 shutdown_connections 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/2989710597 wait complete. 2024-08-31T04:29:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.621+0000 7fb4fcb4d740 20 client.25651 trim_cache size 0 max 16384 2024-08-31T04:29:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 Processor -- start 2024-08-31T04:29:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 -- start start 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf45db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf080390 0x564edf45e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b5920 con 0x564edf05f9f0 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b31f0 con 0x564edf080390 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.639+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b1040 con 0x564edf0781b0 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52534/0 (socket says 172.21.15.2:52534) 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 -- 172.21.15.2:0/3445490630 learned_addr learned my addr 172.21.15.2:0/3445490630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf080390 0x564edf45e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 -- 172.21.15.2:0/3445490630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 msgr2=0x564edf45db10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:29:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf45db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 -- 172.21.15.2:0/3445490630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf080390 msgr2=0x564edf45e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf080390 0x564edf45e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 -- 172.21.15.2:0/3445490630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edf452d80 con 0x564edf05f9f0 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4effff640 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00a8590 tx=0x7fb4e000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71070799c4edbcb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4d5ffb640 1 -- 172.21.15.2:0/3445490630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00ab760 con 0x564edf05f9f0 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4d5ffb640 1 -- 172.21.15.2:0/3445490630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e00c5070 con 0x564edf05f9f0 2024-08-31T04:29:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.640+0000 7fb4d5ffb640 1 -- 172.21.15.2:0/3445490630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00b03e0 con 0x564edf05f9f0 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3445490630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 msgr2=0x564edf449ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00a8590 tx=0x7fb4e000cf20 comp rx=0 tx=0).stop 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3445490630 shutdown_connections 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf080390 0x564edf45e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf0781b0 0x564edf45db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3445490630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf05f9f0 0x564edf449ad0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3445490630 >> 172.21.15.2:0/3445490630 conn(0x564edf095460 msgr2=0x564edf4493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3445490630 shutdown_connections 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.641+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3445490630 wait complete. 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.642+0000 7fb4fcb4d740 1 -- start start 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.642+0000 7fb4fcb4d740 1 Processor -- start 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.642+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 0x564edf4ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.642+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf459bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.642+0000 7fb4fcb4d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b16b0 con 0x564edf080390 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b2b20 con 0x564edf0781b0 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4fcb4d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01b1d80 con 0x564edf05f9f0 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf459bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52550/0 (socket says 172.21.15.2:52550) 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3550410622 learned_addr learned my addr 172.21.15.2:0/3550410622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4fcb4d740 10 client.0 _ll_register_callbacks cb 0x7fb4e0009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4effff640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 0x564edf4ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3550410622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 msgr2=0x564edf4ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 0x564edf4ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 msgr2=0x564edf459bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf459bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 -- 172.21.15.2:0/3550410622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edf4c7570 con 0x564edf080390 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4effff640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 0x564edf4ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4f4b75640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb4e802a900 tx=0x7fb4e80046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cf313c7c189a4d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8063060 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb4e8003b70 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.643+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4e00c5070 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4e8004040 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564edf4df880 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e00c5070 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb4e802fba0 con 0x564edf080390 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 20 client.16080 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf0a1070 0x564edf4e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 4 client.16080 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:29:02.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564edf3bb020 con 0x564edf0a1070 2024-08-31T04:29:02.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.644+0000 7fb4effff640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf0a1070 0x564edf4e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.645+0000 7fb4cf7fe640 10 client.16080 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:02.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.645+0000 7fb4effff640 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf0a1070 0x564edf4e1d80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe599004da9a077b server_cookie=817ebb2e486cf5ab in_seq=0 out_seq=0 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4cf7fe640 1 -- 172.21.15.2:0/3550410622 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x564edf3bb020 con 0x564edf0a1070 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4cf7fe640 10 client.16080 handle_command_reply: tid=0 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 client.16080 shutdown 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 msgr2=0x564edf45a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb4e802a900 tx=0x7fb4e80046e0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 shutdown_connections 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564edf0a1070 0x564edf4e1d80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edf080390 0x564edf45a300 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564edf0781b0 0x564edf459bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 --2- 172.21.15.2:0/3550410622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564edf05f9f0 0x564edf4ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 >> 172.21.15.2:0/3550410622 conn(0x564edf095460 msgr2=0x564edf449b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.646+0000 7fb4cf7fe640 0 client.16080 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 shutdown_connections 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4fcb4d740 1 -- 172.21.15.2:0/3550410622 wait complete. 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4fcb4d740 20 client.16080 trim_cache size 0 max 16384 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:29:02.652 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:02.653 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:02.655 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:02.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 msgr2=0x7fb4d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 0x7fb4d80b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb4e804e000 tx=0x7fb4e804c000 comp rx=0 tx=0).stop 2024-08-31T04:29:02.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 msgr2=0x7fb4f01025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.647+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e9f0 tx=0x7fb4e000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 shutdown_connections 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4d80b4ca0 0x7fb4d80b71b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f01050d0 0x7fb4f0102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4f010dc50 0x7fb4f0103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 --2- 172.21.15.2:0/3201142885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f01046a0 0x7fb4f01025b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 >> 172.21.15.2:0/3201142885 conn(0x7fb4f0079510 msgr2=0x7fb4f0107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 shutdown_connections 2024-08-31T04:29:02.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:02.648+0000 7fb4f65d8640 1 -- 172.21.15.2:0/3201142885 wait complete. 2024-08-31T04:29:02.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 273359 13.02 MB/sec execute 22 sec latency 74.278 ms 2024-08-31T04:29:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:02 smithi002 ceph-mon[18656]: pgmap v447: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 287 op/s 2024-08-31T04:29:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:02 smithi064 ceph-mon[22007]: pgmap v447: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 287 op/s 2024-08-31T04:29:03.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:02 smithi132 ceph-mon[22335]: pgmap v447: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 287 op/s 2024-08-31T04:29:03.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:29:03.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:29:03.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 275633 12.81 MB/sec execute 23 sec latency 36.619 ms 2024-08-31T04:29:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 -- 172.21.15.2:0/943093102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 msgr2=0x7fb014108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/943093102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb014108580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb00402a410 comp rx=0 tx=0).stop 2024-08-31T04:29:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 -- 172.21.15.2:0/943093102 shutdown_connections 2024-08-31T04:29:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/943093102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb014108580 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/943093102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014108ac0 0x7fb01410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/943093102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014102880 0x7fb014102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 -- 172.21.15.2:0/943093102 >> 172.21.15.2:0/943093102 conn(0x7fb014079530 msgr2=0x7fb014079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 -- 172.21.15.2:0/943093102 shutdown_connections 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.314+0000 7fb01c3b6640 1 -- 172.21.15.2:0/943093102 wait complete. 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 Processor -- start 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 -- start start 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014102880 0x7fb0140ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 0x7fb0140ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0141127a0 con 0x7fb014108170 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112620 con 0x7fb014108ac0 2024-08-31T04:29:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.315+0000 7fb01c3b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112920 con 0x7fb014102880 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52570/0 (socket says 172.21.15.2:52570) 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 -- 172.21.15.2:0/1423763204 learned_addr learned my addr 172.21.15.2:0/1423763204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb01a953640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 0x7fb0140ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb01a152640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014102880 0x7fb0140ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 -- 172.21.15.2:0/1423763204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014102880 msgr2=0x7fb0140ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014102880 0x7fb0140ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 -- 172.21.15.2:0/1423763204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 msgr2=0x7fb0140ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 0x7fb0140ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 -- 172.21.15.2:0/1423763204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0141a85a0 con 0x7fb014108170 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb01a953640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 0x7fb0140ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb019951640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb004006010 tx=0x7fb004004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00403f030 con 0x7fb014108170 2024-08-31T04:29:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.316+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0141a8830 con 0x7fb014108170 2024-08-31T04:29:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.317+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb004003aa0 con 0x7fb014108170 2024-08-31T04:29:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.317+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004035070 con 0x7fb014108170 2024-08-31T04:29:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.317+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141a8d90 con 0x7fb014108170 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.318+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb014102c90 con 0x7fb014108170 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.319+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb004042030 con 0x7fb014108170 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.320+0000 7fb00b7fe640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 0x7fb0000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.320+0000 7fb01a152640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 0x7fb0000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.320+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fb004106370 con 0x7fb014108170 2024-08-31T04:29:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.321+0000 7fb01a152640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 0x7fb0000b71b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb014100e60 tx=0x7fb010005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.323+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb0040ccd40 con 0x7fb014108170 2024-08-31T04:29:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.593+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb014100710 con 0x7fb014108170 2024-08-31T04:29:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.594+0000 7fb00b7fe640 1 -- 172.21.15.2:0/1423763204 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11897 (secure 0 0 0) 0x7fb014100710 con 0x7fb014108170 2024-08-31T04:29:04.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:29:04.596 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-08-31T04:28:47:821768+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:28:47.525009+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:29:04.596 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 msgr2=0x7fb0000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 0x7fb0000b71b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb014100e60 tx=0x7fb010005f90 comp rx=0 tx=0).stop 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 msgr2=0x7fb0140ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb004006010 tx=0x7fb004004060 comp rx=0 tx=0).stop 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 shutdown_connections 2024-08-31T04:29:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb0000b4ca0 0x7fb0000b71b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb014108170 0x7fb0140ff950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb014108ac0 0x7fb0140ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 --2- 172.21.15.2:0/1423763204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014102880 0x7fb0140ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.596+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 >> 172.21.15.2:0/1423763204 conn(0x7fb014079530 msgr2=0x7fb014101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.597+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 shutdown_connections 2024-08-31T04:29:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:04.597+0000 7fb01c3b6640 1 -- 172.21.15.2:0/1423763204 wait complete. 2024-08-31T04:29:04.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 277426 12.76 MB/sec execute 24 sec latency 69.277 ms 2024-08-31T04:29:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:04 smithi002 ceph-mon[18656]: pgmap v448: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:29:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:04 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1423763204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:05.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:04 smithi064 ceph-mon[22007]: pgmap v448: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:29:05.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:04 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1423763204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:04 smithi132 ceph-mon[22335]: pgmap v448: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-08-31T04:29:05.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:04 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1423763204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:05.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:29:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:05.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 280311 12.94 MB/sec execute 25 sec latency 22.686 ms 2024-08-31T04:29:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.273+0000 7fd798665640 1 -- 172.21.15.2:0/3398398756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790109250 msgr2=0x7fd790109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.273+0000 7fd798665640 1 --2- 172.21.15.2:0/3398398756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790109250 0x7fd790109660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd780009900 tx=0x7fd78002a410 comp rx=0 tx=0).stop 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 -- 172.21.15.2:0/3398398756 shutdown_connections 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 --2- 172.21.15.2:0/3398398756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109ba0 0x7fd7901103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 --2- 172.21.15.2:0/3398398756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790109250 0x7fd790109660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 --2- 172.21.15.2:0/3398398756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790103960 0x7fd790103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 -- 172.21.15.2:0/3398398756 >> 172.21.15.2:0/3398398756 conn(0x7fd79007b6b0 msgr2=0x7fd79007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 -- 172.21.15.2:0/3398398756 shutdown_connections 2024-08-31T04:29:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 -- 172.21.15.2:0/3398398756 wait complete. 2024-08-31T04:29:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 Processor -- start 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.274+0000 7fd798665640 1 -- start start 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790103960 0x7fd79019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790109ba0 0x7fd79019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd790113860 con 0x7fd790109250 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901136e0 con 0x7fd790103960 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd798665640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901139e0 con 0x7fd790109ba0 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42950/0 (socket says 172.21.15.2:42950) 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 -- 172.21.15.2:0/1900297449 learned_addr learned my addr 172.21.15.2:0/1900297449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd796401640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790103960 0x7fd79019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd796c02640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790109ba0 0x7fd79019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 -- 172.21.15.2:0/1900297449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790109ba0 msgr2=0x7fd79019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790109ba0 0x7fd79019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 -- 172.21.15.2:0/1900297449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790103960 msgr2=0x7fd79019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790103960 0x7fd79019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.275+0000 7fd795c00640 1 -- 172.21.15.2:0/1900297449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7901a01e0 con 0x7fd790109250 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd795c00640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd78002a930 tx=0x7fd780031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd7877fe640 1 -- 172.21.15.2:0/1900297449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78003f030 con 0x7fd790109250 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7901a0470 con 0x7fd790109250 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd7877fe640 1 -- 172.21.15.2:0/1900297449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd780004490 con 0x7fd790109250 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd7877fe640 1 -- 172.21.15.2:0/1900297449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780035070 con 0x7fd790109250 2024-08-31T04:29:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.276+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd790075390 con 0x7fd790109250 2024-08-31T04:29:06.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.278+0000 7fd79ebda740 1 Processor -- start 2024-08-31T04:29:06.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 -- start start 2024-08-31T04:29:06.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd7877fe640 1 -- 172.21.15.2:0/1900297449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd780042030 con 0x7fd790109250 2024-08-31T04:29:06.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250670e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250670ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562506685680 con 0x562506369070 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562506674c10 con 0x5625063401b0 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd79ebda740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562506678bc0 con 0x562506348390 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796c02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250670e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796c02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42964/0 (socket says 172.21.15.2:42964) 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796c02640 1 -- 172.21.15.2:0/1360742547 learned_addr learned my addr 172.21.15.2:0/1360742547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd795c00640 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250670ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 -- 172.21.15.2:0/1360742547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 msgr2=0x56250670ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250670ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 -- 172.21.15.2:0/1360742547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 msgr2=0x56250670e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796401640 1 -- 172.21.15.2:0/1360742547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625063d4650 con 0x5625063401b0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.279+0000 7fd796c02640 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd796401640 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250670e850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009c00 tx=0x7fd78c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180858bfb7d441ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd7877fe640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 0x7fd77c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd784ff9640 1 -- 172.21.15.2:0/1360742547 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c004230 con 0x5625063401b0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd796c02640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 0x7fd77c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd784ff9640 1 -- 172.21.15.2:0/1360742547 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c0043d0 con 0x5625063401b0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd784ff9640 1 -- 172.21.15.2:0/1360742547 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c004c30 con 0x5625063401b0 2024-08-31T04:29:06.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.280+0000 7fd7877fe640 1 -- 172.21.15.2:0/1900297449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd780105cd0 con 0x7fd790109250 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- 172.21.15.2:0/1360742547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 msgr2=0x56250670e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd796c02640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 0x7fd77c0b7230 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099a0 tx=0x7fd788009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250670e850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009c00 tx=0x7fd78c011810 comp rx=0 tx=0).stop 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- 172.21.15.2:0/1360742547 shutdown_connections 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250670ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250670e850 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 --2- 172.21.15.2:0/1360742547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x56250670e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- 172.21.15.2:0/1360742547 >> 172.21.15.2:0/1360742547 conn(0x56250635d460 msgr2=0x56250670c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- 172.21.15.2:0/1360742547 shutdown_connections 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- 172.21.15.2:0/1360742547 wait complete. 2024-08-31T04:29:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.281+0000 7fd79ebda740 1 -- start start 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 Processor -- start 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x562506719aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506369070 0x562506725e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625064d7700 con 0x562506348390 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5625065fb750 con 0x5625063401b0 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56250671caf0 con 0x562506369070 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd79ebda740 10 client.0 _ll_register_callbacks cb 0x56250662ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd796401640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x562506719aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42976/0 (socket says 172.21.15.2:42976) 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 -- 172.21.15.2:0/154512818 learned_addr learned my addr 172.21.15.2:0/154512818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd796c02640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506369070 0x562506725e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 -- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506369070 msgr2=0x562506725e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506369070 0x562506725e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 -- 172.21.15.2:0/154512818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 msgr2=0x562506719aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.282+0000 7fd795c00640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x562506719aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd795c00640 1 -- 172.21.15.2:0/154512818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562506634900 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd795c00640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd780031440 tx=0x7fd7800cbd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5034569877726a73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780049070 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd780103220 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd78c0043d0 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd780103420 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd79ebda740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562506728830 con 0x562506348390 2024-08-31T04:29:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c0043d0 con 0x562506348390 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.283+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd7800d03d0 con 0x562506348390 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 20 client.16098 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625063279f0 0x56250672bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 4 client.16098 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625066875d0 con 0x5625063279f0 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd796401640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625063279f0 0x56250672bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd779ffb640 10 client.16098 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.284+0000 7fd796401640 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625063279f0 0x56250672bc70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49df6043a8d5b062 server_cookie=e28318d50f9de70d in_seq=0 out_seq=0 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd779ffb640 1 -- 172.21.15.2:0/154512818 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625066875d0 con 0x5625063279f0 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd779ffb640 10 client.16098 handle_command_reply: tid=0 2024-08-31T04:29:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 client.16098 shutdown 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 msgr2=0x562506719fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd780031440 tx=0x7fd7800cbd10 comp rx=0 tx=0).stop 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 shutdown_connections 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625063279f0 0x56250672bc70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506348390 0x562506719fe0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506369070 0x562506725e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd779ffb640 0 client.16098 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 --2- 172.21.15.2:0/154512818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x562506719aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 >> 172.21.15.2:0/154512818 conn(0x56250635d460 msgr2=0x5625067114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 shutdown_connections 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 1 -- 172.21.15.2:0/154512818 wait complete. 2024-08-31T04:29:06.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.285+0000 7fd79ebda740 20 client.16098 trim_cache size 0 max 16384 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.298+0000 7fd79ebda740 1 Processor -- start 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.298+0000 7fd79ebda740 1 -- start start 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250671b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562506369070 0x562506725d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b5980 con 0x5625063401b0 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b3250 con 0x562506369070 2024-08-31T04:29:06.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd79ebda740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b10a0 con 0x562506348390 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42990/0 (socket says 172.21.15.2:42990) 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 -- 172.21.15.2:0/3924965812 learned_addr learned my addr 172.21.15.2:0/3924965812 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd795c00640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250671b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796c02640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562506369070 0x562506725d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 -- 172.21.15.2:0/3924965812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 msgr2=0x56250671b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250671b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 -- 172.21.15.2:0/3924965812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562506369070 msgr2=0x562506725d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562506369070 0x562506725d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 -- 172.21.15.2:0/3924965812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625067063d0 con 0x5625063401b0 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd795c00640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250671b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.299+0000 7fd796401640 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009b20 tx=0x7fd78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55ba89cd3cdb46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd77bfff640 1 -- 172.21.15.2:0/3924965812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c032070 con 0x5625063401b0 2024-08-31T04:29:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd77bfff640 1 -- 172.21.15.2:0/3924965812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c01f040 con 0x5625063401b0 2024-08-31T04:29:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd77bfff640 1 -- 172.21.15.2:0/3924965812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c01e040 con 0x5625063401b0 2024-08-31T04:29:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 -- 172.21.15.2:0/3924965812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 msgr2=0x56250670fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009b20 tx=0x7fd78c0046c0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 -- 172.21.15.2:0/3924965812 shutdown_connections 2024-08-31T04:29:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562506369070 0x562506725d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x56250671b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 --2- 172.21.15.2:0/3924965812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625063401b0 0x56250670fd00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 -- 172.21.15.2:0/3924965812 >> 172.21.15.2:0/3924965812 conn(0x56250635d460 msgr2=0x56250671afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 -- 172.21.15.2:0/3924965812 shutdown_connections 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.300+0000 7fd79ebda740 1 -- 172.21.15.2:0/3924965812 wait complete. 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 -- start start 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 Processor -- start 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250671fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x562506720380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b1710 con 0x562506369070 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b2b80 con 0x5625063401b0 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901b1de0 con 0x562506348390 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd796c02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd79ebda740 10 client.0 _ll_register_callbacks cb 0x7fd780005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd796401640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250671fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd796c02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43004/0 (socket says 172.21.15.2:43004) 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd796c02640 1 -- 172.21.15.2:0/2009846347 learned_addr learned my addr 172.21.15.2:0/2009846347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.301+0000 7fd795c00640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x562506720380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 -- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 msgr2=0x562506720380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x562506720380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 -- 172.21.15.2:0/2009846347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 msgr2=0x56250671fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250671fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 -- 172.21.15.2:0/2009846347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562506795710 con 0x562506369070 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd796c02640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd788010f30 tx=0x7fd788004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dea9426afa02f35 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788003970 con 0x562506369070 2024-08-31T04:29:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd788003b10 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd78c01f040 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd788034050 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd79ebda740 10 client.16104 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625067969e0 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.302+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c01f040 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd788028070 con 0x562506369070 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 10 client.16104 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 10 client.16104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 20 client.16104 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625062fcda0 0x562506799250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 4 client.16104 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562506683070 con 0x5625062fcda0 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd796401640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625062fcda0 0x562506799250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd779ffb640 10 client.16104 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd796401640 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625062fcda0 0x562506799250 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9eb7dcd1f74ffbe server_cookie=1d6f096853ed28b in_seq=0 out_seq=0 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd779ffb640 1 -- 172.21.15.2:0/2009846347 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562506683070 con 0x5625062fcda0 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.303+0000 7fd779ffb640 10 client.16104 handle_command_reply: tid=0 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 client.16104 shutdown 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 msgr2=0x5625067208c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd788010f30 tx=0x7fd788004ab0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 shutdown_connections 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5625062fcda0 0x562506799250 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562506369070 0x5625067208c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562506348390 0x562506720380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd779ffb640 0 client.16104 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 --2- 172.21.15.2:0/2009846347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5625063401b0 0x56250671fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 >> 172.21.15.2:0/2009846347 conn(0x56250635d460 msgr2=0x56250670fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 shutdown_connections 2024-08-31T04:29:06.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 1 -- 172.21.15.2:0/2009846347 wait complete. 2024-08-31T04:29:06.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd79ebda740 20 client.16104 trim_cache size 0 max 16384 2024-08-31T04:29:06.311 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 msgr2=0x7fd77c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 0x7fd77c0b7230 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd7880099a0 tx=0x7fd788009500 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 msgr2=0x7fd79019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.304+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd78002a930 tx=0x7fd780031a20 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 shutdown_connections 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd77c0b4d20 0x7fd77c0b7230 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd790109250 0x7fd79019a810 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd790109ba0 0x7fd79019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 --2- 172.21.15.2:0/1900297449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd790103960 0x7fd79019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 >> 172.21.15.2:0/1900297449 conn(0x7fd79007b6b0 msgr2=0x7fd7901052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 shutdown_connections 2024-08-31T04:29:06.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:06.305+0000 7fd798665640 1 -- 172.21.15.2:0/1900297449 wait complete. 2024-08-31T04:29:06.668 INFO:tasks.workunit.client.0.smithi002.stdout: 1 282566 12.77 MB/sec execute 26 sec latency 35.529 ms 2024-08-31T04:29:06.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:06 smithi002 ceph-mon[18656]: pgmap v449: 129 pgs: 129 active+clean; 163 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T04:29:07.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:29:07.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:06 smithi064 ceph-mon[22007]: pgmap v449: 129 pgs: 129 active+clean; 163 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T04:29:07.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:06 smithi132 ceph-mon[22335]: pgmap v449: 129 pgs: 129 active+clean; 163 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T04:29:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:07.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 284594 12.77 MB/sec execute 27 sec latency 16.123 ms 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 -- 172.21.15.2:0/1023712746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc10dbb0 msgr2=0x7faddc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 --2- 172.21.15.2:0/1023712746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc10dbb0 0x7faddc1100a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009ca0 tx=0x7fadd402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 -- 172.21.15.2:0/1023712746 shutdown_connections 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 --2- 172.21.15.2:0/1023712746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc10dbb0 0x7faddc1100a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 --2- 172.21.15.2:0/1023712746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc1050a0 0x7faddc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 --2- 172.21.15.2:0/1023712746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc104750 0x7faddc104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 -- 172.21.15.2:0/1023712746 >> 172.21.15.2:0/1023712746 conn(0x7faddc0794d0 msgr2=0x7faddc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 -- 172.21.15.2:0/1023712746 shutdown_connections 2024-08-31T04:29:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.859+0000 7fade27d0640 1 -- 172.21.15.2:0/1023712746 wait complete. 2024-08-31T04:29:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.860+0000 7fade27d0640 1 Processor -- start 2024-08-31T04:29:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.860+0000 7fade27d0640 1 -- start start 2024-08-31T04:29:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 0x7faddc19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc10dbb0 0x7faddc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faddc113830 con 0x7faddc104750 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1136b0 con 0x7faddc1050a0 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade27d0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1139b0 con 0x7faddc10dbb0 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 0x7faddc19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 0x7faddc19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43034/0 (socket says 172.21.15.2:43034) 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48708/0 (socket says 172.21.15.2:48708) 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddbfff640 1 -- 172.21.15.2:0/844910838 learned_addr learned my addr 172.21.15.2:0/844910838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7fade0d6d640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc10dbb0 0x7faddc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 -- 172.21.15.2:0/844910838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc10dbb0 msgr2=0x7faddc19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc10dbb0 0x7faddc19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 -- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 msgr2=0x7faddc19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 0x7faddc19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 -- 172.21.15.2:0/844910838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc1a02b0 con 0x7faddc1050a0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.861+0000 7faddb7fe640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faddc06aad0 tx=0x7fadd000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.862+0000 7fadd97fa640 1 -- 172.21.15.2:0/844910838 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000cc40 con 0x7faddc1050a0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.862+0000 7fadd97fa640 1 -- 172.21.15.2:0/844910838 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd000cde0 con 0x7faddc1050a0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.862+0000 7fadd97fa640 1 -- 172.21.15.2:0/844910838 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004a00 con 0x7faddc1050a0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.862+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faddc1a05a0 con 0x7faddc1050a0 2024-08-31T04:29:07.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.862+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faddc1a6d00 con 0x7faddc1050a0 2024-08-31T04:29:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.864+0000 7fadd97fa640 1 -- 172.21.15.2:0/844910838 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fadd0004ba0 con 0x7faddc1050a0 2024-08-31T04:29:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.864+0000 7fade8d45740 1 Processor -- start 2024-08-31T04:29:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 -- start start 2024-08-31T04:29:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d918310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d918d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d32d88f680 con 0x55d32d54a1b0 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d32d87ec10 con 0x55d32d573070 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade8d45740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d32d882bc0 con 0x55d32d552390 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43050/0 (socket says 172.21.15.2:43050) 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fade0d6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d918310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 -- 172.21.15.2:0/3466832677 learned_addr learned my addr 172.21.15.2:0/3466832677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddb7fe640 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d918d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7fadd97fa640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 0x7fadc40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 -- 172.21.15.2:0/3466832677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 msgr2=0x55d32d918d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d918d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 -- 172.21.15.2:0/3466832677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 msgr2=0x55d32d918310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d918310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.865+0000 7faddbfff640 1 -- 172.21.15.2:0/3466832677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32d5de650 con 0x55d32d54a1b0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7fadd97fa640 1 -- 172.21.15.2:0/844910838 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadd00e5830 con 0x7faddc1050a0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7fade0d6d640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 0x7fadc40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7faddbfff640 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009d90 tx=0x7fadcc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbfd9163b8f1966 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7fadc27fc640 1 -- 172.21.15.2:0/3466832677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc004230 con 0x55d32d54a1b0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7fadc27fc640 1 -- 172.21.15.2:0/3466832677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadcc0043d0 con 0x55d32d54a1b0 2024-08-31T04:29:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.866+0000 7fadc27fc640 1 -- 172.21.15.2:0/3466832677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc019820 con 0x55d32d54a1b0 2024-08-31T04:29:07.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- 172.21.15.2:0/3466832677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 msgr2=0x55d32d918850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009d90 tx=0x7fadcc011810 comp rx=0 tx=0).stop 2024-08-31T04:29:07.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade0d6d640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 0x7fadc40b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006010 tx=0x7fadd40095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- 172.21.15.2:0/3466832677 shutdown_connections 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d918850 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d918d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 --2- 172.21.15.2:0/3466832677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d918310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- 172.21.15.2:0/3466832677 >> 172.21.15.2:0/3466832677 conn(0x55d32d567460 msgr2=0x55d32d916200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- 172.21.15.2:0/3466832677 shutdown_connections 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- 172.21.15.2:0/3466832677 wait complete. 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.867+0000 7fade8d45740 1 -- start start 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 Processor -- start 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d54a1b0 0x55d32d927ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 0x55d32d928410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d32d6e1700 con 0x55d32d573070 2024-08-31T04:29:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d32d805750 con 0x55d32d552390 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d32d92ae20 con 0x55d32d54a1b0 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade8d45740 10 client.0 _ll_register_callbacks cb 0x55d32d834e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade0d6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade0d6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43056/0 (socket says 172.21.15.2:43056) 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7fade0d6d640 1 -- 172.21.15.2:0/3937606043 learned_addr learned my addr 172.21.15.2:0/3937606043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7faddb7fe640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 0x55d32d928410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.868+0000 7faddbfff640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d54a1b0 0x55d32d927ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 -- 172.21.15.2:0/3937606043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d54a1b0 msgr2=0x55d32d927ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d54a1b0 0x55d32d927ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 -- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 msgr2=0x55d32d928410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 0x55d32d928410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 -- 172.21.15.2:0/3937606043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32d83e900 con 0x55d32d573070 2024-08-31T04:29:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7faddb7fe640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 0x55d32d928410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade0d6d640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009c50 tx=0x7fadd402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15d1e5bcb764ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fadbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4003b80 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadd4003d20 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadcc0043d0 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadd4004040 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade8d45740 10 client.16116 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.869+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d32d936c60 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadcc0043d0 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fadd402fa70 con 0x55d32d573070 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 20 client.16116 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d5319f0 0x55d32d93a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 4 client.16116 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d32d8915d0 con 0x55d32d5319f0 2024-08-31T04:29:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.870+0000 7faddbfff640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d5319f0 0x55d32d93a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.871+0000 7fadbb7fe640 10 client.16116 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.871+0000 7faddbfff640 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d5319f0 0x55d32d93a1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32c2f65cf06d8540 server_cookie=e5f2c5a8b3561a36 in_seq=0 out_seq=0 2024-08-31T04:29:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.871+0000 7fadbb7fe640 1 -- 172.21.15.2:0/3937606043 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d32d8915d0 con 0x55d32d5319f0 2024-08-31T04:29:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.871+0000 7fadbb7fe640 10 client.16116 handle_command_reply: tid=0 2024-08-31T04:29:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.871+0000 7fade8d45740 1 client.16116 shutdown 2024-08-31T04:29:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 msgr2=0x55d32d934150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009c50 tx=0x7fadd402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 shutdown_connections 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d5319f0 0x55d32d93a1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d573070 0x55d32d934150 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d552390 0x55d32d928410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fadbb7fe640 0 client.16116 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 --2- 172.21.15.2:0/3937606043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d54a1b0 0x55d32d927ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 >> 172.21.15.2:0/3937606043 conn(0x55d32d567460 msgr2=0x55d32d91b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 shutdown_connections 2024-08-31T04:29:07.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 1 -- 172.21.15.2:0/3937606043 wait complete. 2024-08-31T04:29:07.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.872+0000 7fade8d45740 20 client.16116 trim_cache size 0 max 16384 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.885+0000 7fade8d45740 1 Processor -- start 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.885+0000 7fade8d45740 1 -- start start 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d916230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1b1670 con 0x55d32d54a1b0 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1aef40 con 0x55d32d573070 2024-08-31T04:29:07.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade8d45740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1acd90 con 0x55d32d552390 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade0d6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43058/0 (socket says 172.21.15.2:43058) 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 -- 172.21.15.2:0/3144012770 learned_addr learned my addr 172.21.15.2:0/3144012770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade0d6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48742/0 (socket says 172.21.15.2:48742) 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddb7fe640 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d916230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 -- 172.21.15.2:0/3144012770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 msgr2=0x55d32d916230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d916230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 -- 172.21.15.2:0/3144012770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 msgr2=0x55d32d934050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 -- 172.21.15.2:0/3144012770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32d917030 con 0x55d32d54a1b0 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7fade0d6d640 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.886+0000 7faddbfff640 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadcc011d10 tx=0x7fadcc019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876de337610b295b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.887+0000 7fadc1ffb640 1 -- 172.21.15.2:0/3144012770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc031070 con 0x55d32d54a1b0 2024-08-31T04:29:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.887+0000 7fadc1ffb640 1 -- 172.21.15.2:0/3144012770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadcc0053b0 con 0x55d32d54a1b0 2024-08-31T04:29:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.887+0000 7fadc1ffb640 1 -- 172.21.15.2:0/3144012770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc019490 con 0x55d32d54a1b0 2024-08-31T04:29:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- 172.21.15.2:0/3144012770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 msgr2=0x55d32d923680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadcc011d10 tx=0x7fadcc019420 comp rx=0 tx=0).stop 2024-08-31T04:29:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- 172.21.15.2:0/3144012770 shutdown_connections 2024-08-31T04:29:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d934050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d916230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 --2- 172.21.15.2:0/3144012770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d923680 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- 172.21.15.2:0/3144012770 >> 172.21.15.2:0/3144012770 conn(0x55d32d567460 msgr2=0x55d32d915b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- 172.21.15.2:0/3144012770 shutdown_connections 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- 172.21.15.2:0/3144012770 wait complete. 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 -- start start 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.888+0000 7fade8d45740 1 Processor -- start 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d92bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d92c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1ad400 con 0x55d32d54a1b0 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1ae870 con 0x55d32d573070 2024-08-31T04:29:07.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faddc1adad0 con 0x55d32d552390 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade8d45740 10 client.0 _ll_register_callbacks cb 0x7fadd4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43070/0 (socket says 172.21.15.2:43070) 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 -- 172.21.15.2:0/2086202505 learned_addr learned my addr 172.21.15.2:0/2086202505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fade0d6d640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d92c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddb7fe640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d92bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 -- 172.21.15.2:0/2086202505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 msgr2=0x55d32d92bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d92bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 -- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 msgr2=0x55d32d92c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d92c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 -- 172.21.15.2:0/2086202505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32d9a3b90 con 0x55d32d54a1b0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7faddbfff640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0058c0 tx=0x7fadcc0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85fa104bb0ce4c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.889+0000 7fadbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc031030 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fadcc02a040 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadcc0053b0 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadcc042050 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 10 client.16122 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d32d9a4c80 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadcc0053b0 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fadcc019620 con 0x55d32d54a1b0 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 10 client.16122 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 10 client.16122 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 20 client.16122 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d506da0 0x55d32d9a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 4 client.16122 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.890+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d32d88d070 con 0x55d32d506da0 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7faddb7fe640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d506da0 0x55d32d9a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7fadbb7fe640 10 client.16122 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7faddb7fe640 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d506da0 0x55d32d9a71e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7cb14c2f453e1c61 server_cookie=7532ab234e3a6339 in_seq=0 out_seq=0 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7fadbb7fe640 1 -- 172.21.15.2:0/2086202505 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d32d88d070 con 0x55d32d506da0 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7fadbb7fe640 10 client.16122 handle_command_reply: tid=0 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7fade8d45740 1 client.16122 shutdown 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.891+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 msgr2=0x55d32d930a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0058c0 tx=0x7fadcc0095e0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 shutdown_connections 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d32d573070 0x55d32d92c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d32d552390 0x55d32d92bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55d32d506da0 0x55d32d9a71e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 --2- 172.21.15.2:0/2086202505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d32d54a1b0 0x55d32d930a50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 >> 172.21.15.2:0/2086202505 conn(0x55d32d567460 msgr2=0x55d32d919340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fadbb7fe640 0 client.16122 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 shutdown_connections 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 1 -- 172.21.15.2:0/2086202505 wait complete. 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade8d45740 20 client.16122 trim_cache size 0 max 16384 2024-08-31T04:29:07.898 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 msgr2=0x7fadc40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 0x7fadc40b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006010 tx=0x7fadd40095c0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 msgr2=0x7faddc19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.892+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faddc06aad0 tx=0x7fadd000ee50 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 shutdown_connections 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faddc10dbb0 0x7faddc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faddc1050a0 0x7faddc19a8e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fadc40b4ca0 0x7fadc40b71b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 --2- 172.21.15.2:0/844910838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc104750 0x7faddc19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 >> 172.21.15.2:0/844910838 conn(0x7faddc0794d0 msgr2=0x7faddc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 shutdown_connections 2024-08-31T04:29:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:07.893+0000 7fade27d0640 1 -- 172.21.15.2:0/844910838 wait complete. 2024-08-31T04:29:08.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:29:08.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 287641 12.96 MB/sec execute 28 sec latency 19.160 ms 2024-08-31T04:29:08.892 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:08 smithi002 ceph-mon[18656]: pgmap v450: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 356 op/s 2024-08-31T04:29:09.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:08 smithi064 ceph-mon[22007]: pgmap v450: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 356 op/s 2024-08-31T04:29:09.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:08 smithi132 ceph-mon[22335]: pgmap v450: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 356 op/s 2024-08-31T04:29:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 -- 172.21.15.2:0/4002425536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 msgr2=0x7febe80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 --2- 172.21.15.2:0/4002425536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a1af0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7febe4009900 tx=0x7febe402a410 comp rx=0 tx=0).stop 2024-08-31T04:29:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 -- 172.21.15.2:0/4002425536 shutdown_connections 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 --2- 172.21.15.2:0/4002425536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a1af0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 --2- 172.21.15.2:0/4002425536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 0x7febe809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 --2- 172.21.15.2:0/4002425536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 0x7febe8095440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 -- 172.21.15.2:0/4002425536 >> 172.21.15.2:0/4002425536 conn(0x7febe800cd80 msgr2=0x7febe800d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 -- 172.21.15.2:0/4002425536 shutdown_connections 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 -- 172.21.15.2:0/4002425536 wait complete. 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.574+0000 7febf6edb640 1 Processor -- start 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 -- start start 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 0x7febe80a2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 0x7febe80a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febe80a6000 con 0x7febe809b2c0 2024-08-31T04:29:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7febe80a5e80 con 0x7febe809a970 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf6edb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7febe80a6180 con 0x7febe8095030 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43096/0 (socket says 172.21.15.2:43096) 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 -- 172.21.15.2:0/4084945630 learned_addr learned my addr 172.21.15.2:0/4084945630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf56d8640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 0x7febe80a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf5ed9640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 0x7febe80a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 -- 172.21.15.2:0/4084945630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 msgr2=0x7febe80a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 0x7febe80a2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 -- 172.21.15.2:0/4084945630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 msgr2=0x7febe80a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 0x7febe80a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.575+0000 7febf66da640 1 -- 172.21.15.2:0/4084945630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe813acb0 con 0x7febe809b2c0 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febf66da640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7febe4004770 tx=0x7febe4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febe2ffd640 1 -- 172.21.15.2:0/4084945630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe403f030 con 0x7febe809b2c0 2024-08-31T04:29:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe813af40 con 0x7febe809b2c0 2024-08-31T04:29:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe813b390 con 0x7febe809b2c0 2024-08-31T04:29:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febe2ffd640 1 -- 172.21.15.2:0/4084945630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe4004440 con 0x7febe809b2c0 2024-08-31T04:29:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.576+0000 7febe2ffd640 1 -- 172.21.15.2:0/4084945630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4049060 con 0x7febe809b2c0 2024-08-31T04:29:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 Processor -- start 2024-08-31T04:29:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febe2ffd640 1 -- 172.21.15.2:0/4084945630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7febe4042030 con 0x7febe809b2c0 2024-08-31T04:29:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 -- start start 2024-08-31T04:29:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b6294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b629f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55724b5a0680 con 0x55724b284070 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55724b58fc10 con 0x55724b25b1b0 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.579+0000 7febfe6b2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55724b593bc0 con 0x55724b263390 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48788/0 (socket says 172.21.15.2:48788) 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 -- 172.21.15.2:0/1821458697 learned_addr learned my addr 172.21.15.2:0/1821458697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf56d8640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b6294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf56d8640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b629f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 -- 172.21.15.2:0/1821458697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 msgr2=0x55724b629f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b629f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 -- 172.21.15.2:0/1821458697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 msgr2=0x55724b6294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febe2ffd640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 0x7febdc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b6294b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf5ed9640 1 -- 172.21.15.2:0/1821458697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724b2ef650 con 0x55724b25b1b0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf56d8640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b629f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febe2ffd640 1 -- 172.21.15.2:0/4084945630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7febe41055e0 con 0x7febe809b2c0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.580+0000 7febf66da640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 0x7febdc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.581+0000 7febf5ed9640 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febec009c90 tx=0x7febec011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c1534c75859807 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.581+0000 7febdbfff640 1 -- 172.21.15.2:0/1821458697 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec005220 con 0x55724b25b1b0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.581+0000 7febf66da640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 0x7febdc0b7230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7febe4009a20 tx=0x7febe4094ad0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.581+0000 7febdbfff640 1 -- 172.21.15.2:0/1821458697 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec004c50 con 0x55724b25b1b0 2024-08-31T04:29:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.581+0000 7febdbfff640 1 -- 172.21.15.2:0/1821458697 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0196b0 con 0x55724b25b1b0 2024-08-31T04:29:09.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 -- 172.21.15.2:0/1821458697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 msgr2=0x55724b6299f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febec009c90 tx=0x7febec011810 comp rx=0 tx=0).stop 2024-08-31T04:29:09.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 -- 172.21.15.2:0/1821458697 shutdown_connections 2024-08-31T04:29:09.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b629f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b6299f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 --2- 172.21.15.2:0/1821458697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b6294b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 -- 172.21.15.2:0/1821458697 >> 172.21.15.2:0/1821458697 conn(0x55724b278460 msgr2=0x55724b6273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 -- 172.21.15.2:0/1821458697 shutdown_connections 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.582+0000 7febfe6b2740 1 -- 172.21.15.2:0/1821458697 wait complete. 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 -- start start 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 Processor -- start 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b634bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b641010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55724b3f2700 con 0x55724b284070 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55724b516750 con 0x55724b25b1b0 2024-08-31T04:29:09.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55724b637c90 con 0x55724b263390 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febf5ed9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf56d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b634bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.583+0000 7febfe6b2740 10 client.0 _ll_register_callbacks cb 0x55724b545e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:55696/0 (socket says 172.21.15.2:55696) 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 -- 172.21.15.2:0/2743518970 learned_addr learned my addr 172.21.15.2:0/2743518970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf56d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b634bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48796/0 (socket says 172.21.15.2:48796) 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf56d8640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b641010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 -- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 msgr2=0x55724b634bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b634bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 -- 172.21.15.2:0/2743518970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 msgr2=0x55724b641010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b641010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 -- 172.21.15.2:0/2743518970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724b54f900 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febf5ed9640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febec01b040 tx=0x7febec009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1da8912dd536e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec005030 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7febec0051d0 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.584+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febec004c50 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febec03d050 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 10 client.25702 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55724b643990 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec0053d0 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7febec019430 con 0x55724b263390 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 10 client.25702 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 10 client.25702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:09.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 20 client.25702 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b2429f0 0x55724b646e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 4 client.25702 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7febec004c50 con 0x55724b2429f0 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.585+0000 7febf56d8640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b2429f0 0x55724b646e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.586+0000 7febf56d8640 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b2429f0 0x55724b646e00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59824585893ccb80 server_cookie=2c6d4d67c6350749 in_seq=0 out_seq=0 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.586+0000 7febd97fa640 10 client.25702 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febd97fa640 1 -- 172.21.15.2:0/2743518970 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7febec004c50 con 0x55724b2429f0 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febd97fa640 10 client.25702 handle_command_reply: tid=0 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 client.25702 shutdown 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 msgr2=0x55724b635130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febec01b040 tx=0x7febec009640 comp rx=0 tx=0).stop 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 shutdown_connections 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b2429f0 0x55724b646e00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b641010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b635130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 --2- 172.21.15.2:0/2743518970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b634bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 >> 172.21.15.2:0/2743518970 conn(0x55724b278460 msgr2=0x55724b62a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febd97fa640 0 client.25702 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 shutdown_connections 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.587+0000 7febfe6b2740 1 -- 172.21.15.2:0/2743518970 wait complete. 2024-08-31T04:29:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.588+0000 7febfe6b2740 20 client.25702 trim_cache size 0 max 16384 2024-08-31T04:29:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 Processor -- start 2024-08-31T04:29:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 -- start start 2024-08-31T04:29:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b62aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b640f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febd4012a90 con 0x55724b284070 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7febd4010360 con 0x55724b25b1b0 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febfe6b2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7febd400e1b0 con 0x55724b263390 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43116/0 (socket says 172.21.15.2:43116) 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 -- 172.21.15.2:0/4168170992 learned_addr learned my addr 172.21.15.2:0/4168170992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b62aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf5ed9640 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b640f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 -- 172.21.15.2:0/4168170992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 msgr2=0x55724b640f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b640f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 -- 172.21.15.2:0/4168170992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 msgr2=0x55724b62aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b62aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.602+0000 7febf56d8640 1 -- 172.21.15.2:0/4168170992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724b626820 con 0x55724b284070 2024-08-31T04:29:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.603+0000 7febf56d8640 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7febf0052600 tx=0x7febf0069bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59482807bb590c7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.603+0000 7febdb7fe640 1 -- 172.21.15.2:0/4168170992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00790d0 con 0x55724b284070 2024-08-31T04:29:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.603+0000 7febdb7fe640 1 -- 172.21.15.2:0/4168170992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf009a070 con 0x55724b284070 2024-08-31T04:29:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.603+0000 7febdb7fe640 1 -- 172.21.15.2:0/4168170992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00897c0 con 0x55724b284070 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- 172.21.15.2:0/4168170992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 msgr2=0x55724b636820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7febf0052600 tx=0x7febf0069bb0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- 172.21.15.2:0/4168170992 shutdown_connections 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b284070 0x55724b636820 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b263390 0x55724b640f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 --2- 172.21.15.2:0/4168170992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b25b1b0 0x55724b62aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- 172.21.15.2:0/4168170992 >> 172.21.15.2:0/4168170992 conn(0x55724b278460 msgr2=0x55724b636110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- 172.21.15.2:0/4168170992 shutdown_connections 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- 172.21.15.2:0/4168170992 wait complete. 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.604+0000 7febfe6b2740 1 -- start start 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 Processor -- start 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 0x55724b6395c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b284070 0x55724b639b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febd400e820 con 0x55724b25b1b0 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7febd400fc90 con 0x55724b263390 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7febd400eef0 con 0x55724b284070 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febf56d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febf56d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43132/0 (socket says 172.21.15.2:43132) 2024-08-31T04:29:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febf56d8640 1 -- 172.21.15.2:0/134202103 learned_addr learned my addr 172.21.15.2:0/134202103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febf5ed9640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 0x55724b6395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febfe6b2740 10 client.0 _ll_register_callbacks cb 0x7febf0069cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.605+0000 7febf56d8640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b284070 0x55724b639b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 -- 172.21.15.2:0/134202103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b284070 msgr2=0x55724b639b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b284070 0x55724b639b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 -- 172.21.15.2:0/134202103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 msgr2=0x55724b639080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 -- 172.21.15.2:0/134202103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724b6b0850 con 0x55724b263390 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf56d8640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febf5ed9640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 0x55724b6395c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febec009c90 tx=0x7febec0099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655ad23445d30f3d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0049d0 con 0x55724b263390 2024-08-31T04:29:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7febec004b70 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.606+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf009a070 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febec019a40 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 10 client.25859 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55724b6b1ab0 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf009a070 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7febec005130 con 0x55724b263390 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 10 client.25859 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 10 client.25859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 20 client.25859 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b217da0 0x55724b6b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 4 client.25859 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55724b5a25d0 con 0x55724b217da0 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.607+0000 7febf56d8640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b217da0 0x55724b6b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.608+0000 7febd97fa640 10 client.25859 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.608+0000 7febf56d8640 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b217da0 0x55724b6b41d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37606b76d8ddb180 server_cookie=bfee0de04becb675 in_seq=0 out_seq=0 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febd97fa640 1 -- 172.21.15.2:0/134202103 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55724b5a25d0 con 0x55724b217da0 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febd97fa640 10 client.25859 handle_command_reply: tid=0 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 client.25859 shutdown 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 msgr2=0x55724b6395c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 0x55724b6395c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febec009c90 tx=0x7febec0099d0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 shutdown_connections 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55724b217da0 0x55724b6b41d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febd97fa640 0 client.25859 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55724b284070 0x55724b639b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55724b263390 0x55724b6395c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 --2- 172.21.15.2:0/134202103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724b25b1b0 0x55724b639080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 >> 172.21.15.2:0/134202103 conn(0x55724b278460 msgr2=0x55724b62ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 shutdown_connections 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 1 -- 172.21.15.2:0/134202103 wait complete. 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.609+0000 7febfe6b2740 20 client.25859 trim_cache size 0 max 16384 2024-08-31T04:29:09.616 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 msgr2=0x7febdc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 0x7febdc0b7230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7febe4009a20 tx=0x7febe4094ad0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 msgr2=0x7febe80a2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7febe4004770 tx=0x7febe4004040 comp rx=0 tx=0).stop 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 shutdown_connections 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7febdc0b4d20 0x7febdc0b7230 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe809b2c0 0x7febe80a2ed0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febe809a970 0x7febe80a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 --2- 172.21.15.2:0/4084945630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe8095030 0x7febe80a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 >> 172.21.15.2:0/4084945630 conn(0x7febe800cd80 msgr2=0x7febe80989c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 shutdown_connections 2024-08-31T04:29:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:09.610+0000 7febf6edb640 1 -- 172.21.15.2:0/4084945630 wait complete. 2024-08-31T04:29:09.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 289830 12.79 MB/sec execute 29 sec latency 58.943 ms 2024-08-31T04:29:10.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 291854 12.78 MB/sec execute 30 sec latency 27.010 ms 2024-08-31T04:29:11.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:10 smithi002 ceph-mon[18656]: pgmap v451: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 305 op/s 2024-08-31T04:29:11.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:10 smithi064 ceph-mon[22007]: pgmap v451: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 305 op/s 2024-08-31T04:29:11.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:10 smithi132 ceph-mon[22335]: pgmap v451: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 305 op/s 2024-08-31T04:29:11.553 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:29:11.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:29:11.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 294802 12.95 MB/sec execute 31 sec latency 15.590 ms 2024-08-31T04:29:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 -- 172.21.15.2:0/256688882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108ac0 msgr2=0x7f292010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 --2- 172.21.15.2:0/256688882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108ac0 0x7f292010f2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2918009ca0 tx=0x7f291802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 -- 172.21.15.2:0/256688882 shutdown_connections 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 --2- 172.21.15.2:0/256688882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108ac0 0x7f292010f2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 --2- 172.21.15.2:0/256688882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108170 0x7f2920108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 --2- 172.21.15.2:0/256688882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f2920102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 -- 172.21.15.2:0/256688882 >> 172.21.15.2:0/256688882 conn(0x7f2920079500 msgr2=0x7f2920079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 -- 172.21.15.2:0/256688882 shutdown_connections 2024-08-31T04:29:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.327+0000 7f29283d9640 1 -- 172.21.15.2:0/256688882 wait complete. 2024-08-31T04:29:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.328+0000 7f29283d9640 1 Processor -- start 2024-08-31T04:29:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.328+0000 7f29283d9640 1 -- start start 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f292019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108ac0 0x7f292019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112740 con 0x7f2920108170 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29201125c0 con 0x7f2920108ac0 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f29283d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29201128c0 con 0x7f2920102880 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43150/0 (socket says 172.21.15.2:43150) 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 -- 172.21.15.2:0/1881801749 learned_addr learned my addr 172.21.15.2:0/1881801749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2926175640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f292019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2926976640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108ac0 0x7f292019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 -- 172.21.15.2:0/1881801749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 msgr2=0x7f292019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f292019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 -- 172.21.15.2:0/1881801749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108ac0 msgr2=0x7f292019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108ac0 0x7f292019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2925974640 1 -- 172.21.15.2:0/1881801749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29201a6280 con 0x7f2920108170 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.329+0000 7f2926175640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f292019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f2925974640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f291000e9c0 tx=0x7f291000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f29177fe640 1 -- 172.21.15.2:0/1881801749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000cd80 con 0x7f2920108170 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2920198dc0 con 0x7f2920108170 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f29177fe640 1 -- 172.21.15.2:0/1881801749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29100054d0 con 0x7f2920108170 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f29177fe640 1 -- 172.21.15.2:0/1881801749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910010430 con 0x7f2920108170 2024-08-31T04:29:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.330+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2920199300 con 0x7f2920108170 2024-08-31T04:29:12.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f29177fe640 1 -- 172.21.15.2:0/1881801749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f29100105d0 con 0x7f2920108170 2024-08-31T04:29:12.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f292e94e740 1 Processor -- start 2024-08-31T04:29:12.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f292e94e740 1 -- start start 2024-08-31T04:29:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f292e94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 0x55855d5f3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f292e94e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 0x55855d5f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f29177fe640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 0x7f290c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.333+0000 7f292e94e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d22c670 0x55855d5f4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f292e94e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55855d5695f0 con 0x55855d22c670 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f292e94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55855d558b80 con 0x55855d24d350 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f292e94e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55855d55cb30 con 0x55855d224490 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2925974640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 0x7f290c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926976640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 0x55855d5f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 0x55855d5f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926976640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 0x55855d5f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48862/0 (socket says 172.21.15.2:48862) 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926976640 1 -- 172.21.15.2:0/1272597338 learned_addr learned my addr 172.21.15.2:0/1272597338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926976640 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d22c670 0x55855d5f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f29177fe640 1 -- 172.21.15.2:0/1881801749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f29100e5d70 con 0x7f2920108170 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 -- 172.21.15.2:0/1272597338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 msgr2=0x55855d5f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 0x55855d5f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 -- 172.21.15.2:0/1272597338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d22c670 msgr2=0x55855d5f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d22c670 0x55855d5f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 -- 172.21.15.2:0/1272597338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855d2b8930 con 0x55855d224490 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2926175640 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 0x55855d5f3cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f291c009fa0 tx=0x7f291c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b900980ac802037 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.334+0000 7f2925974640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 0x7f290c0b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2910076030 tx=0x7f29100dc240 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.335+0000 7f2914d9a640 1 -- 172.21.15.2:0/1272597338 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c0040f0 con 0x55855d224490 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.335+0000 7f2914d9a640 1 -- 172.21.15.2:0/1272597338 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291c0054d0 con 0x55855d224490 2024-08-31T04:29:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.335+0000 7f2914d9a640 1 -- 172.21.15.2:0/1272597338 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c004d20 con 0x55855d224490 2024-08-31T04:29:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- 172.21.15.2:0/1272597338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 msgr2=0x55855d5f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 0x55855d5f3cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f291c009fa0 tx=0x7f291c0118d0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- 172.21.15.2:0/1272597338 shutdown_connections 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d22c670 0x55855d5f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d224490 0x55855d5f3cc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 --2- 172.21.15.2:0/1272597338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d24d350 0x55855d5f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- 172.21.15.2:0/1272597338 >> 172.21.15.2:0/1272597338 conn(0x55855d241740 msgr2=0x55855d5f1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- 172.21.15.2:0/1272597338 shutdown_connections 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- 172.21.15.2:0/1272597338 wait complete. 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 -- start start 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.336+0000 7f292e94e740 1 Processor -- start 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 0x55855d5ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d24d350 0x55855d60b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55855d3bb890 con 0x55855d224490 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55855d4df790 con 0x55855d22c670 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55855d601f60 con 0x55855d24d350 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f292e94e740 10 client.0 _ll_register_callbacks cb 0x55855d264ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926175640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 0x55855d5ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43174/0 (socket says 172.21.15.2:43174) 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 -- 172.21.15.2:0/2871648725 learned_addr learned my addr 172.21.15.2:0/2871648725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d24d350 0x55855d60b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 -- 172.21.15.2:0/2871648725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d24d350 msgr2=0x55855d60b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d24d350 0x55855d60b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 -- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 msgr2=0x55855d5ff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 0x55855d5ff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926976640 1 -- 172.21.15.2:0/2871648725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855d516f30 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.337+0000 7f2926175640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 0x55855d5ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2926976640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2918005e30 tx=0x7f291802f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a49b74432191f0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918054060 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f29180317c0 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291c0054d0 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f291805b050 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55855d60dca0 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291c0054d0 con 0x55855d224490 2024-08-31T04:29:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f291803cb10 con 0x55855d224490 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 20 client.16152 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d20bcd0 0x55855d611180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 4 client.16152 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.338+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55855d56b540 con 0x55855d20bcd0 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.339+0000 7f2926175640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d20bcd0 0x55855d611180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.339+0000 7f2909ffb640 10 client.16152 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.339+0000 7f2926175640 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d20bcd0 0x55855d611180 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdcc94320cfb7dfa server_cookie=917cc09d64a2a6ce in_seq=0 out_seq=0 2024-08-31T04:29:12.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f2909ffb640 1 -- 172.21.15.2:0/2871648725 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55855d56b540 con 0x55855d20bcd0 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f2909ffb640 10 client.16152 handle_command_reply: tid=0 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f292e94e740 1 client.16152 shutdown 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 msgr2=0x55855d5fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2918005e30 tx=0x7f291802f390 comp rx=0 tx=0).stop 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 shutdown_connections 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.341+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d20bcd0 0x55855d611180 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d24d350 0x55855d60b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f2909ffb640 0 client.16152 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d22c670 0x55855d5ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 --2- 172.21.15.2:0/2871648725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d5fee60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 >> 172.21.15.2:0/2871648725 conn(0x55855d241740 msgr2=0x55855d5f6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 shutdown_connections 2024-08-31T04:29:12.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 1 -- 172.21.15.2:0/2871648725 wait complete. 2024-08-31T04:29:12.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.342+0000 7f292e94e740 20 client.16152 trim_cache size 0 max 16384 2024-08-31T04:29:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 Processor -- start 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 -- start start 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 0x55855d5f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d5f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b1420 con 0x55855d20bcd0 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29201aecf0 con 0x55855d224490 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f292e94e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29201acb40 con 0x55855d22c670 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f2926976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f2926175640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 0x55855d5f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f2926976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43188/0 (socket says 172.21.15.2:43188) 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.363+0000 7f2926976640 1 -- 172.21.15.2:0/4284006999 learned_addr learned my addr 172.21.15.2:0/4284006999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926976640 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d5f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 -- 172.21.15.2:0/4284006999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 msgr2=0x55855d5f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d5f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 -- 172.21.15.2:0/4284006999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 msgr2=0x55855d600a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 -- 172.21.15.2:0/4284006999 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855d5fd360 con 0x55855d224490 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926976640 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f2926175640 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 0x55855d5f0ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f291c004880 tx=0x7f291c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e01dfb4c22c381 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f290bfff640 1 -- 172.21.15.2:0/4284006999 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c0035f0 con 0x55855d224490 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f290bfff640 1 -- 172.21.15.2:0/4284006999 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291c02f030 con 0x55855d224490 2024-08-31T04:29:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.364+0000 7f290bfff640 1 -- 172.21.15.2:0/4284006999 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c024590 con 0x55855d224490 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 -- 172.21.15.2:0/4284006999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 msgr2=0x55855d5f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 0x55855d5f0ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f291c004880 tx=0x7f291c0118d0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 -- 172.21.15.2:0/4284006999 shutdown_connections 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d5f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d224490 0x55855d5f0ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 --2- 172.21.15.2:0/4284006999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d20bcd0 0x55855d600a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 -- 172.21.15.2:0/4284006999 >> 172.21.15.2:0/4284006999 conn(0x55855d241740 msgr2=0x55855d600380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 -- 172.21.15.2:0/4284006999 shutdown_connections 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.365+0000 7f292e94e740 1 -- 172.21.15.2:0/4284006999 wait complete. 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 -- start start 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 Processor -- start 2024-08-31T04:29:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 0x55855d603b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d604110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d674bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ad1b0 con 0x55855d224490 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ae620 con 0x55855d20bcd0 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ad880 con 0x55855d22c670 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f292e94e740 10 client.0 _ll_register_callbacks cb 0x7f2918031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f2926976640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 0x55855d603b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f2926175640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d604110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f2926976640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 0x55855d603b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48906/0 (socket says 172.21.15.2:48906) 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.366+0000 7f2926976640 1 -- 172.21.15.2:0/3742529499 learned_addr learned my addr 172.21.15.2:0/3742529499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926976640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d674bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 -- 172.21.15.2:0/3742529499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 msgr2=0x55855d674bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d674bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 -- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 msgr2=0x55855d603b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 0x55855d603b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 -- 172.21.15.2:0/3742529499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855d675230 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926976640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d674bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2926175640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d604110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f291c0057c0 tx=0x7f291c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a5b025a30adec0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c037070 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291c02f030 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f291c0035f0 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f291c005c50 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.367+0000 7f292e94e740 10 client.16158 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55855d67c590 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291c02f030 con 0x55855d224490 2024-08-31T04:29:12.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f291c024a10 con 0x55855d224490 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 10 client.16158 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 20 client.16158 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d24d350 0x55855d67eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 4 client.16158 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55855d566fe0 con 0x55855d24d350 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.368+0000 7f2926976640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d24d350 0x55855d67eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.369+0000 7f2909ffb640 10 client.16158 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.369+0000 7f2926976640 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d24d350 0x55855d67eab0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee4d7d5a899579d server_cookie=a530c9bf3759c4d8 in_seq=0 out_seq=0 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f2909ffb640 1 -- 172.21.15.2:0/3742529499 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55855d566fe0 con 0x55855d24d350 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f2909ffb640 10 client.16158 handle_command_reply: tid=0 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 client.16158 shutdown 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 msgr2=0x55855d604110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d604110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f291c0057c0 tx=0x7f291c009ed0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 shutdown_connections 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55855d24d350 0x55855d67eab0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55855d224490 0x55855d604110 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55855d22c670 0x55855d674bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 --2- 172.21.15.2:0/3742529499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55855d20bcd0 0x55855d603b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f2909ffb640 0 client.16158 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 >> 172.21.15.2:0/3742529499 conn(0x55855d241740 msgr2=0x55855d600c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.374+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 shutdown_connections 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f292e94e740 1 -- 172.21.15.2:0/3742529499 wait complete. 2024-08-31T04:29:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f292e94e740 20 client.16158 trim_cache size 0 max 16384 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7be2b730-d0a5-4d56-bf6c-4616345a7b27", 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 msgr2=0x7f290c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 0x7f290c0b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2910076030 tx=0x7f29100dc240 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 msgr2=0x7f292019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f291000e9c0 tx=0x7f291000ee80 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 shutdown_connections 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f290c0b4ca0 0x7f290c0b71b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920108170 0x7f292019b4b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2920108ac0 0x7f292019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 --2- 172.21.15.2:0/1881801749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2920102880 0x7f292019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 >> 172.21.15.2:0/1881801749 conn(0x7f2920079500 msgr2=0x7f2920104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 shutdown_connections 2024-08-31T04:29:12.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:12.375+0000 7f29283d9640 1 -- 172.21.15.2:0/1881801749 wait complete. 2024-08-31T04:29:12.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 297205 12.89 MB/sec execute 32 sec latency 56.816 ms 2024-08-31T04:29:13.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:12 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:12 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:12 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:13.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 299461 12.90 MB/sec execute 33 sec latency 25.461 ms 2024-08-31T04:29:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 -- 172.21.15.2:0/2894325701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc104f30 msgr2=0x7f1bcc105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 --2- 172.21.15.2:0/2894325701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc104f30 0x7f1bcc105340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009900 tx=0x7f1bbc02a410 comp rx=0 tx=0).stop 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 -- 172.21.15.2:0/2894325701 shutdown_connections 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 --2- 172.21.15.2:0/2894325701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc104f30 0x7f1bcc105340 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 --2- 172.21.15.2:0/2894325701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc105880 0x7f1bcc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 --2- 172.21.15.2:0/2894325701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 -- 172.21.15.2:0/2894325701 >> 172.21.15.2:0/2894325701 conn(0x7f1bcc077a00 msgr2=0x7f1bcc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 -- 172.21.15.2:0/2894325701 shutdown_connections 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.059+0000 7f1bd33db640 1 -- 172.21.15.2:0/2894325701 wait complete. 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 Processor -- start 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 -- start start 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc104f30 0x7f1bcc19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc105880 0x7f1bcc19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1126f0 con 0x7f1bcc105880 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc112570 con 0x7f1bcc102f60 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd33db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc112870 con 0x7f1bcc104f30 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc105880 0x7f1bcc19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48922/0 (socket says 172.21.15.2:48922) 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 -- 172.21.15.2:0/1758894584 learned_addr learned my addr 172.21.15.2:0/1758894584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd0976640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc104f30 0x7f1bcc19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 -- 172.21.15.2:0/1758894584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc104f30 msgr2=0x7f1bcc19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc104f30 0x7f1bcc19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 -- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc105880 msgr2=0x7f1bcc19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc105880 0x7f1bcc19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.060+0000 7f1bd1177640 1 -- 172.21.15.2:0/1758894584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc1a0220 con 0x7f1bcc102f60 2024-08-31T04:29:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bd1177640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800ea60 tx=0x7f1bc800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bc27fc640 1 -- 172.21.15.2:0/1758894584 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800cde0 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc1a0510 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bc27fc640 1 -- 172.21.15.2:0/1758894584 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc80035f0 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bc27fc640 1 -- 172.21.15.2:0/1758894584 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8010690 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.061+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc1a6c70 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.064+0000 7f1bd9950740 1 Processor -- start 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.064+0000 7f1bd9950740 1 -- start start 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcc7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bc27fc640 1 -- 172.21.15.2:0/1758894584 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1bc80037a0 con 0x7f1bcc102f60 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcc7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e48fc3e630 con 0x55e48f901390 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e48fc2dbc0 con 0x55e48f922070 2024-08-31T04:29:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd9950740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e48fc31b70 con 0x55e48f8f91b0 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcc7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48924/0 (socket says 172.21.15.2:48924) 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcc7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43230/0 (socket says 172.21.15.2:43230) 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 -- 172.21.15.2:0/209384789 learned_addr learned my addr 172.21.15.2:0/209384789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1177640 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcc7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 -- 172.21.15.2:0/209384789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 msgr2=0x55e48fcc7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcc7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 -- 172.21.15.2:0/209384789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 msgr2=0x55e48fcc7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcc7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.065+0000 7f1bd1978640 1 -- 172.21.15.2:0/209384789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e48f98d650 con 0x55e48f922070 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bd1978640 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009f70 tx=0x7f1bc4010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a6bdba6d4caf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bb77fe640 1 -- 172.21.15.2:0/209384789 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4016070 con 0x55e48f922070 2024-08-31T04:29:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bc27fc640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 0x7f1bb80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bb77fe640 1 -- 172.21.15.2:0/209384789 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc4004d20 con 0x55e48f922070 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bb77fe640 1 -- 172.21.15.2:0/209384789 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40127d0 con 0x55e48f922070 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bd1177640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 0x7f1bb80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.066+0000 7f1bc27fc640 1 -- 172.21.15.2:0/1758894584 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bc80e5c10 con 0x7f1bcc102f60 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- 172.21.15.2:0/209384789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 msgr2=0x55e48fcc72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009f70 tx=0x7f1bc4010800 comp rx=0 tx=0).stop 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd1177640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 0x7f1bb80b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80e2ff0 tx=0x7f1bc80e9760 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- 172.21.15.2:0/209384789 shutdown_connections 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcc7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcc7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 --2- 172.21.15.2:0/209384789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcc72c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- 172.21.15.2:0/209384789 >> 172.21.15.2:0/209384789 conn(0x55e48f916460 msgr2=0x55e48fcc51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- 172.21.15.2:0/209384789 shutdown_connections 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- 172.21.15.2:0/209384789 wait complete. 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.067+0000 7f1bd9950740 1 -- start start 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 Processor -- start 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcdede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e48fa90700 con 0x55e48f901390 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e48fbb4700 con 0x55e48f922070 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e48fcd5af0 con 0x55e48f8f91b0 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd9950740 10 client.0 _ll_register_callbacks cb 0x55e48fbe3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43246/0 (socket says 172.21.15.2:43246) 2024-08-31T04:29:14.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd0976640 1 -- 172.21.15.2:0/3577033174 learned_addr learned my addr 172.21.15.2:0/3577033174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:55772/0 (socket says 172.21.15.2:55772) 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.068+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcdede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 -- 172.21.15.2:0/3577033174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 msgr2=0x55e48fcd2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 -- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 msgr2=0x55e48fcdede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcdede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 -- 172.21.15.2:0/3577033174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e48fbed8b0 con 0x55e48f901390 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009900 tx=0x7f1bbc032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65179f4b4f591c9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc035040 con 0x55e48f901390 2024-08-31T04:29:14.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bbc0317e0 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc4004d20 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1bbc004040 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd9950740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.069+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e48fce1910 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc4004d20 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1bbc004750 con 0x55e48f901390 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 20 client.16170 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f8e09f0 0x55e48fce4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 4 client.16170 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e48fc40580 con 0x55e48f8e09f0 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.070+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f8e09f0 0x55e48fce4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.071+0000 7f1bb4ff9640 10 client.16170 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:14.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.071+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f8e09f0 0x55e48fce4ee0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c20634d742e1de0 server_cookie=555eeb683feab61 in_seq=0 out_seq=0 2024-08-31T04:29:14.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3577033174 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e48fc40580 con 0x55e48f8e09f0 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bb4ff9640 10 client.16170 handle_command_reply: tid=0 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 client.16170 shutdown 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 msgr2=0x55e48fcd2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009900 tx=0x7f1bbc032eb0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 shutdown_connections 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f8e09f0 0x55e48fce4ee0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bb4ff9640 0 client.16170 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcd2f70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f922070 0x55e48fcdede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3577033174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 >> 172.21.15.2:0/3577033174 conn(0x55e48f916460 msgr2=0x55e48fcc82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 shutdown_connections 2024-08-31T04:29:14.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.072+0000 7f1bd9950740 1 -- 172.21.15.2:0/3577033174 wait complete. 2024-08-31T04:29:14.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.073+0000 7f1bd9950740 20 client.16170 trim_cache size 0 max 16384 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.091+0000 7f1bd9950740 1 Processor -- start 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.091+0000 7f1bd9950740 1 -- start start 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcdece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1b3710 con 0x55e48f901390 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1b0fe0 con 0x55e48f8e09f0 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd9950740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1aee30 con 0x55e48f8f91b0 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43248/0 (socket says 172.21.15.2:43248) 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 -- 172.21.15.2:0/3598702394 learned_addr learned my addr 172.21.15.2:0/3598702394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcdece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 -- 172.21.15.2:0/3598702394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 msgr2=0x55e48fcdece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcdece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 -- 172.21.15.2:0/3598702394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 msgr2=0x55e48fcd2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 -- 172.21.15.2:0/3598702394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e48fcd0f30 con 0x55e48f901390 2024-08-31T04:29:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.092+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4010e00 tx=0x7f1bc4010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa10e56cee4ceb26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.093+0000 7f1bb6ffd640 1 -- 172.21.15.2:0/3598702394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4016040 con 0x55e48f901390 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.093+0000 7f1bb6ffd640 1 -- 172.21.15.2:0/3598702394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc4012450 con 0x55e48f901390 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.093+0000 7f1bb6ffd640 1 -- 172.21.15.2:0/3598702394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4023040 con 0x55e48f901390 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- 172.21.15.2:0/3598702394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 msgr2=0x55e48fcdf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4010e00 tx=0x7f1bc4010fd0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- 172.21.15.2:0/3598702394 shutdown_connections 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fcdf220 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcdece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3598702394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- 172.21.15.2:0/3598702394 >> 172.21.15.2:0/3598702394 conn(0x55e48f916460 msgr2=0x55e48fcd27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- 172.21.15.2:0/3598702394 shutdown_connections 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- 172.21.15.2:0/3598702394 wait complete. 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 -- start start 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.094+0000 7f1bd9950740 1 Processor -- start 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fd4e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1af4a0 con 0x55e48f901390 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1b0910 con 0x55e48f8e09f0 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1afb70 con 0x55e48f8f91b0 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd9950740 10 client.0 _ll_register_callbacks cb 0x7f1bbc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd1978640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:55794/0 (socket says 172.21.15.2:55794) 2024-08-31T04:29:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 -- 172.21.15.2:0/3416107182 learned_addr learned my addr 172.21.15.2:0/3416107182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fd4e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 -- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 msgr2=0x55e48fcd73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 -- 172.21.15.2:0/3416107182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 msgr2=0x55e48fd4e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fd4e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.095+0000 7f1bd0976640 1 -- 172.21.15.2:0/3416107182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e48fd4ede0 con 0x55e48f8f91b0 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bd0976640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc004b70 tx=0x7f1bbc0058c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfaa5af6b3cdd441 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc058060 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc4012450 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bbc004f70 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1bbc05f050 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bd9950740 10 client.25744 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e48fd4ffd0 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.096+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc4012450 con 0x55e48f8f91b0 2024-08-31T04:29:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1bbc003b70 con 0x55e48f8f91b0 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 10 client.25744 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 10 client.25744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 20 client.25744 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f922070 0x55e48fd52760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 4 client.25744 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e48fc3c020 con 0x55e48f922070 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f922070 0x55e48fd52760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.097+0000 7f1bb4ff9640 10 client.25744 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.098+0000 7f1bd1978640 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f922070 0x55e48fd52760 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791a0506d219cd7d server_cookie=f326c3439f23c78f in_seq=0 out_seq=0 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.098+0000 7f1bb4ff9640 1 -- 172.21.15.2:0/3416107182 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55e48fc3c020 con 0x55e48f922070 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.098+0000 7f1bb4ff9640 10 client.25744 handle_command_reply: tid=0 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.098+0000 7f1bd9950740 1 client.25744 shutdown 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.098+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 msgr2=0x55e48fcd7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc004b70 tx=0x7f1bbc0058c0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 shutdown_connections 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e48f922070 0x55e48fd52760 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e48f901390 0x55e48fd4e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bb4ff9640 0 client.25744 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e48f8f91b0 0x55e48fcd7900 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 --2- 172.21.15.2:0/3416107182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e48f8e09f0 0x55e48fcd73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 >> 172.21.15.2:0/3416107182 conn(0x55e48f916460 msgr2=0x55e48fcc4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 shutdown_connections 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 1 -- 172.21.15.2:0/3416107182 wait complete. 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd9950740 20 client.25744 trim_cache size 0 max 16384 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7be2b730-d0a5-4d56-bf6c-4616345a7b27", 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 msgr2=0x7f1bb80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 0x7f1bb80b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80e2ff0 tx=0x7f1bc80e9760 comp rx=0 tx=0).stop 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 msgr2=0x7f1bcc19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.099+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800ea60 tx=0x7f1bc800ef20 comp rx=0 tx=0).stop 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 shutdown_connections 2024-08-31T04:29:14.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bb80b4ca0 0x7f1bb80b71b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc105880 0x7f1bcc19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bcc104f30 0x7f1bcc19a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 --2- 172.21.15.2:0/1758894584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bcc102f60 0x7f1bcc19a2b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 >> 172.21.15.2:0/1758894584 conn(0x7f1bcc077a00 msgr2=0x7f1bcc100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 shutdown_connections 2024-08-31T04:29:14.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:14.100+0000 7f1bd33db640 1 -- 172.21.15.2:0/1758894584 wait complete. 2024-08-31T04:29:14.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 301999 12.93 MB/sec execute 34 sec latency 47.971 ms 2024-08-31T04:29:15.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:14 smithi002 ceph-mon[18656]: pgmap v453: 129 pgs: 129 active+clean; 175 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T04:29:15.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:14 smithi064 ceph-mon[22007]: pgmap v453: 129 pgs: 129 active+clean; 175 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T04:29:15.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:14 smithi132 ceph-mon[22335]: pgmap v453: 129 pgs: 129 active+clean; 175 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T04:29:15.443 INFO:tasks.cephfs.filesystem:scrub status for tag:7be2b730-d0a5-4d56-bf6c-4616345a7b27 - {'path': '/', 'tag': '7be2b730-d0a5-4d56-bf6c-4616345a7b27', 'options': 'recursive,force'} 2024-08-31T04:29:15.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 304871 12.98 MB/sec execute 35 sec latency 55.880 ms 2024-08-31T04:29:16.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 306674 12.89 MB/sec execute 36 sec latency 27.913 ms 2024-08-31T04:29:17.119 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:16 smithi132 ceph-mon[22335]: pgmap v454: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 307 op/s 2024-08-31T04:29:17.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:16 smithi002 ceph-mon[18656]: pgmap v454: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 307 op/s 2024-08-31T04:29:17.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:16 smithi064 ceph-mon[22007]: pgmap v454: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 307 op/s 2024-08-31T04:29:17.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 309298 12.93 MB/sec execute 37 sec latency 26.124 ms 2024-08-31T04:29:18.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:17 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:29:18.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:17 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:29:18.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:17 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:29:18.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:17 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:29:18.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:17 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:29:18.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:17 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:29:18.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 312366 13.07 MB/sec execute 38 sec latency 14.187 ms 2024-08-31T04:29:19.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:18 smithi002 ceph-mon[18656]: pgmap v455: 129 pgs: 129 active+clean; 180 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T04:29:19.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:18 smithi064 ceph-mon[22007]: pgmap v455: 129 pgs: 129 active+clean; 180 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T04:29:19.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:18 smithi132 ceph-mon[22335]: pgmap v455: 129 pgs: 129 active+clean; 180 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T04:29:19.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 314933 13.03 MB/sec execute 39 sec latency 23.997 ms 2024-08-31T04:29:20.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 316628 12.93 MB/sec execute 40 sec latency 53.391 ms 2024-08-31T04:29:21.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:20 smithi002 ceph-mon[18656]: pgmap v456: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T04:29:21.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:20 smithi064 ceph-mon[22007]: pgmap v456: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T04:29:21.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:20 smithi132 ceph-mon[22335]: pgmap v456: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T04:29:21.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 319466 13.05 MB/sec execute 41 sec latency 67.327 ms 2024-08-31T04:29:22.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 322009 13.01 MB/sec execute 42 sec latency 25.404 ms 2024-08-31T04:29:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:22 smithi002 ceph-mon[18656]: pgmap v457: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 262 op/s 2024-08-31T04:29:23.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:22 smithi064 ceph-mon[22007]: pgmap v457: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 262 op/s 2024-08-31T04:29:23.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:22 smithi132 ceph-mon[22335]: pgmap v457: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 262 op/s 2024-08-31T04:29:23.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 323983 12.94 MB/sec execute 43 sec latency 41.056 ms 2024-08-31T04:29:24.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 326868 13.04 MB/sec execute 44 sec latency 12.950 ms 2024-08-31T04:29:25.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:24 smithi002 ceph-mon[18656]: pgmap v458: 129 pgs: 129 active+clean; 192 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 297 op/s 2024-08-31T04:29:25.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:24 smithi064 ceph-mon[22007]: pgmap v458: 129 pgs: 129 active+clean; 192 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 297 op/s 2024-08-31T04:29:25.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:24 smithi132 ceph-mon[22335]: pgmap v458: 129 pgs: 129 active+clean; 192 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 297 op/s 2024-08-31T04:29:25.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 329269 13.03 MB/sec execute 45 sec latency 100.413 ms 2024-08-31T04:29:26.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 331049 12.93 MB/sec execute 46 sec latency 58.658 ms 2024-08-31T04:29:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:26 smithi002 ceph-mon[18656]: pgmap v459: 129 pgs: 129 active+clean; 194 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-08-31T04:29:27.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:26 smithi064 ceph-mon[22007]: pgmap v459: 129 pgs: 129 active+clean; 194 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-08-31T04:29:27.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:26 smithi132 ceph-mon[22335]: pgmap v459: 129 pgs: 129 active+clean; 194 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-08-31T04:29:27.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 333887 13.02 MB/sec execute 47 sec latency 17.016 ms 2024-08-31T04:29:28.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 336948 13.11 MB/sec execute 48 sec latency 55.400 ms 2024-08-31T04:29:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:28 smithi002 ceph-mon[18656]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 294 op/s 2024-08-31T04:29:29.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:28 smithi064 ceph-mon[22007]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 294 op/s 2024-08-31T04:29:29.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:28 smithi132 ceph-mon[22335]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 294 op/s 2024-08-31T04:29:29.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 339316 13.02 MB/sec execute 49 sec latency 22.765 ms 2024-08-31T04:29:30.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 341202 13.01 MB/sec execute 50 sec latency 64.441 ms 2024-08-31T04:29:31.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:30 smithi002 ceph-mon[18656]: pgmap v461: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-08-31T04:29:31.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:30 smithi064 ceph-mon[22007]: pgmap v461: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-08-31T04:29:31.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:30 smithi132 ceph-mon[22335]: pgmap v461: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-08-31T04:29:31.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 344073 13.09 MB/sec execute 51 sec latency 20.798 ms 2024-08-31T04:29:32.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 346625 13.02 MB/sec execute 52 sec latency 25.678 ms 2024-08-31T04:29:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:32 smithi002 ceph-mon[18656]: pgmap v462: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-08-31T04:29:33.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:32 smithi064 ceph-mon[22007]: pgmap v462: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-08-31T04:29:33.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:32 smithi132 ceph-mon[22335]: pgmap v462: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-08-31T04:29:33.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 348610 13.01 MB/sec execute 53 sec latency 40.654 ms 2024-08-31T04:29:34.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 351525 13.10 MB/sec execute 54 sec latency 22.319 ms 2024-08-31T04:29:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:34 smithi002 ceph-mon[18656]: pgmap v463: 129 pgs: 129 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.2 MiB/s wr, 291 op/s 2024-08-31T04:29:35.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:34 smithi064 ceph-mon[22007]: pgmap v463: 129 pgs: 129 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.2 MiB/s wr, 291 op/s 2024-08-31T04:29:35.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:34 smithi132 ceph-mon[22335]: pgmap v463: 129 pgs: 129 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.2 MiB/s wr, 291 op/s 2024-08-31T04:29:35.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 354058 13.08 MB/sec execute 55 sec latency 66.158 ms 2024-08-31T04:29:36.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 355842 13.01 MB/sec execute 56 sec latency 26.763 ms 2024-08-31T04:29:37.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:36 smithi064 ceph-mon[22007]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 294 op/s 2024-08-31T04:29:37.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:36 smithi132 ceph-mon[22335]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 294 op/s 2024-08-31T04:29:37.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:36 smithi002 ceph-mon[18656]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 294 op/s 2024-08-31T04:29:37.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 358648 13.08 MB/sec execute 57 sec latency 13.138 ms 2024-08-31T04:29:38.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 361450 13.09 MB/sec execute 58 sec latency 43.083 ms 2024-08-31T04:29:39.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:38 smithi064 ceph-mon[22007]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:29:39.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:38 smithi132 ceph-mon[22335]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:29:39.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:38 smithi002 ceph-mon[18656]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:29:39.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 363555 13.05 MB/sec execute 59 sec latency 25.265 ms 2024-08-31T04:29:40.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 365910 13.07 MB/sec execute 60 sec latency 90.039 ms 2024-08-31T04:29:41.199 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:40 smithi002 ceph-mon[18656]: pgmap v466: 129 pgs: 129 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-08-31T04:29:41.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:40 smithi064 ceph-mon[22007]: pgmap v466: 129 pgs: 129 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-08-31T04:29:41.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:40 smithi132 ceph-mon[22335]: pgmap v466: 129 pgs: 129 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-08-31T04:29:41.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 368542 13.07 MB/sec execute 61 sec latency 44.643 ms 2024-08-31T04:29:42.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 370659 13.04 MB/sec execute 62 sec latency 32.959 ms 2024-08-31T04:29:43.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:42 smithi064 ceph-mon[22007]: pgmap v467: 129 pgs: 129 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-08-31T04:29:43.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:42 smithi132 ceph-mon[22335]: pgmap v467: 129 pgs: 129 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-08-31T04:29:43.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:42 smithi002 ceph-mon[18656]: pgmap v467: 129 pgs: 129 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-08-31T04:29:43.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 373164 13.06 MB/sec execute 63 sec latency 33.332 ms 2024-08-31T04:29:44.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 376198 13.14 MB/sec execute 64 sec latency 18.051 ms 2024-08-31T04:29:45.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:44 smithi064 ceph-mon[22007]: pgmap v468: 129 pgs: 129 active+clean; 220 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2024-08-31T04:29:45.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:44 smithi132 ceph-mon[22335]: pgmap v468: 129 pgs: 129 active+clean; 220 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2024-08-31T04:29:45.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:44 smithi002 ceph-mon[18656]: pgmap v468: 129 pgs: 129 active+clean; 220 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2024-08-31T04:29:45.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:29:45.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 378360 13.05 MB/sec execute 65 sec latency 43.119 ms 2024-08-31T04:29:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 -- 172.21.15.2:0/693715499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109c60 msgr2=0x7f4c3c110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 --2- 172.21.15.2:0/693715499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109c60 0x7f4c3c110490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009ca0 tx=0x7f4c3402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 -- 172.21.15.2:0/693715499 shutdown_connections 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 --2- 172.21.15.2:0/693715499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109c60 0x7f4c3c110490 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 --2- 172.21.15.2:0/693715499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c109310 0x7f4c3c109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 --2- 172.21.15.2:0/693715499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c1039d0 0x7f4c3c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 -- 172.21.15.2:0/693715499 >> 172.21.15.2:0/693715499 conn(0x7f4c3c07b670 msgr2=0x7f4c3c07ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 -- 172.21.15.2:0/693715499 shutdown_connections 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.204+0000 7f4c40d56640 1 -- 172.21.15.2:0/693715499 wait complete. 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.205+0000 7f4c40d56640 1 Processor -- start 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.205+0000 7f4c40d56640 1 -- start start 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c1039d0 0x7f4c3c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c109c60 0x7f4c3c19fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c113880 con 0x7f4c3c109310 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c113700 con 0x7f4c3c109c60 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c40d56640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c113a00 con 0x7f4c3c1039d0 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43832/0 (socket says 172.21.15.2:43832) 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 -- 172.21.15.2:0/1341236827 learned_addr learned my addr 172.21.15.2:0/1341236827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c109c60 0x7f4c3c19fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c1039d0 0x7f4c3c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 -- 172.21.15.2:0/1341236827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c1039d0 msgr2=0x7f4c3c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c1039d0 0x7f4c3c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 -- 172.21.15.2:0/1341236827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c109c60 msgr2=0x7f4c3c19fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c109c60 0x7f4c3c19fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 -- 172.21.15.2:0/1341236827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c1a0200 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9c0 tx=0x7f4c3000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.206+0000 7f4c2b7fe640 1 -- 172.21.15.2:0/1341236827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000ccc0 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.207+0000 7f4c2b7fe640 1 -- 172.21.15.2:0/1341236827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c300054d0 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.207+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3c1a04f0 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.207+0000 7f4c2b7fe640 1 -- 172.21.15.2:0/1341236827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30010430 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.207+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3c1a6c50 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.209+0000 7f4c472cb740 1 Processor -- start 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.209+0000 7f4c472cb740 1 -- start start 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.209+0000 7f4c2b7fe640 1 -- 172.21.15.2:0/1341236827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4c300105d0 con 0x7f4c3c109310 2024-08-31T04:29:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56059d844630 con 0x56059d528070 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56059d833bc0 con 0x56059d507390 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c472cb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56059d837b70 con 0x56059d4ff1b0 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43840/0 (socket says 172.21.15.2:43840) 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 -- 172.21.15.2:0/2382849970 learned_addr learned my addr 172.21.15.2:0/2382849970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 -- 172.21.15.2:0/2382849970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 msgr2=0x56059d8cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 -- 172.21.15.2:0/2382849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 msgr2=0x56059d8cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 -- 172.21.15.2:0/2382849970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059d593650 con 0x56059d528070 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c3402f410 tx=0x7f4c3402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53c0613ba7916f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.210+0000 7f4c2b7fe640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 0x7f4c240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.211+0000 7f4c28ff9640 1 -- 172.21.15.2:0/2382849970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34031cf0 con 0x56059d528070 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.211+0000 7f4c28ff9640 1 -- 172.21.15.2:0/2382849970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c34036030 con 0x56059d528070 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.211+0000 7f4c28ff9640 1 -- 172.21.15.2:0/2382849970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34004240 con 0x56059d528070 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.211+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 0x7f4c240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.211+0000 7f4c2b7fe640 1 -- 172.21.15.2:0/1341236827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4c300e5c70 con 0x7f4c3c109310 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- 172.21.15.2:0/2382849970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 msgr2=0x56059d8cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 0x7f4c240b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56059d8cbf80 tx=0x7f4c2c015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c3402f410 tx=0x7f4c3402f440 comp rx=0 tx=0).stop 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- 172.21.15.2:0/2382849970 shutdown_connections 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2382849970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8cd300 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- 172.21.15.2:0/2382849970 >> 172.21.15.2:0/2382849970 conn(0x56059d51c460 msgr2=0x56059d8cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- 172.21.15.2:0/2382849970 shutdown_connections 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- 172.21.15.2:0/2382849970 wait complete. 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 -- start start 2024-08-31T04:29:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.212+0000 7f4c472cb740 1 Processor -- start 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 0x56059d8d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d528070 0x56059d8e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56059d696700 con 0x56059d507390 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56059d7ba700 con 0x56059d4ff1b0 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56059d8db900 con 0x56059d528070 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c472cb740 10 client.0 _ll_register_callbacks cb 0x56059d7e9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c3a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 0x56059d8d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43854/0 (socket says 172.21.15.2:43854) 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 -- 172.21.15.2:0/3845377276 learned_addr learned my addr 172.21.15.2:0/3845377276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d528070 0x56059d8e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 -- 172.21.15.2:0/3845377276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d528070 msgr2=0x56059d8e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d528070 0x56059d8e4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 -- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 msgr2=0x56059d8d8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 0x56059d8d8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 -- 172.21.15.2:0/3845377276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059d7f38b0 con 0x56059d507390 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 0x56059d8d8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c6a0 tx=0x7f4c300ab950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e4d9c43d9f28e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.213+0000 7f4c21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30005680 con 0x56059d507390 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c34036030 con 0x56059d507390 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4c300b03c0 con 0x56059d507390 2024-08-31T04:29:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c300ac640 con 0x56059d507390 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56059d8e77b0 con 0x56059d507390 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c34036030 con 0x56059d507390 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4c300970d0 con 0x56059d507390 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 20 client.16188 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4e69f0 0x56059d8eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 4 client.16188 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.214+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059d846580 con 0x56059d4e69f0 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.215+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4e69f0 0x56059d8eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.215+0000 7f4c21ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.215+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4e69f0 0x56059d8eab10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeccc42dcf980662 server_cookie=97f99117a365a05f in_seq=0 out_seq=0 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c21ffb640 1 -- 172.21.15.2:0/3845377276 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56059d846580 con 0x56059d4e69f0 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c21ffb640 10 client.16188 handle_command_reply: tid=0 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 client.16188 shutdown 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 msgr2=0x56059d8d9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c6a0 tx=0x7f4c300ab950 comp rx=0 tx=0).stop 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 shutdown_connections 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4e69f0 0x56059d8eab10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8d9010 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d528070 0x56059d8e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 --2- 172.21.15.2:0/3845377276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d4ff1b0 0x56059d8d8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 >> 172.21.15.2:0/3845377276 conn(0x56059d51c460 msgr2=0x56059d8d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c21ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 shutdown_connections 2024-08-31T04:29:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.216+0000 7f4c472cb740 1 -- 172.21.15.2:0/3845377276 wait complete. 2024-08-31T04:29:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.217+0000 7f4c472cb740 20 client.16188 trim_cache size 0 max 16384 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 Processor -- start 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 -- start start 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1b1520 con 0x56059d528070 2024-08-31T04:29:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1aedf0 con 0x56059d507390 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.236+0000 7f4c472cb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1acc40 con 0x56059d4ff1b0 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57492/0 (socket says 172.21.15.2:57492) 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46500/0 (socket says 172.21.15.2:46500) 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c39d9b640 1 -- 172.21.15.2:0/2470774439 learned_addr learned my addr 172.21.15.2:0/2470774439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 -- 172.21.15.2:0/2470774439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 msgr2=0x56059d8d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 -- 172.21.15.2:0/2470774439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 msgr2=0x56059d8d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 -- 172.21.15.2:0/2470774439 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059d8d9900 con 0x56059d4ff1b0 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56059d8eb180 tx=0x7f4c2c01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8bb7e5d38048a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.237+0000 7f4c23fff640 1 -- 172.21.15.2:0/2470774439 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c025040 con 0x56059d4ff1b0 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c23fff640 1 -- 172.21.15.2:0/2470774439 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c2c038070 con 0x56059d4ff1b0 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c23fff640 1 -- 172.21.15.2:0/2470774439 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01f650 con 0x56059d4ff1b0 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 -- 172.21.15.2:0/2470774439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 msgr2=0x56059d8d79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56059d8eb180 tx=0x7f4c2c01b000 comp rx=0 tx=0).stop 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 -- 172.21.15.2:0/2470774439 shutdown_connections 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d528070 0x56059d8d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d507390 0x56059d8d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.238+0000 7f4c472cb740 1 --2- 172.21.15.2:0/2470774439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8d79c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- 172.21.15.2:0/2470774439 >> 172.21.15.2:0/2470774439 conn(0x56059d51c460 msgr2=0x56059d8d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- 172.21.15.2:0/2470774439 shutdown_connections 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- 172.21.15.2:0/2470774439 wait complete. 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- start start 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 Processor -- start 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 0x56059d8dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ad2b0 con 0x56059d507390 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ae720 con 0x56059d528070 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ad980 con 0x56059d4ff1b0 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.239+0000 7f4c472cb740 10 client.0 _ll_register_callbacks cb 0x7f4c300096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c3a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43866/0 (socket says 172.21.15.2:43866) 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 -- 172.21.15.2:0/148386286 learned_addr learned my addr 172.21.15.2:0/148386286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 0x56059d8dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 -- 172.21.15.2:0/148386286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 msgr2=0x56059d8dcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8dcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 -- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 msgr2=0x56059d8dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 0x56059d8dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 -- 172.21.15.2:0/148386286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059d954640 con 0x56059d507390 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c3ad9d640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 0x56059d8dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c39d9b640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c300e3050 tx=0x7f4c30005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6517a2c0d11f3d15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300c5070 con 0x56059d507390 2024-08-31T04:29:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4c300932c0 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c2c038070 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c300b5260 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c472cb740 10 client.16194 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.240+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56059d9558b0 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c2c038070 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4c300ab1a0 con 0x56059d507390 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 10 client.16194 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 20 client.16194 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4bbda0 0x56059d958040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 4 client.16194 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56059d842020 con 0x56059d4bbda0 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.241+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4bbda0 0x56059d958040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.242+0000 7f4c3a59c640 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4bbda0 0x56059d958040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f4932aec04f555 server_cookie=2abf7c58d7fc2be0 in_seq=0 out_seq=0 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.242+0000 7f4c21ffb640 10 client.16194 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.242+0000 7f4c21ffb640 1 -- 172.21.15.2:0/148386286 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x56059d842020 con 0x56059d4bbda0 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.242+0000 7f4c21ffb640 10 client.16194 handle_command_reply: tid=0 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.242+0000 7f4c472cb740 1 client.16194 shutdown 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 msgr2=0x56059d8dd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c300e3050 tx=0x7f4c30005230 comp rx=0 tx=0).stop 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 shutdown_connections 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56059d4bbda0 0x56059d958040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56059d507390 0x56059d8dd270 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56059d528070 0x56059d8dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c21ffb640 0 client.16194 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 --2- 172.21.15.2:0/148386286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56059d4ff1b0 0x56059d8dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 >> 172.21.15.2:0/148386286 conn(0x56059d51c460 msgr2=0x56059d8ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 shutdown_connections 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 1 -- 172.21.15.2:0/148386286 wait complete. 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c472cb740 20 client.16194 trim_cache size 0 max 16384 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:29:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:46.261 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 msgr2=0x7f4c240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 0x7f4c240b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56059d8cbf80 tx=0x7f4c2c015040 comp rx=0 tx=0).stop 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 msgr2=0x7f4c3c19a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.243+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9c0 tx=0x7f4c3000ee80 comp rx=0 tx=0).stop 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 shutdown_connections 2024-08-31T04:29:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c240b4ca0 0x7f4c240b71b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3c109310 0x7f4c3c19a830 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c3c109c60 0x7f4c3c19fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 --2- 172.21.15.2:0/1341236827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c1039d0 0x7f4c3c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 >> 172.21.15.2:0/1341236827 conn(0x7f4c3c07b670 msgr2=0x7f4c3c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 shutdown_connections 2024-08-31T04:29:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:46.244+0000 7f4c40d56640 1 -- 172.21.15.2:0/1341236827 wait complete. 2024-08-31T04:29:46.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 380171 13.04 MB/sec execute 66 sec latency 46.617 ms 2024-08-31T04:29:47.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:46 smithi064 ceph-mon[22007]: pgmap v469: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 293 op/s 2024-08-31T04:29:47.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:46 smithi132 ceph-mon[22335]: pgmap v469: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 293 op/s 2024-08-31T04:29:47.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:46 smithi002 ceph-mon[18656]: pgmap v469: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 293 op/s 2024-08-31T04:29:47.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 383087 13.10 MB/sec execute 67 sec latency 58.359 ms 2024-08-31T04:29:47.888 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:29:47.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:29:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:48.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 385463 13.04 MB/sec execute 68 sec latency 39.666 ms 2024-08-31T04:29:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 -- 172.21.15.2:0/1960269532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108140 msgr2=0x7fcef8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 --2- 172.21.15.2:0/1960269532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108140 0x7fcef8108550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009900 tx=0x7fcee802a410 comp rx=0 tx=0).stop 2024-08-31T04:29:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 -- 172.21.15.2:0/1960269532 shutdown_connections 2024-08-31T04:29:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 --2- 172.21.15.2:0/1960269532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108140 0x7fcef8108550 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 --2- 172.21.15.2:0/1960269532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8108a90 0x7fcef810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 --2- 172.21.15.2:0/1960269532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8102800 0x7fcef8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 -- 172.21.15.2:0/1960269532 >> 172.21.15.2:0/1960269532 conn(0x7fcef80794d0 msgr2=0x7fcef80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 -- 172.21.15.2:0/1960269532 shutdown_connections 2024-08-31T04:29:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.681+0000 7fcf00486640 1 -- 172.21.15.2:0/1960269532 wait complete. 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.682+0000 7fcf00486640 1 Processor -- start 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 -- start start 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 0x7fcef819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 0x7fcef819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcef81126c0 con 0x7fcef8108a90 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcef8112540 con 0x7fcef8108140 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcf00486640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcef8112840 con 0x7fcef8102800 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefea23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 0x7fcef819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57536/0 (socket says 172.21.15.2:57536) 2024-08-31T04:29:48.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefe222640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 0x7fcef819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 -- 172.21.15.2:0/4188199621 learned_addr learned my addr 172.21.15.2:0/4188199621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefea23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 0x7fcef819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43890/0 (socket says 172.21.15.2:43890) 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 -- 172.21.15.2:0/4188199621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 msgr2=0x7fcef819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 0x7fcef819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.683+0000 7fcefda21640 1 -- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 msgr2=0x7fcef819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcefda21640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 0x7fcef819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcefda21640 1 -- 172.21.15.2:0/4188199621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef81a0180 con 0x7fcef8108140 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcefe222640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 0x7fcef819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcefda21640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcee8032fd0 tx=0x7fcee8031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee803f030 con 0x7fcef8108140 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef81a0410 con 0x7fcef8108140 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee8004490 con 0x7fcef8108140 2024-08-31T04:29:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8035070 con 0x7fcef8108140 2024-08-31T04:29:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.684+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef81a6bd0 con 0x7fcef8108140 2024-08-31T04:29:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.685+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef8102c10 con 0x7fcef8108140 2024-08-31T04:29:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.687+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcee8042030 con 0x7fcef8108140 2024-08-31T04:29:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.688+0000 7fceef7fe640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 0x7fcee40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.688+0000 7fcefe222640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 0x7fcee40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.688+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fcee8106090 con 0x7fcef8108140 2024-08-31T04:29:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.688+0000 7fcefe222640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 0x7fcee40b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcef40095f0 tx=0x7fcef4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:48.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.691+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcee80cc3b0 con 0x7fcef8108140 2024-08-31T04:29:48.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.955+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcef81a6da0 con 0x7fcef8108140 2024-08-31T04:29:48.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.956+0000 7fceef7fe640 1 -- 172.21.15.2:0/4188199621 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11897 (secure 0 0 0) 0x7fcee80d0b70 con 0x7fcef8108140 2024-08-31T04:29:48.958 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:29:48.958 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-08-31T04:28:47:821768+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:28:47.525009+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:29:48.958 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-08-31T04:29:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.958+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 msgr2=0x7fcee40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.958+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 0x7fcee40b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcef40095f0 tx=0x7fcef4005f90 comp rx=0 tx=0).stop 2024-08-31T04:29:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.958+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 msgr2=0x7fcef819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.958+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcee8032fd0 tx=0x7fcee8031a20 comp rx=0 tx=0).stop 2024-08-31T04:29:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 shutdown_connections 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fcee40b4ca0 0x7fcee40b71b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8108a90 0x7fcef819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcef8108140 0x7fcef819a7b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 --2- 172.21.15.2:0/4188199621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcef8102800 0x7fcef819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 >> 172.21.15.2:0/4188199621 conn(0x7fcef80794d0 msgr2=0x7fcef8101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 shutdown_connections 2024-08-31T04:29:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:48.959+0000 7fcf00486640 1 -- 172.21.15.2:0/4188199621 wait complete. 2024-08-31T04:29:49.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:48 smithi064 ceph-mon[22007]: pgmap v470: 129 pgs: 129 active+clean; 227 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 287 op/s 2024-08-31T04:29:49.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:48 smithi132 ceph-mon[22335]: pgmap v470: 129 pgs: 129 active+clean; 227 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 287 op/s 2024-08-31T04:29:49.329 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:48 smithi002 ceph-mon[18656]: pgmap v470: 129 pgs: 129 active+clean; 227 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 287 op/s 2024-08-31T04:29:49.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 387503 13.03 MB/sec execute 69 sec latency 27.324 ms 2024-08-31T04:29:49.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:29:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:50.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:49 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/4188199621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:50.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:49 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/4188199621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:50.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:49 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/4188199621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 -- 172.21.15.2:0/2543496307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0109270 msgr2=0x7f95f0109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 --2- 172.21.15.2:0/2543496307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0109270 0x7f95f0109680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009900 tx=0x7f95dc02a410 comp rx=0 tx=0).stop 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 -- 172.21.15.2:0/2543496307 shutdown_connections 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 --2- 172.21.15.2:0/2543496307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0109270 0x7f95f0109680 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 --2- 172.21.15.2:0/2543496307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f01103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 --2- 172.21.15.2:0/2543496307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0103930 0x7f95f0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 -- 172.21.15.2:0/2543496307 >> 172.21.15.2:0/2543496307 conn(0x7f95f00ff3a0 msgr2=0x7f95f01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 -- 172.21.15.2:0/2543496307 shutdown_connections 2024-08-31T04:29:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.556+0000 7f95f725b640 1 -- 172.21.15.2:0/2543496307 wait complete. 2024-08-31T04:29:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 Processor -- start 2024-08-31T04:29:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 -- start start 2024-08-31T04:29:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 0x7f95f019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f0113880 con 0x7f95f0103930 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95f0113700 con 0x7f95f0109270 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f725b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95f0113a00 con 0x7f95f0109bc0 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f4ff7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f4ff7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43910/0 (socket says 172.21.15.2:43910) 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 0x7f95f019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f4ff7640 1 -- 172.21.15.2:0/613742630 learned_addr learned my addr 172.21.15.2:0/613742630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.557+0000 7f95f57f8640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 -- 172.21.15.2:0/613742630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 msgr2=0x7f95f019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 -- 172.21.15.2:0/613742630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 msgr2=0x7f95f019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 0x7f95f019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 -- 172.21.15.2:0/613742630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f01a01c0 con 0x7f95f0103930 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f57f8640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95effff640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 0x7f95f019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95e400e9f0 tx=0x7f95e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95edffb640 1 -- 172.21.15.2:0/613742630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e400cd80 con 0x7f95f0103930 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f01a04b0 con 0x7f95f0103930 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95edffb640 1 -- 172.21.15.2:0/613742630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e40108e0 con 0x7f95f0103930 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.558+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f01a6c10 con 0x7f95f0103930 2024-08-31T04:29:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.559+0000 7f95edffb640 1 -- 172.21.15.2:0/613742630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4018980 con 0x7f95f0103930 2024-08-31T04:29:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 Processor -- start 2024-08-31T04:29:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 -- start start 2024-08-31T04:29:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95edffb640 1 -- 172.21.15.2:0/613742630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f95e4010430 con 0x7f95f0103930 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd021b0 0x55b17d0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b17d047680 con 0x55b17cd0a390 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b17d036c10 con 0x55b17cd2b070 2024-08-31T04:29:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17d03abc0 con 0x55b17cd021b0 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43924/0 (socket says 172.21.15.2:43924) 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95effff640 1 -- 172.21.15.2:0/3465817008 learned_addr learned my addr 172.21.15.2:0/3465817008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95f57f8640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.561+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd021b0 0x55b17d0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 -- 172.21.15.2:0/3465817008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd021b0 msgr2=0x55b17d0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd021b0 0x55b17d0d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 -- 172.21.15.2:0/3465817008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 msgr2=0x55b17d0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 -- 172.21.15.2:0/3465817008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cd96650 con 0x55b17cd2b070 2024-08-31T04:29:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95effff640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f57f8640 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0d0310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ee0 tx=0x7f95e8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2bbeb8e33df7bc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95daffd640 1 -- 172.21.15.2:0/3465817008 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8016070 con 0x55b17cd2b070 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95daffd640 1 -- 172.21.15.2:0/3465817008 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e8012900 con 0x55b17cd2b070 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95daffd640 1 -- 172.21.15.2:0/3465817008 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011920 con 0x55b17cd2b070 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95edffb640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 0x7f95e00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 0x7f95e00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.562+0000 7f95edffb640 1 -- 172.21.15.2:0/613742630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f95e40e5d20 con 0x7f95f0103930 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- 172.21.15.2:0/3465817008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 msgr2=0x55b17d0d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95f4ff7640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 0x7f95e00b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95e40e3100 tx=0x7f95e4000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0d0310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ee0 tx=0x7f95e8010740 comp rx=0 tx=0).stop 2024-08-31T04:29:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- 172.21.15.2:0/3465817008 shutdown_connections 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd0a390 0x55b17d0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd021b0 0x55b17d0d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/3465817008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0d0310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- 172.21.15.2:0/3465817008 >> 172.21.15.2:0/3465817008 conn(0x55b17cd1f460 msgr2=0x55b17d0ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- 172.21.15.2:0/3465817008 shutdown_connections 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- 172.21.15.2:0/3465817008 wait complete. 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.563+0000 7f95fd7d0740 1 -- start start 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 Processor -- start 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b17ce99700 con 0x55b17cd021b0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b17cfbd750 con 0x55b17cd2b070 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17d0e2e20 con 0x55b17cd0a390 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95fd7d0740 10 client.0 _ll_register_callbacks cb 0x55b17cfece10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43926/0 (socket says 172.21.15.2:43926) 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95f57f8640 1 -- 172.21.15.2:0/554662243 learned_addr learned my addr 172.21.15.2:0/554662243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95f57f8640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.564+0000 7f95effff640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 -- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 msgr2=0x55b17d0e0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 -- 172.21.15.2:0/554662243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 msgr2=0x55b17d0e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 -- 172.21.15.2:0/554662243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17cff6900 con 0x55b17cd021b0 2024-08-31T04:29:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95effff640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:50.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95f57f8640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ca0 tx=0x7f95e80115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4946a55c553d758 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.565+0000 7f95cffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:50.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e801f020 con 0x55b17cd021b0 2024-08-31T04:29:50.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f95e80116a0 con 0x55b17cd021b0 2024-08-31T04:29:50.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e8012900 con 0x55b17cd021b0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95e8032050 con 0x55b17cd021b0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 10 client.16212 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b17d0e47d0 con 0x55b17cd021b0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e8012900 con 0x55b17cd021b0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f95e800f040 con 0x55b17cd021b0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 10 client.16212 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 10 client.16212 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 20 client.16212 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.566+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cce99f0 0x55b17d0e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.567+0000 7f95fd7d0740 4 client.16212 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.567+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b17d0495d0 con 0x55b17cce99f0 2024-08-31T04:29:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.567+0000 7f95effff640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cce99f0 0x55b17d0e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.567+0000 7f95effff640 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cce99f0 0x55b17d0e7bf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed9764f82671dd88 server_cookie=ff040461c56b420c in_seq=0 out_seq=0 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.567+0000 7f95cffff640 10 client.16212 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95cffff640 1 -- 172.21.15.2:0/554662243 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b17d0495d0 con 0x55b17cce99f0 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95cffff640 10 client.16212 handle_command_reply: tid=0 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 client.16212 shutdown 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 msgr2=0x55b17d0dfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ca0 tx=0x7f95e80115c0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 shutdown_connections 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cce99f0 0x55b17d0e7bf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd2b070 0x55b17d0e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95cffff640 0 client.16212 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/554662243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cd021b0 0x55b17d0dfe30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 >> 172.21.15.2:0/554662243 conn(0x55b17cd1f460 msgr2=0x55b17d0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 shutdown_connections 2024-08-31T04:29:50.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.568+0000 7f95fd7d0740 1 -- 172.21.15.2:0/554662243 wait complete. 2024-08-31T04:29:50.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.569+0000 7f95fd7d0740 20 client.16212 trim_cache size 0 max 16384 2024-08-31T04:29:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 Processor -- start 2024-08-31T04:29:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 -- start start 2024-08-31T04:29:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01b1630 con 0x55b17cce99f0 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01aef00 con 0x55b17cd021b0 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01acd50 con 0x55b17cd0a390 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43942/0 (socket says 172.21.15.2:43942) 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 -- 172.21.15.2:0/114693250 learned_addr learned my addr 172.21.15.2:0/114693250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 -- 172.21.15.2:0/114693250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 msgr2=0x55b17d0e1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 -- 172.21.15.2:0/114693250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 msgr2=0x55b17d0e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95f57f8640 1 -- 172.21.15.2:0/114693250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17d0d3110 con 0x55b17cce99f0 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.583+0000 7f95effff640 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.584+0000 7f95f57f8640 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009e30 tx=0x7f95e80097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d266ac98dc039789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.584+0000 7f95da7fc640 1 -- 172.21.15.2:0/114693250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e802f070 con 0x55b17cce99f0 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.584+0000 7f95da7fc640 1 -- 172.21.15.2:0/114693250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e8022070 con 0x55b17cce99f0 2024-08-31T04:29:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.584+0000 7f95da7fc640 1 -- 172.21.15.2:0/114693250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e801f040 con 0x55b17cce99f0 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- 172.21.15.2:0/114693250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 msgr2=0x55b17d0d9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009e30 tx=0x7f95e80097e0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- 172.21.15.2:0/114693250 shutdown_connections 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/114693250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0d9620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- 172.21.15.2:0/114693250 >> 172.21.15.2:0/114693250 conn(0x55b17cd1f460 msgr2=0x55b17d0e1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- 172.21.15.2:0/114693250 shutdown_connections 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- 172.21.15.2:0/114693250 wait complete. 2024-08-31T04:29:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 -- start start 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.585+0000 7f95fd7d0740 1 Processor -- start 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01ad3c0 con 0x55b17cce99f0 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01ae830 con 0x55b17cd021b0 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95f01ada90 con 0x55b17cd0a390 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95fd7d0740 10 client.0 _ll_register_callbacks cb 0x7f95e8009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43956/0 (socket says 172.21.15.2:43956) 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 -- 172.21.15.2:0/685901114 learned_addr learned my addr 172.21.15.2:0/685901114 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95effff640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 -- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 msgr2=0x55b17d0e72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 -- 172.21.15.2:0/685901114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 msgr2=0x55b17d0e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.586+0000 7f95f57f8640 1 -- 172.21.15.2:0/685901114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17d0e7a30 con 0x55b17cce99f0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95f57f8640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ca0 tx=0x7f95e801b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb219beacdf1f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8048060 con 0x55b17cce99f0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e8022070 con 0x55b17cce99f0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f95e80126d0 con 0x55b17cce99f0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95e801f070 con 0x55b17cce99f0 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95fd7d0740 10 client.16218 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b17d169a30 con 0x55b17cce99f0 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e8022070 con 0x55b17cce99f0 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.587+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f95e802b450 con 0x55b17cce99f0 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 10 client.16218 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 10 client.16218 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 20 client.16218 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cd2b070 0x55b17d16c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 4 client.16218 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b17d045070 con 0x55b17cd2b070 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95effff640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cd2b070 0x55b17d16c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95cffff640 10 client.16218 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95effff640 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cd2b070 0x55b17d16c0f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e12f95d0f16eb8e3 server_cookie=140ab925c7d84d32 in_seq=0 out_seq=0 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.588+0000 7f95cffff640 1 -- 172.21.15.2:0/685901114 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b17d045070 con 0x55b17cd2b070 2024-08-31T04:29:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95cffff640 10 client.16218 handle_command_reply: tid=0 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 client.16218 shutdown 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 msgr2=0x55b17d0eb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ca0 tx=0x7f95e801b500 comp rx=0 tx=0).stop 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 shutdown_connections 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55b17cd2b070 0x55b17d16c0f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd0a390 0x55b17d0e72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b17cd021b0 0x55b17d0e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 --2- 172.21.15.2:0/685901114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b17cce99f0 0x55b17d0eb380 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95cffff640 0 client.16218 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 >> 172.21.15.2:0/685901114 conn(0x55b17cd1f460 msgr2=0x55b17d0e0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 shutdown_connections 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 1 -- 172.21.15.2:0/685901114 wait complete. 2024-08-31T04:29:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.589+0000 7f95fd7d0740 20 client.16218 trim_cache size 0 max 16384 2024-08-31T04:29:50.597 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 msgr2=0x7f95e00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 0x7f95e00b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95e40e3100 tx=0x7f95e4000bc0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 msgr2=0x7f95f019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95e400e9f0 tx=0x7f95e400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 shutdown_connections 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95f0109bc0 0x7f95f019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f0109270 0x7f95f019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f95e00b4ca0 0x7f95e00b71b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 --2- 172.21.15.2:0/613742630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f0103930 0x7f95f019a250 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 >> 172.21.15.2:0/613742630 conn(0x7f95f00ff3a0 msgr2=0x7f95f01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 shutdown_connections 2024-08-31T04:29:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:50.590+0000 7f95f725b640 1 -- 172.21.15.2:0/613742630 wait complete. 2024-08-31T04:29:50.670 INFO:tasks.workunit.client.0.smithi002.stdout: 1 390317 13.09 MB/sec execute 70 sec latency 49.928 ms 2024-08-31T04:29:51.218 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:50 smithi064 ceph-mon[22007]: pgmap v471: 129 pgs: 129 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-08-31T04:29:51.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:50 smithi002 ceph-mon[18656]: pgmap v471: 129 pgs: 129 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-08-31T04:29:51.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:50 smithi132 ceph-mon[22335]: pgmap v471: 129 pgs: 129 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-08-31T04:29:51.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:29:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:51.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 392604 13.03 MB/sec execute 71 sec latency 43.415 ms 2024-08-31T04:29:52.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 -- 172.21.15.2:0/1011218426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8102800 msgr2=0x7f8bb8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/1011218426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8102800 0x7f8bb8102c10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009860 tx=0x7f8bb402a340 comp rx=0 tx=0).stop 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 -- 172.21.15.2:0/1011218426 shutdown_connections 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/1011218426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8108a90 0x7f8bb810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/1011218426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108140 0x7f8bb8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/1011218426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8102800 0x7f8bb8102c10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 -- 172.21.15.2:0/1011218426 >> 172.21.15.2:0/1011218426 conn(0x7f8bb80794d0 msgr2=0x7f8bb80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 -- 172.21.15.2:0/1011218426 shutdown_connections 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.076+0000 7f8bbec7c640 1 -- 172.21.15.2:0/1011218426 wait complete. 2024-08-31T04:29:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 Processor -- start 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 -- start start 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 0x7f8bb819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108a90 0x7f8bb819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8113820 con 0x7f8bb8108140 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81136a0 con 0x7f8bb8108a90 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbec7c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81139a0 con 0x7f8bb8102800 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 0x7f8bb819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43982/0 (socket says 172.21.15.2:43982) 2024-08-31T04:29:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.077+0000 7f8baffff640 1 -- 172.21.15.2:0/640051295 learned_addr learned my addr 172.21.15.2:0/640051295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8bbd219640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108a90 0x7f8bb819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 -- 172.21.15.2:0/640051295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 msgr2=0x7f8bb819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 0x7f8bb819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 -- 172.21.15.2:0/640051295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108a90 msgr2=0x7f8bb819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108a90 0x7f8bb819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 -- 172.21.15.2:0/640051295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb81a0120 con 0x7f8bb8108140 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8bbca18640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 0x7f8bb819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8baffff640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800e9a0 tx=0x7f8ba800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8badffb640 1 -- 172.21.15.2:0/640051295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800cd80 con 0x7f8bb8108140 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8badffb640 1 -- 172.21.15.2:0/640051295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ba80035f0 con 0x7f8bb8108140 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb81a0410 con 0x7f8bb8108140 2024-08-31T04:29:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.078+0000 7f8badffb640 1 -- 172.21.15.2:0/640051295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8010690 con 0x7f8bb8108140 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.079+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb81a6b70 con 0x7f8bb8108140 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 Processor -- start 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8badffb640 1 -- 172.21.15.2:0/640051295 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8ba8004000 con 0x7f8bb8108140 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 -- start start 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a7498310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a7498d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5583a740f680 con 0x5583a70d2390 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5583a73fec10 con 0x5583a70ca1b0 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.081+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583a7402bc0 con 0x5583a70f3070 2024-08-31T04:29:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a7498d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57606/0 (socket says 172.21.15.2:57606) 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 -- 172.21.15.2:0/1336878223 learned_addr learned my addr 172.21.15.2:0/1336878223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbd219640 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a7498310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8badffb640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 0x7f8ba00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 -- 172.21.15.2:0/1336878223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 msgr2=0x5583a7498310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a7498310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 -- 172.21.15.2:0/1336878223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 msgr2=0x5583a7498d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a7498d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbca18640 1 -- 172.21.15.2:0/1336878223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a715e650 con 0x5583a70ca1b0 2024-08-31T04:29:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8bbd219640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 0x7f8ba00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.082+0000 7f8badffb640 1 -- 172.21.15.2:0/640051295 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8ba80e5c10 con 0x7f8bb8108140 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.083+0000 7f8bbca18640 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40057c0 tx=0x7f8bb4005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef5331bac0aeb29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.083+0000 7f8b9effd640 1 -- 172.21.15.2:0/1336878223 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4037040 con 0x5583a70ca1b0 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.083+0000 7f8b9effd640 1 -- 172.21.15.2:0/1336878223 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4030450 con 0x5583a70ca1b0 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.083+0000 7f8b9effd640 1 -- 172.21.15.2:0/1336878223 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4032b30 con 0x5583a70ca1b0 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 -- 172.21.15.2:0/1336878223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 msgr2=0x5583a7498850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40057c0 tx=0x7f8bb4005d90 comp rx=0 tx=0).stop 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bbd219640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 0x7f8ba00b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009fd0 tx=0x7f8bb0004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 -- 172.21.15.2:0/1336878223 shutdown_connections 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a7498d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70ca1b0 0x5583a7498850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/1336878223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a7498310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 -- 172.21.15.2:0/1336878223 >> 172.21.15.2:0/1336878223 conn(0x5583a70e7460 msgr2=0x5583a7496200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 -- 172.21.15.2:0/1336878223 shutdown_connections 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.084+0000 7f8bc51f1740 1 -- 172.21.15.2:0/1336878223 wait complete. 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 -- start start 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 Processor -- start 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a74afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5583a7261700 con 0x5583a70d2390 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5583a7385750 con 0x5583a70f3070 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583a74a6a90 con 0x5583a70ca1b0 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bc51f1740 10 client.0 _ll_register_callbacks cb 0x5583a73b4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44006/0 (socket says 172.21.15.2:44006) 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8baffff640 1 -- 172.21.15.2:0/4014474280 learned_addr learned my addr 172.21.15.2:0/4014474280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.085+0000 7f8bbd219640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a74afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 -- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 msgr2=0x5583a74afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a74afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 -- 172.21.15.2:0/4014474280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 msgr2=0x5583a74a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 -- 172.21.15.2:0/4014474280 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a73be900 con 0x5583a70ca1b0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8baffff640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbd219640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a74afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bbca18640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74a3a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005eb0 tx=0x7f8bb402aa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a90e0aed111fef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8b97fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4037030 con 0x5583a70ca1b0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8bb40328d0 con 0x5583a70ca1b0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.086+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb4030450 con 0x5583a70ca1b0 2024-08-31T04:29:52.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8bb4057050 con 0x5583a70ca1b0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 10 client.25798 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583a74b28a0 con 0x5583a70ca1b0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4030450 con 0x5583a70ca1b0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8bb4046460 con 0x5583a70ca1b0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 10 client.25798 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 10 client.25798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 20 client.25798 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a70b19f0 0x5583a74b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 4 client.25798 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583a74115d0 con 0x5583a70b19f0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.087+0000 7f8baffff640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a70b19f0 0x5583a74b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.088+0000 7f8b97fff640 10 client.25798 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.088+0000 7f8baffff640 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a70b19f0 0x5583a74b5c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=932122f7fc7b6626 server_cookie=53a8c8440d460c11 in_seq=0 out_seq=0 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8b97fff640 1 -- 172.21.15.2:0/4014474280 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583a74115d0 con 0x5583a70b19f0 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8b97fff640 10 client.25798 handle_command_reply: tid=0 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 client.25798 shutdown 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 msgr2=0x5583a74a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74a3a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005eb0 tx=0x7f8bb402aa80 comp rx=0 tx=0).stop 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 shutdown_connections 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a70b19f0 0x5583a74b5c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a74afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/4014474280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74a3a90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8b97fff640 0 client.25798 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 >> 172.21.15.2:0/4014474280 conn(0x5583a70e7460 msgr2=0x5583a749b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 shutdown_connections 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 1 -- 172.21.15.2:0/4014474280 wait complete. 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.089+0000 7f8bc51f1740 20 client.25798 trim_cache size 0 max 16384 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.103+0000 7f8bc51f1740 1 Processor -- start 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.103+0000 7f8bc51f1740 1 -- start start 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.103+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.103+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 0x5583a749b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.103+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a749b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81b1500 con 0x5583a70ca1b0 2024-08-31T04:29:52.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81aedd0 con 0x5583a70d2390 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81acc20 con 0x5583a70f3070 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8baffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 0x5583a749b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44022/0 (socket says 172.21.15.2:44022) 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 -- 172.21.15.2:0/3732823639 learned_addr learned my addr 172.21.15.2:0/3732823639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbd219640 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a749b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 -- 172.21.15.2:0/3732823639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 msgr2=0x5583a749b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a749b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 -- 172.21.15.2:0/3732823639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 msgr2=0x5583a749b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 0x5583a749b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 -- 172.21.15.2:0/3732823639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a74903d0 con 0x5583a70ca1b0 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8baffff640 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 0x5583a749b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:52.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8bbca18640 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40057c0 tx=0x7f8bb402aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6153f8821a73d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8b9e7fc640 1 -- 172.21.15.2:0/3732823639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb404a070 con 0x5583a70ca1b0 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8b9e7fc640 1 -- 172.21.15.2:0/3732823639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4030450 con 0x5583a70ca1b0 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.104+0000 7f8b9e7fc640 1 -- 172.21.15.2:0/3732823639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4037040 con 0x5583a70ca1b0 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 -- 172.21.15.2:0/3732823639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 msgr2=0x5583a74a4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40057c0 tx=0x7f8bb402aaf0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 -- 172.21.15.2:0/3732823639 shutdown_connections 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70f3070 0x5583a749b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70d2390 0x5583a749b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/3732823639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70ca1b0 0x5583a74a4070 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 -- 172.21.15.2:0/3732823639 >> 172.21.15.2:0/3732823639 conn(0x5583a70e7460 msgr2=0x5583a74a2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 -- 172.21.15.2:0/3732823639 shutdown_connections 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.105+0000 7f8bc51f1740 1 -- 172.21.15.2:0/3732823639 wait complete. 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 -- start start 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 Processor -- start 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a75183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ad290 con 0x5583a70d2390 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ae700 con 0x5583a70f3070 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ad960 con 0x5583a70ca1b0 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bc51f1740 10 client.0 _ll_register_callbacks cb 0x7f8ba80a8530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8bbd219640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a75183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8baffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44036/0 (socket says 172.21.15.2:44036) 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.106+0000 7f8baffff640 1 -- 172.21.15.2:0/283839057 learned_addr learned my addr 172.21.15.2:0/283839057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8bbca18640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 -- 172.21.15.2:0/283839057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 msgr2=0x5583a74b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 -- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 msgr2=0x5583a75183b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a75183b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 -- 172.21.15.2:0/283839057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a7518a20 con 0x5583a70d2390 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8baffff640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80e2ff0 tx=0x7f8ba80e8120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fbc1cbcef3dec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8b97fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80932e0 con 0x5583a70d2390 2024-08-31T04:29:52.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f8ba80b02a0 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb4030450 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ba80ab9f0 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8bc51f1740 10 client.16236 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.107+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583a751fe50 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4030450 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8bb4030d10 con 0x5583a70d2390 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 10 client.16236 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 10 client.16236 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 20 client.16236 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:52.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a7086da0 0x5583a7522570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 4 client.16236 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583a740d070 con 0x5583a7086da0 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bbca18640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a7086da0 0x5583a7522570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8b97fff640 10 client.16236 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.108+0000 7f8bbca18640 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a7086da0 0x5583a7522570 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc8c7f1665a80e99 server_cookie=79e16dce965c2e74 in_seq=0 out_seq=0 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8b97fff640 1 -- 172.21.15.2:0/283839057 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583a740d070 con 0x5583a7086da0 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8b97fff640 10 client.16236 handle_command_reply: tid=0 2024-08-31T04:29:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 client.16236 shutdown 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 msgr2=0x5583a74b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80e2ff0 tx=0x7f8ba80e8120 comp rx=0 tx=0).stop 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 shutdown_connections 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5583a7086da0 0x5583a7522570 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583a70d2390 0x5583a74b6c00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8b97fff640 0 client.16236 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5583a70f3070 0x5583a75183b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 --2- 172.21.15.2:0/283839057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583a70ca1b0 0x5583a74b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 >> 172.21.15.2:0/283839057 conn(0x5583a70e7460 msgr2=0x5583a749b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 shutdown_connections 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 1 -- 172.21.15.2:0/283839057 wait complete. 2024-08-31T04:29:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.109+0000 7f8bc51f1740 20 client.16236 trim_cache size 0 max 16384 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 msgr2=0x7f8ba00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 0x7f8ba00b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009fd0 tx=0x7f8bb0004a40 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 msgr2=0x7f8bb819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800e9a0 tx=0x7f8ba800ee60 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 shutdown_connections 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8ba00b4ca0 0x7f8ba00b71b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8108140 0x7f8bb819a750 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bb8108a90 0x7f8bb819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 --2- 172.21.15.2:0/640051295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bb8102800 0x7f8bb819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 >> 172.21.15.2:0/640051295 conn(0x7f8bb80794d0 msgr2=0x7f8bb8101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 shutdown_connections 2024-08-31T04:29:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:52.110+0000 7f8bbec7c640 1 -- 172.21.15.2:0/640051295 wait complete. 2024-08-31T04:29:52.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 394506 13.02 MB/sec execute 72 sec latency 20.687 ms 2024-08-31T04:29:53.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:52 smithi002 ceph-mon[18656]: pgmap v472: 129 pgs: 129 active+clean; 231 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 277 op/s 2024-08-31T04:29:53.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:29:53.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:52 smithi064 ceph-mon[22007]: pgmap v472: 129 pgs: 129 active+clean; 231 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 277 op/s 2024-08-31T04:29:53.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:52 smithi132 ceph-mon[22335]: pgmap v472: 129 pgs: 129 active+clean; 231 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 277 op/s 2024-08-31T04:29:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:53.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 397409 13.08 MB/sec execute 73 sec latency 19.180 ms 2024-08-31T04:29:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 -- 172.21.15.2:0/4124318852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 msgr2=0x7f9b18103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4124318852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b18103d40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009900 tx=0x7f9b1402a410 comp rx=0 tx=0).stop 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 -- 172.21.15.2:0/4124318852 shutdown_connections 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4124318852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109bc0 0x7f9b181103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4124318852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109270 0x7f9b18109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4124318852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b18103d40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 -- 172.21.15.2:0/4124318852 >> 172.21.15.2:0/4124318852 conn(0x7f9b180ff3a0 msgr2=0x7f9b181017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 -- 172.21.15.2:0/4124318852 shutdown_connections 2024-08-31T04:29:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.021+0000 7f9b207ba640 1 -- 172.21.15.2:0/4124318852 wait complete. 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 Processor -- start 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 -- start start 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109270 0x7f9b180759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 0x7f9b18075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18113880 con 0x7f9b18103930 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18113700 con 0x7f9b18109bc0 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b207ba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18113a00 con 0x7f9b18109270 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109270 0x7f9b180759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b1ed57640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 0x7f9b18075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44044/0 (socket says 172.21.15.2:44044) 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.022+0000 7f9b1e556640 1 -- 172.21.15.2:0/4285219120 learned_addr learned my addr 172.21.15.2:0/4285219120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 -- 172.21.15.2:0/4285219120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109270 msgr2=0x7f9b180759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109270 0x7f9b180759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 -- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 msgr2=0x7f9b180754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 -- 172.21.15.2:0/4285219120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b181a84f0 con 0x7f9b18109bc0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1e556640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b1ed57640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 0x7f9b18075f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e940 tx=0x7f9b1000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/4285219120 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10004d20 con 0x7f9b18109bc0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b181a87e0 con 0x7f9b18109bc0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/4285219120 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b10005020 con 0x7f9b18109bc0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/4285219120 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b100116d0 con 0x7f9b18109bc0 2024-08-31T04:29:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.023+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181a8d20 con 0x7f9b18109bc0 2024-08-31T04:29:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.026+0000 7f9b26d2f740 1 Processor -- start 2024-08-31T04:29:54.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.026+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/4285219120 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9b10005460 con 0x7f9b18109bc0 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 -- start start 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d14310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 0x55bbb2d14850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d14d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2c8b680 con 0x55bbb296f070 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2c7ac10 con 0x55bbb29461b0 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2c7ebc0 con 0x55bbb294e390 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d14310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d14310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44046/0 (socket says 172.21.15.2:44046) 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b1dd55640 1 -- 172.21.15.2:0/3772469178 learned_addr learned my addr 172.21.15.2:0/3772469178 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b1e556640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 0x55bbb2d14850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.027+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d14d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b0f7fe640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 0x7f9b040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 -- 172.21.15.2:0/3772469178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 msgr2=0x55bbb2d14850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 0x55bbb2d14850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 -- 172.21.15.2:0/3772469178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 msgr2=0x55bbb2d14310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d14310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1ed57640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 0x7f9b040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 -- 172.21.15.2:0/3772469178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbb29da650 con 0x55bbb294e390 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1e556640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 0x55bbb2d14850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d14d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b080137c0 tx=0x7f9b08004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434c63e40b33d789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/4285219120 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f9b100e5a40 con 0x7f9b18109bc0 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b0cff9640 1 -- 172.21.15.2:0/3772469178 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08013130 con 0x55bbb294e390 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b0cff9640 1 -- 172.21.15.2:0/3772469178 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b080132d0 con 0x55bbb294e390 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.028+0000 7f9b0cff9640 1 -- 172.21.15.2:0/3772469178 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08005650 con 0x55bbb294e390 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3772469178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 msgr2=0x55bbb2d14d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b1ed57640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 0x7f9b040b71b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b100a8fd0 tx=0x7f9b100b0040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d14d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b080137c0 tx=0x7f9b08004730 comp rx=0 tx=0).stop 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3772469178 shutdown_connections 2024-08-31T04:29:54.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d14d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb29461b0 0x55bbb2d14850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3772469178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d14310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.029+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3772469178 >> 172.21.15.2:0/3772469178 conn(0x55bbb2963460 msgr2=0x55bbb2d12200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3772469178 shutdown_connections 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3772469178 wait complete. 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- start start 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 Processor -- start 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d1fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d2bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2add700 con 0x55bbb296f070 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2c01750 con 0x55bbb294e390 2024-08-31T04:29:54.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55bbb2d22a90 con 0x55bbb29461b0 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.030+0000 7f9b26d2f740 10 client.0 _ll_register_callbacks cb 0x55bbb2c30e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d2bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57662/0 (socket says 172.21.15.2:57662) 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 -- 172.21.15.2:0/3010479188 learned_addr learned my addr 172.21.15.2:0/3010479188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d1fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 -- 172.21.15.2:0/3010479188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 msgr2=0x55bbb2d1fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d1fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 -- 172.21.15.2:0/3010479188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 msgr2=0x55bbb2d2bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d2bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 -- 172.21.15.2:0/3010479188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbb2c3a900 con 0x55bbb294e390 2024-08-31T04:29:54.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d1fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b1e556640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b14006010 tx=0x7f9b14031810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c2b3dd3c524c06c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14035040 con 0x55bbb294e390 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f9b14004450 con 0x55bbb294e390 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.031+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b080132d0 con 0x55bbb294e390 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b14005020 con 0x55bbb294e390 2024-08-31T04:29:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 10 client.25967 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbb2d2e800 con 0x55bbb294e390 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b080132d0 con 0x55bbb294e390 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9b140035f0 con 0x55bbb294e390 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 10 client.25967 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 20 client.25967 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb292d9f0 0x55bbb2d31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 4 client.25967 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbb2c8d5d0 con 0x55bbb292d9f0 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.032+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb292d9f0 0x55bbb2d31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.033+0000 7f9b01ffb640 10 client.25967 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.033+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb292d9f0 0x55bbb2d31d50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee03820c98bdd1c server_cookie=a321d0557564adbd in_seq=0 out_seq=0 2024-08-31T04:29:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b01ffb640 1 -- 172.21.15.2:0/3010479188 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbb2c8d5d0 con 0x55bbb292d9f0 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b01ffb640 10 client.25967 handle_command_reply: tid=0 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 client.25967 shutdown 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 msgr2=0x55bbb2d1ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b14006010 tx=0x7f9b14031810 comp rx=0 tx=0).stop 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 shutdown_connections 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb292d9f0 0x55bbb2d31d50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb296f070 0x55bbb2d2bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb294e390 0x55bbb2d1ff70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/3010479188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d1fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 >> 172.21.15.2:0/3010479188 conn(0x55bbb2963460 msgr2=0x55bbb2d174f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b01ffb640 0 client.25967 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 shutdown_connections 2024-08-31T04:29:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 1 -- 172.21.15.2:0/3010479188 wait complete. 2024-08-31T04:29:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.034+0000 7f9b26d2f740 20 client.25967 trim_cache size 0 max 16384 2024-08-31T04:29:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 Processor -- start 2024-08-31T04:29:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 -- start start 2024-08-31T04:29:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d12300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d2c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b58c0 con 0x55bbb294e390 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b3190 con 0x55bbb296f070 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.048+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b0fe0 con 0x55bbb29461b0 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44060/0 (socket says 172.21.15.2:44060) 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d2c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 -- 172.21.15.2:0/545737413 learned_addr learned my addr 172.21.15.2:0/545737413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d12300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 -- 172.21.15.2:0/545737413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 msgr2=0x55bbb2d12300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d12300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 -- 172.21.15.2:0/545737413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 msgr2=0x55bbb2d2c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d2c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 -- 172.21.15.2:0/545737413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbb2d0d5a0 con 0x55bbb294e390 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b1e556640 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9b14032fd0 tx=0x7f9b14001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a2f0456e0e0eeb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.049+0000 7f9b03fff640 1 -- 172.21.15.2:0/545737413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14059070 con 0x55bbb294e390 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b03fff640 1 -- 172.21.15.2:0/545737413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b14003c00 con 0x55bbb294e390 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b03fff640 1 -- 172.21.15.2:0/545737413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14035030 con 0x55bbb294e390 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 -- 172.21.15.2:0/545737413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 msgr2=0x55bbb2d2bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9b14032fd0 tx=0x7f9b14001e70 comp rx=0 tx=0).stop 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 -- 172.21.15.2:0/545737413 shutdown_connections 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb294e390 0x55bbb2d2bc80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d2c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/545737413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb29461b0 0x55bbb2d12300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 -- 172.21.15.2:0/545737413 >> 172.21.15.2:0/545737413 conn(0x55bbb2963460 msgr2=0x55bbb2d11bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 -- 172.21.15.2:0/545737413 shutdown_connections 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.050+0000 7f9b26d2f740 1 -- 172.21.15.2:0/545737413 wait complete. 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 -- start start 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 Processor -- start 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d23f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b1650 con 0x55bbb29461b0 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b2ac0 con 0x55bbb296f070 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b1d20 con 0x55bbb294e390 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b26d2f740 10 client.0 _ll_register_callbacks cb 0x7f9b140314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b1dd55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44068/0 (socket says 172.21.15.2:44068) 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b1dd55640 1 -- 172.21.15.2:0/585271480 learned_addr learned my addr 172.21.15.2:0/585271480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d23f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.051+0000 7f9b1e556640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 -- 172.21.15.2:0/585271480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 msgr2=0x55bbb2d239c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d239c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 -- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 msgr2=0x55bbb2d23f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d23f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 -- 172.21.15.2:0/585271480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbb2d246d0 con 0x55bbb29461b0 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1e556640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d239c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b1dd55640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005500 tx=0x7f9b08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28b71fb17a5bb99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800f790 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f9b0801b040 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b14003c00 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b0800f930 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b26d2f740 10 client.16254 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.052+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbb2d9c700 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b14003c00 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9b080109b0 con 0x55bbb29461b0 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 10 client.16254 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 20 client.16254 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb2902da0 0x55bbb2d9edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 4 client.16254 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:29:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbb2c89070 con 0x55bbb2902da0 2024-08-31T04:29:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.053+0000 7f9b1e556640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb2902da0 0x55bbb2d9edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.054+0000 7f9b01ffb640 10 client.16254 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.054+0000 7f9b1e556640 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb2902da0 0x55bbb2d9edb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e469a2a694c7f40f server_cookie=7ae3b0c009451dcc in_seq=0 out_seq=0 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b01ffb640 1 -- 172.21.15.2:0/585271480 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbb2c89070 con 0x55bbb2902da0 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b01ffb640 10 client.16254 handle_command_reply: tid=0 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 client.16254 shutdown 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 msgr2=0x55bbb2d28510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005500 tx=0x7f9b08004730 comp rx=0 tx=0).stop 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 shutdown_connections 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bbb2902da0 0x55bbb2d9edb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bbb296f070 0x55bbb2d23f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b01ffb640 0 client.16254 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb294e390 0x55bbb2d239c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 --2- 172.21.15.2:0/585271480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbb29461b0 0x55bbb2d28510 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 >> 172.21.15.2:0/585271480 conn(0x55bbb2963460 msgr2=0x55bbb2d17410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 shutdown_connections 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 1 -- 172.21.15.2:0/585271480 wait complete. 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.056+0000 7f9b26d2f740 20 client.16254 trim_cache size 0 max 16384 2024-08-31T04:29:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 msgr2=0x7f9b040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 0x7f9b040b71b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b100a8fd0 tx=0x7f9b100b0040 comp rx=0 tx=0).stop 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 msgr2=0x7f9b18075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 0x7f9b18075f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e940 tx=0x7f9b1000ee00 comp rx=0 tx=0).stop 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 shutdown_connections 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b18109bc0 0x7f9b18075f30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18109270 0x7f9b180759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9b040b4ca0 0x7f9b040b71b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 --2- 172.21.15.2:0/4285219120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b18103930 0x7f9b180754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 >> 172.21.15.2:0/4285219120 conn(0x7f9b180ff3a0 msgr2=0x7f9b181017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 shutdown_connections 2024-08-31T04:29:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:54.057+0000 7f9b207ba640 1 -- 172.21.15.2:0/4285219120 wait complete. 2024-08-31T04:29:54.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 399764 13.02 MB/sec execute 74 sec latency 39.617 ms 2024-08-31T04:29:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:54 smithi002 ceph-mon[18656]: pgmap v473: 129 pgs: 129 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 309 op/s 2024-08-31T04:29:55.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:54 smithi064 ceph-mon[22007]: pgmap v473: 129 pgs: 129 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 309 op/s 2024-08-31T04:29:55.321 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:54 smithi132 ceph-mon[22335]: pgmap v473: 129 pgs: 129 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 309 op/s 2024-08-31T04:29:55.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 401742 13.01 MB/sec execute 75 sec latency 39.903 ms 2024-08-31T04:29:55.896 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:29:55.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:29:56.236 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:56.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 404464 13.06 MB/sec execute 76 sec latency 62.013 ms 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 -- 172.21.15.2:0/4228237709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 msgr2=0x7f394010d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 --2- 172.21.15.2:0/4228237709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394010d730 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f392c009900 tx=0x7f392c02a410 comp rx=0 tx=0).stop 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 -- 172.21.15.2:0/4228237709 shutdown_connections 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 --2- 172.21.15.2:0/4228237709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394010d730 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 --2- 172.21.15.2:0/4228237709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f394010dc70 0x7f39401100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 --2- 172.21.15.2:0/4228237709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39401046c0 0x7f3940104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 -- 172.21.15.2:0/4228237709 >> 172.21.15.2:0/4228237709 conn(0x7f3940079550 msgr2=0x7f3940079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 -- 172.21.15.2:0/4228237709 shutdown_connections 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.742+0000 7f3946b5f640 1 -- 172.21.15.2:0/4228237709 wait complete. 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 Processor -- start 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 -- start start 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39401046c0 0x7f394019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f394010dc70 0x7f394019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3940113800 con 0x7f3940105010 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3940113680 con 0x7f394010dc70 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f3946b5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3940113980 con 0x7f39401046c0 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f393ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f39448fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39401046c0 0x7f394019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f393ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55736/0 (socket says 172.21.15.2:55736) 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.743+0000 7f393ffff640 1 -- 172.21.15.2:0/342133190 learned_addr learned my addr 172.21.15.2:0/342133190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f39450fc640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f394010dc70 0x7f394019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 -- 172.21.15.2:0/342133190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39401046c0 msgr2=0x7f394019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39401046c0 0x7f394019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 -- 172.21.15.2:0/342133190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f394010dc70 msgr2=0x7f394019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f394010dc70 0x7f394019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 -- 172.21.15.2:0/342133190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39401a0260 con 0x7f3940105010 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393ffff640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f392c02a930 tx=0x7f392c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393dffb640 1 -- 172.21.15.2:0/342133190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c03f030 con 0x7f3940105010 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393dffb640 1 -- 172.21.15.2:0/342133190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392c004490 con 0x7f3940105010 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39401a04f0 con 0x7f3940105010 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f393dffb640 1 -- 172.21.15.2:0/342133190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c035070 con 0x7f3940105010 2024-08-31T04:29:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.744+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39401a6cb0 con 0x7f3940105010 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 Processor -- start 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 -- start start 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f393dffb640 1 -- 172.21.15.2:0/342133190 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f392c042030 con 0x7f3940105010 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56164326a490 0x561643639cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643272670 0x56164363a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5616435af5f0 con 0x561643293350 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56164359eb80 con 0x561643272670 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f394d0d4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5616435a2b30 con 0x56164326a490 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f39450fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f39450fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55752/0 (socket says 172.21.15.2:55752) 2024-08-31T04:29:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.747+0000 7f39450fc640 1 -- 172.21.15.2:0/2516347417 learned_addr learned my addr 172.21.15.2:0/2516347417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39448fb640 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56164326a490 0x561643639cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f393ffff640 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643272670 0x56164363a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 -- 172.21.15.2:0/2516347417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56164326a490 msgr2=0x561643639cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56164326a490 0x561643639cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 -- 172.21.15.2:0/2516347417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643272670 msgr2=0x56164363a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643272670 0x56164363a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 -- 172.21.15.2:0/2516347417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616432fe930 con 0x561643293350 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39450fc640 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3938009f50 tx=0x7f39380118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba9c7aea0430616 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f393dffb640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 0x7f39300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f39448fb640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 0x7f39300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f392affd640 1 -- 172.21.15.2:0/2516347417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938004d20 con 0x561643293350 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f393dffb640 1 -- 172.21.15.2:0/342133190 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f392c105c40 con 0x7f3940105010 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f392affd640 1 -- 172.21.15.2:0/2516347417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3938004050 con 0x561643293350 2024-08-31T04:29:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.748+0000 7f392affd640 1 -- 172.21.15.2:0/2516347417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938005280 con 0x561643293350 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f39448fb640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 0x7f39300b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x561643638400 tx=0x7f3934005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 -- 172.21.15.2:0/2516347417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 msgr2=0x561643639780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3938009f50 tx=0x7f39380118d0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 -- 172.21.15.2:0/2516347417 shutdown_connections 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643272670 0x56164363a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56164326a490 0x561643639cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2516347417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643293350 0x561643639780 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 -- 172.21.15.2:0/2516347417 >> 172.21.15.2:0/2516347417 conn(0x561643287740 msgr2=0x561643637670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 -- 172.21.15.2:0/2516347417 shutdown_connections 2024-08-31T04:29:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.749+0000 7f394d0d4740 1 -- 172.21.15.2:0/2516347417 wait complete. 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.750+0000 7f394d0d4740 1 -- start start 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.750+0000 7f394d0d4740 1 Processor -- start 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x561643645430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x561643651280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561643401890 con 0x561643272670 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561643525790 con 0x56164326a490 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561643647f60 con 0x561643293350 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f394d0d4740 10 client.0 _ll_register_callbacks cb 0x5616432aaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f393ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x561643645430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:53406/0 (socket says 172.21.15.2:53406) 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 -- 172.21.15.2:0/3242933670 learned_addr learned my addr 172.21.15.2:0/3242933670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39450fc640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x561643651280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 -- 172.21.15.2:0/3242933670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 msgr2=0x561643651280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x561643651280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 -- 172.21.15.2:0/3242933670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 msgr2=0x561643645430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x561643645430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 -- 172.21.15.2:0/3242933670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164355cf30 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f393ffff640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x561643645430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f39448fb640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39340045f0 tx=0x7f3934004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101cb33fd805e2ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.751+0000 7f391ffff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393401f640 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f393401f7e0 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3938004050 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f393401f9e0 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 10 client.25985 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561643653d60 con 0x56164326a490 2024-08-31T04:29:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3938004050 con 0x56164326a490 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3934027070 con 0x56164326a490 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 10 client.25985 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 10 client.25985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 20 client.25985 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643251cd0 0x5616436572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 4 client.25985 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616435b1540 con 0x561643251cd0 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.752+0000 7f393ffff640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643251cd0 0x5616436572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.753+0000 7f391ffff640 10 client.25985 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.753+0000 7f393ffff640 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643251cd0 0x5616436572e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ace640c9cdd58f9 server_cookie=da81ee97a6abba8 in_seq=0 out_seq=0 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f391ffff640 1 -- 172.21.15.2:0/3242933670 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616435b1540 con 0x561643251cd0 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f391ffff640 10 client.25985 handle_command_reply: tid=0 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 client.25985 shutdown 2024-08-31T04:29:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 msgr2=0x561643644ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39340045f0 tx=0x7f3934004730 comp rx=0 tx=0).stop 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 shutdown_connections 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643251cd0 0x5616436572e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x561643645430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x561643651280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f391ffff640 0 client.25985 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 --2- 172.21.15.2:0/3242933670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643644ef0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 >> 172.21.15.2:0/3242933670 conn(0x561643287740 msgr2=0x56164363c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 shutdown_connections 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.754+0000 7f394d0d4740 1 -- 172.21.15.2:0/3242933670 wait complete. 2024-08-31T04:29:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.755+0000 7f394d0d4740 20 client.25985 trim_cache size 0 max 16384 2024-08-31T04:29:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 Processor -- start 2024-08-31T04:29:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 -- start start 2024-08-31T04:29:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 0x561643646b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643293350 0x5616436371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39401b3800 con 0x56164326a490 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39401b10d0 con 0x561643293350 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f394d0d4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f39401aef20 con 0x561643272670 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f39448fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 0x561643646b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f393ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f39450fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643293350 0x5616436371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f393ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:42346/0 (socket says 172.21.15.2:42346) 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f39448fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 0x561643646b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55762/0 (socket says 172.21.15.2:55762) 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.773+0000 7f393ffff640 1 -- 172.21.15.2:0/618978460 learned_addr learned my addr 172.21.15.2:0/618978460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 -- 172.21.15.2:0/618978460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643293350 msgr2=0x5616436371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643293350 0x5616436371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 -- 172.21.15.2:0/618978460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 msgr2=0x561643646b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 0x561643646b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 -- 172.21.15.2:0/618978460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561643643e50 con 0x561643272670 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f393ffff640 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f392c031440 tx=0x7f392c109790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b4188d02a2ad81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f392a7fc640 1 -- 172.21.15.2:0/618978460 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c049040 con 0x561643272670 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f392a7fc640 1 -- 172.21.15.2:0/618978460 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392c0cbad0 con 0x561643272670 2024-08-31T04:29:56.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.774+0000 7f392a7fc640 1 -- 172.21.15.2:0/618978460 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0d5230 con 0x561643272670 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- 172.21.15.2:0/618978460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 msgr2=0x561643636ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f392c031440 tx=0x7f392c109790 comp rx=0 tx=0).stop 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- 172.21.15.2:0/618978460 shutdown_connections 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561643293350 0x5616436371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643272670 0x561643636ca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 --2- 172.21.15.2:0/618978460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164326a490 0x561643646b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- 172.21.15.2:0/618978460 >> 172.21.15.2:0/618978460 conn(0x561643287740 msgr2=0x561643646410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- 172.21.15.2:0/618978460 shutdown_connections 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- 172.21.15.2:0/618978460 wait complete. 2024-08-31T04:29:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.775+0000 7f394d0d4740 1 -- start start 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 Processor -- start 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643649cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x5616436bf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39401af590 con 0x561643272670 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39401b0a00 con 0x56164326a490 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f39401afc60 con 0x561643293350 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f394d0d4740 10 client.0 _ll_register_callbacks cb 0x7f3934009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f393ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f393ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55764/0 (socket says 172.21.15.2:55764) 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f393ffff640 1 -- 172.21.15.2:0/2051352543 learned_addr learned my addr 172.21.15.2:0/2051352543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f39448fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643649cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.776+0000 7f39450fc640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x5616436bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 -- 172.21.15.2:0/2051352543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 msgr2=0x5616436bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x5616436bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 -- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 msgr2=0x561643649cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643649cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 -- 172.21.15.2:0/2051352543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616436bf880 con 0x561643272670 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f39448fb640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643649cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f393ffff640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f392c03b480 tx=0x7f392c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72967c66a12a26e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f391ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c049070 con 0x561643272670 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f392c0b71f0 con 0x561643272670 2024-08-31T04:29:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f392c0cbad0 con 0x561643272670 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f392c0cb730 con 0x561643272670 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f394d0d4740 10 client.16272 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.777+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616436c6c90 con 0x561643272670 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392c0cbad0 con 0x561643272670 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f392c0c8250 con 0x561643272670 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 10 client.16272 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 20 client.16272 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643227080 0x5616436c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 4 client.16272 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5616435acfe0 con 0x561643227080 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.778+0000 7f39448fb640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643227080 0x5616436c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.779+0000 7f39448fb640 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643227080 0x5616436c93f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5897263d7443e7bf server_cookie=ebdf1c4f59fea190 in_seq=0 out_seq=0 2024-08-31T04:29:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.779+0000 7f391ffff640 10 client.16272 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f391ffff640 1 -- 172.21.15.2:0/2051352543 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5616435acfe0 con 0x561643227080 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f391ffff640 10 client.16272 handle_command_reply: tid=0 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 client.16272 shutdown 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 msgr2=0x56164364a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f392c03b480 tx=0x7f392c009610 comp rx=0 tx=0).stop 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 shutdown_connections 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561643227080 0x5616436c93f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561643272670 0x56164364a2d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561643293350 0x5616436bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f391ffff640 0 client.16272 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 --2- 172.21.15.2:0/2051352543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56164326a490 0x561643649cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 >> 172.21.15.2:0/2051352543 conn(0x561643287740 msgr2=0x56164363c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 shutdown_connections 2024-08-31T04:29:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 1 -- 172.21.15.2:0/2051352543 wait complete. 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.782+0000 7f394d0d4740 20 client.16272 trim_cache size 0 max 16384 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d", 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:29:56.786 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 msgr2=0x7f39300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 0x7f39300b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x561643638400 tx=0x7f3934005f90 comp rx=0 tx=0).stop 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 msgr2=0x7f394019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f392c02a930 tx=0x7f392c031a20 comp rx=0 tx=0).stop 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 shutdown_connections 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f39300b4ca0 0x7f39300b71b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3940105010 0x7f394019a890 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f394010dc70 0x7f394019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 --2- 172.21.15.2:0/342133190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39401046c0 0x7f394019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 >> 172.21.15.2:0/342133190 conn(0x7f3940079550 msgr2=0x7f3940100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 shutdown_connections 2024-08-31T04:29:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:56.783+0000 7f3946b5f640 1 -- 172.21.15.2:0/342133190 wait complete. 2024-08-31T04:29:57.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:56 smithi002 ceph-mon[18656]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 247 op/s 2024-08-31T04:29:57.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:56 smithi064 ceph-mon[22007]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 247 op/s 2024-08-31T04:29:57.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:56 smithi132 ceph-mon[22335]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 247 op/s 2024-08-31T04:29:57.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:29:57.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 406584 12.99 MB/sec execute 77 sec latency 34.197 ms 2024-08-31T04:29:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:58.209 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:29:58.209 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.209 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:29:58.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:29:58.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:57 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 -- 172.21.15.2:0/3046281226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 msgr2=0x7f0afc10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 --2- 172.21.15.2:0/3046281226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc10f2c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009ca0 tx=0x7f0af402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 -- 172.21.15.2:0/3046281226 shutdown_connections 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 --2- 172.21.15.2:0/3046281226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc10f2c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 --2- 172.21.15.2:0/3046281226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 0x7f0afc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 --2- 172.21.15.2:0/3046281226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 -- 172.21.15.2:0/3046281226 >> 172.21.15.2:0/3046281226 conn(0x7f0afc0794d0 msgr2=0x7f0afc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 -- 172.21.15.2:0/3046281226 shutdown_connections 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.303+0000 7f0b0289c640 1 -- 172.21.15.2:0/3046281226 wait complete. 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.304+0000 7f0b0289c640 1 Processor -- start 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.304+0000 7f0b0289c640 1 -- start start 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 0x7f0afc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc112710 con 0x7f0afc108a90 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc112590 con 0x7f0afc108140 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b0289c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc112890 con 0x7f0afc102800 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0afbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 0x7f0afc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0afbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:42378/0 (socket says 172.21.15.2:42378) 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0afbfff640 1 -- 172.21.15.2:0/4153944201 learned_addr learned my addr 172.21.15.2:0/4153944201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 -- 172.21.15.2:0/4153944201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 msgr2=0x7f0afc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 -- 172.21.15.2:0/4153944201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 msgr2=0x7f0afc1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 0x7f0afc1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 -- 172.21.15.2:0/4153944201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc19f170 con 0x7f0afc108a90 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0afbfff640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.305+0000 7f0b00e39640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc19ea40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0af402ade0 tx=0x7f0af40316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.306+0000 7f0af97fa640 1 -- 172.21.15.2:0/4153944201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af404a070 con 0x7f0afc108a90 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.306+0000 7f0af97fa640 1 -- 172.21.15.2:0/4153944201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af4003b80 con 0x7f0afc108a90 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.306+0000 7f0af97fa640 1 -- 172.21.15.2:0/4153944201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af402f8c0 con 0x7f0afc108a90 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.306+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc19f400 con 0x7f0afc108a90 2024-08-31T04:29:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.306+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc06ac00 con 0x7f0afc108a90 2024-08-31T04:29:58.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 Processor -- start 2024-08-31T04:29:58.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0af97fa640 1 -- 172.21.15.2:0/4153944201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0af404d070 con 0x7f0afc108a90 2024-08-31T04:29:58.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 -- start start 2024-08-31T04:29:58.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d42451b0 0x5640d4613800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d4613d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640d458a630 con 0x5640d426e070 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5640d4579bc0 con 0x5640d42451b0 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.309+0000 7f0b08e11740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5640d457db70 con 0x5640d424d390 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55786/0 (socket says 172.21.15.2:55786) 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 -- 172.21.15.2:0/763391880 learned_addr learned my addr 172.21.15.2:0/763391880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d4613d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afbfff640 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d42451b0 0x5640d4613800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0af97fa640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 0x7f0ae40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 -- 172.21.15.2:0/763391880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 msgr2=0x5640d4613d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d4613d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 -- 172.21.15.2:0/763391880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d42451b0 msgr2=0x5640d4613800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d42451b0 0x5640d4613800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 -- 172.21.15.2:0/763391880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d42d9650 con 0x5640d426e070 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0b00e39640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 0x7f0ae40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0af97fa640 1 -- 172.21.15.2:0/4153944201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0af4107cf0 con 0x7f0afc108a90 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0af00095f0 tx=0x7f0af0009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff409853d6a2dc3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.310+0000 7f0ae27fc640 1 -- 172.21.15.2:0/763391880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0013d10 con 0x5640d426e070 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0ae27fc640 1 -- 172.21.15.2:0/763391880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af0013120 con 0x5640d426e070 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0ae27fc640 1 -- 172.21.15.2:0/763391880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0010670 con 0x5640d426e070 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 -- 172.21.15.2:0/763391880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 msgr2=0x5640d46132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0af00095f0 tx=0x7f0af0009770 comp rx=0 tx=0).stop 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b00e39640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 0x7f0ae40b7230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0af41050d0 tx=0x7f0af40b5040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 -- 172.21.15.2:0/763391880 shutdown_connections 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d4613d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d42451b0 0x5640d4613800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 --2- 172.21.15.2:0/763391880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d46132c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.311+0000 7f0b08e11740 1 -- 172.21.15.2:0/763391880 >> 172.21.15.2:0/763391880 conn(0x5640d4262460 msgr2=0x5640d46111b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.312+0000 7f0b08e11740 1 -- 172.21.15.2:0/763391880 shutdown_connections 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.312+0000 7f0b08e11740 1 -- 172.21.15.2:0/763391880 wait complete. 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.312+0000 7f0b08e11740 1 -- start start 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.312+0000 7f0b08e11740 1 Processor -- start 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.312+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d461ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d426e070 0x5640d462ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640d43dc700 con 0x5640d42451b0 2024-08-31T04:29:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5640d4500700 con 0x5640d424d390 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5640d4621a40 con 0x5640d426e070 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 10 client.0 _ll_register_callbacks cb 0x5640d452fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55788/0 (socket says 172.21.15.2:55788) 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afb7fe640 1 -- 172.21.15.2:0/2012753749 learned_addr learned my addr 172.21.15.2:0/2012753749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d461ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d426e070 0x5640d462ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 -- 172.21.15.2:0/2012753749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d426e070 msgr2=0x5640d462ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d426e070 0x5640d462ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 -- 172.21.15.2:0/2012753749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 msgr2=0x5640d461e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 -- 172.21.15.2:0/2012753749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d45398b0 con 0x5640d424d390 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d461ef10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00bfd0 tx=0x7f0aec011c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5582b03c17f703a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0adb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec010c60 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.313+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af0013120 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0aec010e00 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0aec025050 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 10 client.26003 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640d462d7a0 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af0013120 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0aec00f4c0 con 0x5640d424d390 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 10 client.26003 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 10 client.26003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 20 client.26003 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d422c9f0 0x5640d4630cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 4 client.26003 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640d458c580 con 0x5640d422c9f0 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.314+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d422c9f0 0x5640d4630cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.315+0000 7f0adb7fe640 10 client.26003 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.315+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d422c9f0 0x5640d4630cc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453927284190172a server_cookie=827c4ac55232bd55 in_seq=0 out_seq=0 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.315+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2012753749 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640d458c580 con 0x5640d422c9f0 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.315+0000 7f0adb7fe640 10 client.26003 handle_command_reply: tid=0 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 client.26003 shutdown 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 msgr2=0x5640d461ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d461ef10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00bfd0 tx=0x7f0aec011c90 comp rx=0 tx=0).stop 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 shutdown_connections 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d422c9f0 0x5640d4630cc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d426e070 0x5640d462ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d461ef10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0adb7fe640 0 client.26003 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2012753749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d461e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 >> 172.21.15.2:0/2012753749 conn(0x5640d4262460 msgr2=0x5640d46164a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 shutdown_connections 2024-08-31T04:29:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 1 -- 172.21.15.2:0/2012753749 wait complete. 2024-08-31T04:29:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.316+0000 7f0b08e11740 20 client.26003 trim_cache size 0 max 16384 2024-08-31T04:29:58.324 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:29:58.324 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:57 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.325 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:57 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.333+0000 7f0b08e11740 1 Processor -- start 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 -- start start 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d4620600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d461bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d426e070 0x5640d461c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1b1590 con 0x5640d42451b0 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1aee60 con 0x5640d426e070 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0b08e11740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1accb0 con 0x5640d424d390 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d4620600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d4620600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55798/0 (socket says 172.21.15.2:55798) 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afb7fe640 1 -- 172.21.15.2:0/980010221 learned_addr learned my addr 172.21.15.2:0/980010221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d461bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d426e070 0x5640d461c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 -- 172.21.15.2:0/980010221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d426e070 msgr2=0x5640d461c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d426e070 0x5640d461c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 -- 172.21.15.2:0/980010221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 msgr2=0x5640d4620600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d4620600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.334+0000 7f0afbfff640 1 -- 172.21.15.2:0/980010221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d4616120 con 0x5640d424d390 2024-08-31T04:29:58.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0afbfff640 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d461bbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00b6c0 tx=0x7f0aec0114a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655fdc675b801b00 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0ae1ffb640 1 -- 172.21.15.2:0/980010221 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00fe60 con 0x5640d424d390 2024-08-31T04:29:58.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0ae1ffb640 1 -- 172.21.15.2:0/980010221 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aec02e070 con 0x5640d424d390 2024-08-31T04:29:58.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0ae1ffb640 1 -- 172.21.15.2:0/980010221 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec005390 con 0x5640d424d390 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0b08e11740 1 -- 172.21.15.2:0/980010221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 msgr2=0x5640d461bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.335+0000 7f0b08e11740 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d461bbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00b6c0 tx=0x7f0aec0114a0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 -- 172.21.15.2:0/980010221 shutdown_connections 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d426e070 0x5640d461c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d424d390 0x5640d461bbc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 --2- 172.21.15.2:0/980010221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d42451b0 0x5640d4620600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 -- 172.21.15.2:0/980010221 >> 172.21.15.2:0/980010221 conn(0x5640d4262460 msgr2=0x5640d461fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 -- 172.21.15.2:0/980010221 shutdown_connections 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 -- 172.21.15.2:0/980010221 wait complete. 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 -- start start 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.336+0000 7f0b08e11740 1 Processor -- start 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d42451b0 0x5640d4625540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d4625b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1ad320 con 0x5640d426e070 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1ae790 con 0x5640d424d390 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1ad9f0 con 0x5640d42451b0 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 10 client.0 _ll_register_callbacks cb 0x7f0aec00bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d4625b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55812/0 (socket says 172.21.15.2:55812) 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 -- 172.21.15.2:0/2083620778 learned_addr learned my addr 172.21.15.2:0/2083620778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d42451b0 0x5640d4625540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 -- 172.21.15.2:0/2083620778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d42451b0 msgr2=0x5640d4625540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d42451b0 0x5640d4625540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 -- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 msgr2=0x5640d4625b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d4625b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 -- 172.21.15.2:0/2083620778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d4694cd0 con 0x5640d426e070 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0afb7fe640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0af0013790 tx=0x7f0af0016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5e913475a74c49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0adb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0025020 con 0x5640d426e070 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0af0005360 con 0x5640d426e070 2024-08-31T04:29:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.337+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aec02e070 con 0x5640d426e070 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0af003f050 con 0x5640d426e070 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 10 client.16290 fetch_fsmap learned FSMap version 28 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640d469bfe0 con 0x5640d426e070 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aec02e070 con 0x5640d426e070 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0af0036030 con 0x5640d426e070 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 10 client.16290 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 20 client.16290 populate_metadata read hostname 'smithi002' 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d4201da0 0x5640d469e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 4 client.16290 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640d4588020 con 0x5640d4201da0 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.338+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d4201da0 0x5640d469e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0adb7fe640 10 client.16290 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0afbfff640 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d4201da0 0x5640d469e460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df416f6004ec08e4 server_cookie=a5860fed72e9da21 in_seq=0 out_seq=0 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0adb7fe640 1 -- 172.21.15.2:0/2083620778 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x5640d4588020 con 0x5640d4201da0 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0adb7fe640 10 client.16290 handle_command_reply: tid=0 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 client.16290 shutdown 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 msgr2=0x5640d4694660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0af0013790 tx=0x7f0af0016040 comp rx=0 tx=0).stop 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 shutdown_connections 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5640d4201da0 0x5640d469e460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0adb7fe640 0 client.16290 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640d426e070 0x5640d4694660 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640d424d390 0x5640d4625b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 --2- 172.21.15.2:0/2083620778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5640d42451b0 0x5640d4625540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 >> 172.21.15.2:0/2083620778 conn(0x5640d4262460 msgr2=0x5640d461fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.339+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 shutdown_connections 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b08e11740 1 -- 172.21.15.2:0/2083620778 wait complete. 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b08e11740 20 client.16290 trim_cache size 0 max 16384 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d", 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:29:58.346 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.347 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:29:58.348 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:29:58.350 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 msgr2=0x7f0ae40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 0x7f0ae40b7230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0af41050d0 tx=0x7f0af40b5040 comp rx=0 tx=0).stop 2024-08-31T04:29:58.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 msgr2=0x7f0afc19ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc19ea40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0af402ade0 tx=0x7f0af40316f0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 shutdown_connections 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0ae40b4d20 0x7f0ae40b7230 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0afc108a90 0x7f0afc19ea40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0afc108140 0x7f0afc1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 --2- 172.21.15.2:0/4153944201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0afc102800 0x7f0afc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 >> 172.21.15.2:0/4153944201 conn(0x7f0afc0794d0 msgr2=0x7f0afc1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 shutdown_connections 2024-08-31T04:29:58.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:29:58.340+0000 7f0b0289c640 1 -- 172.21.15.2:0/4153944201 wait complete. 2024-08-31T04:29:58.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 408820 13.00 MB/sec execute 78 sec latency 26.342 ms 2024-08-31T04:29:59.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:29:58 smithi064 ceph-mon[22007]: pgmap v475: 129 pgs: 129 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-08-31T04:29:59.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:29:58 smithi002 ceph-mon[18656]: pgmap v475: 129 pgs: 129 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-08-31T04:29:59.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:29:58 smithi132 ceph-mon[22335]: pgmap v475: 129 pgs: 129 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-08-31T04:29:59.344 INFO:tasks.cephfs.filesystem:scrub status for tag:d91ddbc8-0266-4a94-ba7d-bb4c64cee66d - {'path': '/', 'tag': 'd91ddbc8-0266-4a94-ba7d-bb4c64cee66d', 'options': 'recursive,force'} 2024-08-31T04:29:59.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 411770 13.07 MB/sec execute 79 sec latency 18.672 ms 2024-08-31T04:30:00.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 414465 13.06 MB/sec execute 80 sec latency 27.292 ms 2024-08-31T04:30:01.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:00 smithi064 ceph-mon[22007]: pgmap v476: 129 pgs: 129 active+clean; 242 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-08-31T04:30:01.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:00 smithi064 ceph-mon[22007]: overall HEALTH_OK 2024-08-31T04:30:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:00 smithi132 ceph-mon[22335]: pgmap v476: 129 pgs: 129 active+clean; 242 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-08-31T04:30:01.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:00 smithi132 ceph-mon[22335]: overall HEALTH_OK 2024-08-31T04:30:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:00 smithi002 ceph-mon[18656]: pgmap v476: 129 pgs: 129 active+clean; 242 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-08-31T04:30:01.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:00 smithi002 ceph-mon[18656]: overall HEALTH_OK 2024-08-31T04:30:01.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 415229 12.97 MB/sec execute 81 sec latency 65.960 ms 2024-08-31T04:30:02.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:01 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:02.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:01 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:02.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:01 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:02.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 416465 12.89 MB/sec execute 82 sec latency 58.801 ms 2024-08-31T04:30:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: pgmap v477: 129 pgs: 129 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T04:30:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:30:03.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:30:03.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:02 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: pgmap v477: 129 pgs: 129 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:30:03.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:02 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: pgmap v477: 129 pgs: 129 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:30:03.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:02 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:30:03.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 419025 12.90 MB/sec execute 83 sec latency 12.175 ms 2024-08-31T04:30:04.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:03 smithi064 ceph-mon[22007]: pgmap v478: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:30:04.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:03 smithi132 ceph-mon[22335]: pgmap v478: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:30:04.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:03 smithi002 ceph-mon[18656]: pgmap v478: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:30:04.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 421939 12.92 MB/sec execute 84 sec latency 24.101 ms 2024-08-31T04:30:05.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 424461 12.90 MB/sec execute 85 sec latency 27.272 ms 2024-08-31T04:30:06.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:06 smithi064 ceph-mon[22007]: pgmap v479: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-08-31T04:30:06.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:06 smithi132 ceph-mon[22335]: pgmap v479: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-08-31T04:30:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:06 smithi002 ceph-mon[18656]: pgmap v479: 129 pgs: 129 active+clean; 246 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-08-31T04:30:06.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 426237 12.90 MB/sec execute 86 sec latency 73.140 ms 2024-08-31T04:30:07.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 428684 12.89 MB/sec execute 87 sec latency 73.521 ms 2024-08-31T04:30:08.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:08 smithi064 ceph-mon[22007]: pgmap v480: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 333 op/s 2024-08-31T04:30:08.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:08 smithi132 ceph-mon[22335]: pgmap v480: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 333 op/s 2024-08-31T04:30:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:08 smithi002 ceph-mon[18656]: pgmap v480: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 333 op/s 2024-08-31T04:30:08.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.88 MB/sec execute 88 sec latency 73.859 ms 2024-08-31T04:30:09.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.73 MB/sec execute 89 sec latency 1073.958 ms 2024-08-31T04:30:10.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:10 smithi064 ceph-mon[22007]: pgmap v481: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-08-31T04:30:10.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:10 smithi132 ceph-mon[22335]: pgmap v481: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-08-31T04:30:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:10 smithi002 ceph-mon[18656]: pgmap v481: 129 pgs: 129 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-08-31T04:30:10.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.59 MB/sec execute 90 sec latency 2074.068 ms 2024-08-31T04:30:11.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.45 MB/sec execute 91 sec latency 3074.167 ms 2024-08-31T04:30:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:12 smithi064 ceph-mon[22007]: pgmap v482: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-08-31T04:30:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:12 smithi132 ceph-mon[22335]: pgmap v482: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-08-31T04:30:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:12 smithi002 ceph-mon[18656]: pgmap v482: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-08-31T04:30:12.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.32 MB/sec execute 92 sec latency 4074.216 ms 2024-08-31T04:30:13.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 430607 12.18 MB/sec execute 93 sec latency 5074.268 ms 2024-08-31T04:30:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:14 smithi064 ceph-mon[22007]: pgmap v483: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:30:14.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:14 smithi132 ceph-mon[22335]: pgmap v483: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:30:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:14 smithi002 ceph-mon[18656]: pgmap v483: 129 pgs: 129 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:30:14.671 INFO:tasks.workunit.client.0.smithi002.stdout: 1 432886 12.19 MB/sec execute 94 sec latency 5171.571 ms 2024-08-31T04:30:15.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 434627 12.13 MB/sec execute 95 sec latency 35.069 ms 2024-08-31T04:30:16.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:16 smithi064 ceph-mon[22007]: pgmap v484: 129 pgs: 129 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 224 op/s 2024-08-31T04:30:16.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:16 smithi132 ceph-mon[22335]: pgmap v484: 129 pgs: 129 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 224 op/s 2024-08-31T04:30:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:16 smithi002 ceph-mon[18656]: pgmap v484: 129 pgs: 129 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 224 op/s 2024-08-31T04:30:16.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 436697 12.15 MB/sec execute 96 sec latency 97.403 ms 2024-08-31T04:30:17.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 438454 12.08 MB/sec execute 97 sec latency 44.065 ms 2024-08-31T04:30:18.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:18 smithi064 ceph-mon[22007]: pgmap v485: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 229 op/s 2024-08-31T04:30:18.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:18 smithi132 ceph-mon[22335]: pgmap v485: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 229 op/s 2024-08-31T04:30:18.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:18 smithi002 ceph-mon[18656]: pgmap v485: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 229 op/s 2024-08-31T04:30:18.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 440646 12.10 MB/sec execute 98 sec latency 26.755 ms 2024-08-31T04:30:19.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 443392 12.15 MB/sec execute 99 sec latency 26.934 ms 2024-08-31T04:30:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:20 smithi064 ceph-mon[22007]: pgmap v486: 129 pgs: 129 active+clean; 269 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-08-31T04:30:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:20 smithi132 ceph-mon[22335]: pgmap v486: 129 pgs: 129 active+clean; 269 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-08-31T04:30:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:20 smithi002 ceph-mon[18656]: pgmap v486: 129 pgs: 129 active+clean; 269 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-08-31T04:30:20.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 445183 12.10 MB/sec execute 100 sec latency 30.824 ms 2024-08-31T04:30:21.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 447322 12.12 MB/sec execute 101 sec latency 85.730 ms 2024-08-31T04:30:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:22 smithi064 ceph-mon[22007]: pgmap v487: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 173 op/s 2024-08-31T04:30:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:22 smithi132 ceph-mon[22335]: pgmap v487: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 173 op/s 2024-08-31T04:30:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:22 smithi002 ceph-mon[18656]: pgmap v487: 129 pgs: 129 active+clean; 270 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 173 op/s 2024-08-31T04:30:22.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 449316 12.07 MB/sec execute 102 sec latency 31.085 ms 2024-08-31T04:30:23.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 451302 12.07 MB/sec execute 103 sec latency 26.973 ms 2024-08-31T04:30:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:24 smithi064 ceph-mon[22007]: pgmap v488: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 209 op/s 2024-08-31T04:30:24.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:24 smithi132 ceph-mon[22335]: pgmap v488: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 209 op/s 2024-08-31T04:30:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:24 smithi002 ceph-mon[18656]: pgmap v488: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 209 op/s 2024-08-31T04:30:24.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 453869 12.09 MB/sec execute 104 sec latency 24.466 ms 2024-08-31T04:30:25.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 455697 12.07 MB/sec execute 105 sec latency 36.385 ms 2024-08-31T04:30:26.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:26 smithi064 ceph-mon[22007]: pgmap v489: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2024-08-31T04:30:26.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:26 smithi132 ceph-mon[22335]: pgmap v489: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2024-08-31T04:30:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:26 smithi002 ceph-mon[18656]: pgmap v489: 129 pgs: 129 active+clean; 276 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2024-08-31T04:30:26.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 457846 12.08 MB/sec execute 106 sec latency 61.330 ms 2024-08-31T04:30:27.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 458813 12.13 MB/sec execute 107 sec latency 88.605 ms 2024-08-31T04:30:28.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:28 smithi064 ceph-mon[22007]: pgmap v490: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 251 op/s 2024-08-31T04:30:28.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:28 smithi132 ceph-mon[22335]: pgmap v490: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 251 op/s 2024-08-31T04:30:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:28 smithi002 ceph-mon[18656]: pgmap v490: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 251 op/s 2024-08-31T04:30:28.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 461283 12.17 MB/sec execute 108 sec latency 15.788 ms 2024-08-31T04:30:29.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:30:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:29.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 463422 12.17 MB/sec execute 109 sec latency 29.270 ms 2024-08-31T04:30:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 -- 172.21.15.2:0/1268789226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 msgr2=0x7fd780110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 --2- 172.21.15.2:0/1268789226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd780110210 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd778009ca0 tx=0x7fd77802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 -- 172.21.15.2:0/1268789226 shutdown_connections 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 --2- 172.21.15.2:0/1268789226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd780110210 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 --2- 172.21.15.2:0/1268789226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd7801094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 --2- 172.21.15.2:0/1268789226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd780103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 -- 172.21.15.2:0/1268789226 >> 172.21.15.2:0/1268789226 conn(0x7fd7800ff1a0 msgr2=0x7fd7801015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 -- 172.21.15.2:0/1268789226 shutdown_connections 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.308+0000 7fd785b9e640 1 -- 172.21.15.2:0/1268789226 wait complete. 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 Processor -- start 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 -- start start 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd78019c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd78019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd7801a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801136b0 con 0x7fd7801099e0 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd780113530 con 0x7fd780109090 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd785b9e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd780113830 con 0x7fd780103750 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd7801a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd78019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd784b9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd78019c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd7801a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53918/0 (socket says 172.21.15.2:53918) 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.309+0000 7fd78539d640 1 -- 172.21.15.2:0/2429427255 learned_addr learned my addr 172.21.15.2:0/2429427255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 -- 172.21.15.2:0/2429427255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 msgr2=0x7fd78019c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd78019c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 -- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 msgr2=0x7fd7801a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd7801a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 -- 172.21.15.2:0/2429427255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7801a21b0 con 0x7fd780109090 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd784b9c640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd78019c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77ffff640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd78019c7e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd78006a5e0 tx=0x7fd76c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77dffb640 1 -- 172.21.15.2:0/2429427255 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00cc40 con 0x7fd780109090 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7801a24a0 con 0x7fd780109090 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77dffb640 1 -- 172.21.15.2:0/2429427255 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd76c00cde0 con 0x7fd780109090 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd77dffb640 1 -- 172.21.15.2:0/2429427255 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c018760 con 0x7fd780109090 2024-08-31T04:30:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.310+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7801a8c00 con 0x7fd780109090 2024-08-31T04:30:30.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd77dffb640 1 -- 172.21.15.2:0/2429427255 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd76c018900 con 0x7fd780109090 2024-08-31T04:30:30.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 Processor -- start 2024-08-31T04:30:30.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 -- start start 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d1801599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd93390 0x55d180159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1800d0630 con 0x55d17fdb4070 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d1800bfbc0 con 0x55d17fd8b1b0 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.313+0000 7fd78d375740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d1800c3b70 con 0x55d17fd93390 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53922/0 (socket says 172.21.15.2:53922) 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 -- 172.21.15.2:0/2117873154 learned_addr learned my addr 172.21.15.2:0/2117873154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd77ffff640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd93390 0x55d180159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd784b9c640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d1801599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd77dffb640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 0x7fd7700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 -- 172.21.15.2:0/2117873154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd93390 msgr2=0x55d180159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd93390 0x55d180159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 -- 172.21.15.2:0/2117873154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 msgr2=0x55d1801599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d1801599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 -- 172.21.15.2:0/2117873154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17fe1f650 con 0x55d17fdb4070 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd784b9c640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d1801599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 0x7fd7700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd77dffb640 1 -- 172.21.15.2:0/2429427255 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd76c0e5ca0 con 0x7fd780109090 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.314+0000 7fd78539d640 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd77802f4c0 tx=0x7fd778009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7605278ec0c0b32 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.315+0000 7fd76affd640 1 -- 172.21.15.2:0/2117873154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778042040 con 0x55d17fdb4070 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.315+0000 7fd78539d640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 0x7fd7700b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd77804d000 tx=0x7fd77804e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.315+0000 7fd76affd640 1 -- 172.21.15.2:0/2117873154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd778036070 con 0x55d17fdb4070 2024-08-31T04:30:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.315+0000 7fd76affd640 1 -- 172.21.15.2:0/2117873154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7780047c0 con 0x55d17fdb4070 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 -- 172.21.15.2:0/2117873154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 msgr2=0x55d180159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd77802f4c0 tx=0x7fd778009820 comp rx=0 tx=0).stop 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 -- 172.21.15.2:0/2117873154 shutdown_connections 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd93390 0x55d180159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d1801599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 --2- 172.21.15.2:0/2117873154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180159460 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 -- 172.21.15.2:0/2117873154 >> 172.21.15.2:0/2117873154 conn(0x55d17fda8460 msgr2=0x55d180157350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 -- 172.21.15.2:0/2117873154 shutdown_connections 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.316+0000 7fd78d375740 1 -- 172.21.15.2:0/2117873154 wait complete. 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 -- start start 2024-08-31T04:30:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 Processor -- start 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d18016dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d17ff22700 con 0x55d17fd93390 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d180046700 con 0x55d17fd8b1b0 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d180167c40 con 0x55d17fdb4070 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.317+0000 7fd78d375740 10 client.0 _ll_register_callbacks cb 0x55d180075dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd78539d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd784b9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d18016dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53938/0 (socket says 172.21.15.2:53938) 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 -- 172.21.15.2:0/3499464749 learned_addr learned my addr 172.21.15.2:0/3499464749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd78539d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46728/0 (socket says 172.21.15.2:46728) 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 -- 172.21.15.2:0/3499464749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 msgr2=0x55d180173330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 -- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 msgr2=0x55d18016dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d18016dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 -- 172.21.15.2:0/3499464749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d18007f8b0 con 0x55d17fd93390 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d18016dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd78539d640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0a80a0 tx=0x7fd76c010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1932123767cc060a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd75ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.318+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0ab790 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd76c0ab280 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd778036070 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76c0abb30 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 10 client.16302 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d18017c2e0 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd778036070 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fd76c0a7990 con 0x55d17fd93390 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 10 client.16302 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 20 client.16302 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd729f0 0x55d18017f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 4 client.16302 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1800d2580 con 0x55d17fd729f0 2024-08-31T04:30:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.319+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd729f0 0x55d18017f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.320+0000 7fd75ffff640 10 client.16302 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.320+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd729f0 0x55d18017f7a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304a28bbe848af2d server_cookie=c676617172189b5f in_seq=0 out_seq=0 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd75ffff640 1 -- 172.21.15.2:0/3499464749 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1800d2580 con 0x55d17fd729f0 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd75ffff640 10 client.16302 handle_command_reply: tid=0 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 client.16302 shutdown 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 msgr2=0x55d18016e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0a80a0 tx=0x7fd76c010e30 comp rx=0 tx=0).stop 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 shutdown_connections 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd729f0 0x55d18017f7a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd75ffff640 0 client.16302 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fd93390 0x55d18016e310 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fdb4070 0x55d180173330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 --2- 172.21.15.2:0/3499464749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd8b1b0 0x55d18016dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 >> 172.21.15.2:0/3499464749 conn(0x55d17fda8460 msgr2=0x55d18015c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 shutdown_connections 2024-08-31T04:30:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 1 -- 172.21.15.2:0/3499464749 wait complete. 2024-08-31T04:30:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.321+0000 7fd78d375740 20 client.16302 trim_cache size 0 max 16384 2024-08-31T04:30:30.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.342+0000 7fd78d375740 1 Processor -- start 2024-08-31T04:30:30.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 -- start start 2024-08-31T04:30:30.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d1801692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d18015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801b1370 con 0x55d17fdb4070 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801aec10 con 0x55d17fd93390 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78d375740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801aca80 con 0x55d17fd8b1b0 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53952/0 (socket says 172.21.15.2:53952) 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 -- 172.21.15.2:0/3744171484 learned_addr learned my addr 172.21.15.2:0/3744171484 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d18015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d1801692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 -- 172.21.15.2:0/3744171484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 msgr2=0x55d1801692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d1801692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 -- 172.21.15.2:0/3744171484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 msgr2=0x55d18015cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d18015cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd78539d640 1 -- 172.21.15.2:0/3744171484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d18015b980 con 0x55d17fdb4070 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.343+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d18015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.344+0000 7fd78539d640 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd778006010 tx=0x7fd77802f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb11f482e36ec9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.344+0000 7fd76a7fc640 1 -- 172.21.15.2:0/3744171484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778059070 con 0x55d17fdb4070 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.344+0000 7fd76a7fc640 1 -- 172.21.15.2:0/3744171484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd778036070 con 0x55d17fdb4070 2024-08-31T04:30:30.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.344+0000 7fd76a7fc640 1 -- 172.21.15.2:0/3744171484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778042040 con 0x55d17fdb4070 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 -- 172.21.15.2:0/3744171484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 msgr2=0x55d180166f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd778006010 tx=0x7fd77802f530 comp rx=0 tx=0).stop 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 -- 172.21.15.2:0/3744171484 shutdown_connections 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180166f60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d18015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 --2- 172.21.15.2:0/3744171484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d1801692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 -- 172.21.15.2:0/3744171484 >> 172.21.15.2:0/3744171484 conn(0x55d17fda8460 msgr2=0x55d18015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 -- 172.21.15.2:0/3744171484 shutdown_connections 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.345+0000 7fd78d375740 1 -- 172.21.15.2:0/3744171484 wait complete. 2024-08-31T04:30:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.346+0000 7fd78d375740 1 -- start start 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.346+0000 7fd78d375740 1 Processor -- start 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.346+0000 7fd78d375740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.346+0000 7fd78d375740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78d375740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180178fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd784b9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47884/0 (socket says 172.21.15.2:47884) 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd784b9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46740/0 (socket says 172.21.15.2:46740) 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 -- 172.21.15.2:0/3967214808 learned_addr learned my addr 172.21.15.2:0/3967214808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801ad0d0 con 0x55d17fdb4070 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801ae540 con 0x55d17fd93390 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801ad7a0 con 0x55d17fd8b1b0 2024-08-31T04:30:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78d375740 10 client.0 _ll_register_callbacks cb 0x7fd76c0e94e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78539d640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180178fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 -- 172.21.15.2:0/3967214808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 msgr2=0x55d180173f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 -- 172.21.15.2:0/3967214808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 msgr2=0x55d180178fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180178fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d180179520 con 0x55d17fd93390 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd78539d640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180178fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd77ffff640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0a7920 tx=0x7fd76c0ab6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b88f3a78a82498 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.347+0000 7fd75ffff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0c5060 con 0x55d17fd93390 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd76c0971a0 con 0x55d17fd93390 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd778036070 con 0x55d17fd93390 2024-08-31T04:30:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76c0a7ee0 con 0x55d17fd93390 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 10 client.26027 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d1801ea120 con 0x55d17fd93390 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd778036070 con 0x55d17fd93390 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fd76c0b1970 con 0x55d17fd93390 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 10 client.26027 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 10 client.26027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 20 client.26027 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd47da0 0x55d1801ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 4 client.26027 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.348+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1800ce020 con 0x55d17fd47da0 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd47da0 0x55d1801ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd75ffff640 10 client.26027 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd784b9c640 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd47da0 0x55d1801ec8e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b17ee7173f054ef server_cookie=b57f4dc61b9b9498 in_seq=0 out_seq=0 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd75ffff640 1 -- 172.21.15.2:0/3967214808 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55d1800ce020 con 0x55d17fd47da0 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd75ffff640 10 client.26027 handle_command_reply: tid=0 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.349+0000 7fd78d375740 1 client.26027 shutdown 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 msgr2=0x55d1801744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0a7920 tx=0x7fd76c0ab6e0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 shutdown_connections 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d17fd47da0 0x55d1801ec8e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d17fdb4070 0x55d180178fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d17fd93390 0x55d1801744d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd75ffff640 0 client.26027 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 --2- 172.21.15.2:0/3967214808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d17fd8b1b0 0x55d180173f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 >> 172.21.15.2:0/3967214808 conn(0x55d17fda8460 msgr2=0x55d18015abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 shutdown_connections 2024-08-31T04:30:30.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 1 -- 172.21.15.2:0/3967214808 wait complete. 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.350+0000 7fd78d375740 20 client.26027 trim_cache size 0 max 16384 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.357 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:30:30.359 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:30:30.361 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:30:30.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 msgr2=0x7fd7700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 0x7fd7700b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd77804d000 tx=0x7fd77804e000 comp rx=0 tx=0).stop 2024-08-31T04:30:30.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 msgr2=0x7fd78019c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:30.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd78019c7e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd78006a5e0 tx=0x7fd76c00ee50 comp rx=0 tx=0).stop 2024-08-31T04:30:30.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 shutdown_connections 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd7700b4ca0 0x7fd7700b71b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7801099e0 0x7fd7801a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd780109090 0x7fd78019c7e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 --2- 172.21.15.2:0/2429427255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780103750 0x7fd78019c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 >> 172.21.15.2:0/2429427255 conn(0x7fd7800ff1a0 msgr2=0x7fd780106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 shutdown_connections 2024-08-31T04:30:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:30.351+0000 7fd785b9e640 1 -- 172.21.15.2:0/2429427255 wait complete. 2024-08-31T04:30:30.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:30 smithi002 ceph-mon[18656]: pgmap v491: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-08-31T04:30:30.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:30 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:30:30.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:30 smithi064 ceph-mon[22007]: pgmap v491: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-08-31T04:30:30.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:30 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:30:30.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:30 smithi132 ceph-mon[22335]: pgmap v491: 129 pgs: 129 active+clean; 281 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-08-31T04:30:30.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:30 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:30:30.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 465819 12.19 MB/sec execute 110 sec latency 47.486 ms 2024-08-31T04:30:31.385 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:30:31.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:30:31.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 467429 12.13 MB/sec execute 111 sec latency 110.929 ms 2024-08-31T04:30:31.694 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:32.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 -- 172.21.15.2:0/1495440944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 msgr2=0x7fa600110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 --2- 172.21.15.2:0/1495440944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa600110490 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009ca0 tx=0x7fa5f802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 -- 172.21.15.2:0/1495440944 shutdown_connections 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 --2- 172.21.15.2:0/1495440944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa600110490 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 --2- 172.21.15.2:0/1495440944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa600109310 0x7fa600109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 --2- 172.21.15.2:0/1495440944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6001039d0 0x7fa600103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.233+0000 7fa607405640 1 -- 172.21.15.2:0/1495440944 >> 172.21.15.2:0/1495440944 conn(0x7fa60007b670 msgr2=0x7fa60007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.234+0000 7fa607405640 1 -- 172.21.15.2:0/1495440944 shutdown_connections 2024-08-31T04:30:32.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.234+0000 7fa607405640 1 -- 172.21.15.2:0/1495440944 wait complete. 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 Processor -- start 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 -- start start 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa600109310 0x7fa60019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa60019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa600113880 con 0x7fa600109c60 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa6051a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa6059a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa60019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa6051a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46746/0 (socket says 172.21.15.2:46746) 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa6051a1640 1 -- 172.21.15.2:0/2154153946 learned_addr learned my addr 172.21.15.2:0/2154153946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa6049a0640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa600109310 0x7fa60019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:32.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa600113700 con 0x7fa600109310 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.235+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa600113a00 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 -- 172.21.15.2:0/2154153946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa600109310 msgr2=0x7fa60019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa600109310 0x7fa60019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 -- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 msgr2=0x7fa60019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa60019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6001a0200 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6059a2640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa60019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa6051a1640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9f0 tx=0x7fa5fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00cd80 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6001a04f0 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5fc0108e0 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc018980 con 0x7fa6001039d0 2024-08-31T04:30:32.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.236+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6001a6c50 con 0x7fa6001039d0 2024-08-31T04:30:32.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.237+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa600103de0 con 0x7fa6001039d0 2024-08-31T04:30:32.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.239+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa5fc010430 con 0x7fa6001039d0 2024-08-31T04:30:32.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.240+0000 7fa5f67fc640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 0x7fa5ec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:32.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.240+0000 7fa6049a0640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 0x7fa5ec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:32.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.240+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fa5fc0e5e10 con 0x7fa6001039d0 2024-08-31T04:30:32.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.241+0000 7fa6049a0640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 0x7fa5ec0b7230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa600109050 tx=0x7fa5f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:32.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.243+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa5fc0ac190 con 0x7fa6001039d0 2024-08-31T04:30:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.486+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60019b3c0 con 0x7fa6001039d0 2024-08-31T04:30:32.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:32 smithi002 ceph-mon[18656]: pgmap v492: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T04:30:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.487+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2154153946 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11898 (secure 0 0 0) 0x7fa5fc0b0950 con 0x7fa6001039d0 2024-08-31T04:30:32.489 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:30:32.489 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-08-31T04:30:29:275763+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:30:28.725461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:30:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-08-31T04:30:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 msgr2=0x7fa5ec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 0x7fa5ec0b7230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa600109050 tx=0x7fa5f0005f90 comp rx=0 tx=0).stop 2024-08-31T04:30:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 msgr2=0x7fa60019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9f0 tx=0x7fa5fc00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 shutdown_connections 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa5ec0b4d20 0x7fa5ec0b7230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa600109c60 0x7fa60019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa600109310 0x7fa60019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 --2- 172.21.15.2:0/2154153946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6001039d0 0x7fa60019a290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.489+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 >> 172.21.15.2:0/2154153946 conn(0x7fa60007b670 msgr2=0x7fa6001073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.490+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 shutdown_connections 2024-08-31T04:30:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:32.490+0000 7fa607405640 1 -- 172.21.15.2:0/2154153946 wait complete. 2024-08-31T04:30:32.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:32 smithi064 ceph-mon[22007]: pgmap v492: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T04:30:32.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:32 smithi132 ceph-mon[22335]: pgmap v492: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T04:30:32.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 469595 12.14 MB/sec execute 112 sec latency 22.702 ms 2024-08-31T04:30:33.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:30:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:33.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:33 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2154153946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:33.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:33 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2154153946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:33.573 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:33 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2154153946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:33.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 472009 12.14 MB/sec execute 113 sec latency 27.629 ms 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 -- 172.21.15.2:0/286325754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 msgr2=0x7f780410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 --2- 172.21.15.2:0/286325754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780410f340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009ca0 tx=0x7f77fc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 -- 172.21.15.2:0/286325754 shutdown_connections 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 --2- 172.21.15.2:0/286325754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780410f340 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 --2- 172.21.15.2:0/286325754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f78041085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 --2- 172.21.15.2:0/286325754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f7804102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 -- 172.21.15.2:0/286325754 >> 172.21.15.2:0/286325754 conn(0x7f7804079510 msgr2=0x7f7804079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 -- 172.21.15.2:0/286325754 shutdown_connections 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.954+0000 7f780a992640 1 -- 172.21.15.2:0/286325754 wait complete. 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.955+0000 7f780a992640 1 Processor -- start 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.955+0000 7f780a992640 1 -- start start 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f780419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78041127e0 con 0x7f7804108b10 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7804112660 con 0x7f78041081c0 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f780a992640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7804112960 con 0x7f7804102880 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47926/0 (socket says 172.21.15.2:47926) 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 -- 172.21.15.2:0/1773562119 learned_addr learned my addr 172.21.15.2:0/1773562119 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f7808f2f640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f7803fff640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f780419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 -- 172.21.15.2:0/1773562119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 msgr2=0x7f780419b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f780419b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 -- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 msgr2=0x7f780419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 -- 172.21.15.2:0/1773562119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78041a6300 con 0x7f78041081c0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f7803fff640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f780419b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.956+0000 7f78037fe640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77f800e9f0 tx=0x7f77f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.957+0000 7f78017fa640 1 -- 172.21.15.2:0/1773562119 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f800ccc0 con 0x7f78041081c0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.957+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78041a65f0 con 0x7f78041081c0 2024-08-31T04:30:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.957+0000 7f78017fa640 1 -- 172.21.15.2:0/1773562119 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f80108e0 con 0x7f78041081c0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.957+0000 7f78017fa640 1 -- 172.21.15.2:0/1773562119 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8018860 con 0x7f78041081c0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.957+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78041a6b80 con 0x7f78041081c0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.959+0000 7f7810f07740 1 Processor -- start 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 -- start start 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f78017fa640 1 -- 172.21.15.2:0/1773562119 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f77f8010430 con 0x7f78041081c0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1c3d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c3dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c3e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee1bb0680 con 0x55fee186b1b0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fee1b9fc10 con 0x55fee1873390 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7810f07740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fee1ba3bc0 con 0x55fee1894070 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7803fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c3dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7803fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c3dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54008/0 (socket says 172.21.15.2:54008) 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7803fff640 1 -- 172.21.15.2:0/2796106472 learned_addr learned my addr 172.21.15.2:0/2796106472 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f78037fe640 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c3e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7808f2f640 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1c3d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7808f2f640 1 -- 172.21.15.2:0/2796106472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 msgr2=0x55fee1c3e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7808f2f640 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c3e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7808f2f640 1 -- 172.21.15.2:0/2796106472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 msgr2=0x55fee1c3dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.960+0000 7f7808f2f640 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c3dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f7808f2f640 1 -- 172.21.15.2:0/2796106472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee18ff650 con 0x55fee1894070 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f7808f2f640 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1c3d720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005e30 tx=0x7f77fc02f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c70875aadcabe12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f78017fa640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 0x7f77ec0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f7803fff640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 0x7f77ec0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f77ea7fc640 1 -- 172.21.15.2:0/2796106472 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc031cf0 con 0x55fee1894070 2024-08-31T04:30:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f77ea7fc640 1 -- 172.21.15.2:0/2796106472 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77fc036030 con 0x55fee1894070 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f77ea7fc640 1 -- 172.21.15.2:0/2796106472 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc004040 con 0x55fee1894070 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.961+0000 7f78017fa640 1 -- 172.21.15.2:0/1773562119 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f77f80e5ca0 con 0x7f78041081c0 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- 172.21.15.2:0/2796106472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 msgr2=0x55fee1c3d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7803fff640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 0x7f77ec0b71e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55fee1c3c3a0 tx=0x7f77f4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1c3d720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005e30 tx=0x7f77fc02f410 comp rx=0 tx=0).stop 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- 172.21.15.2:0/2796106472 shutdown_connections 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c3dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c3e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 --2- 172.21.15.2:0/2796106472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1c3d720 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- 172.21.15.2:0/2796106472 >> 172.21.15.2:0/2796106472 conn(0x55fee1888460 msgr2=0x55fee1c3b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- 172.21.15.2:0/2796106472 shutdown_connections 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- 172.21.15.2:0/2796106472 wait complete. 2024-08-31T04:30:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.962+0000 7f7810f07740 1 -- start start 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 Processor -- start 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c493a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee1a02700 con 0x55fee1894070 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fee1b26750 con 0x55fee1873390 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fee1c4bd20 con 0x55fee186b1b0 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7810f07740 10 client.0 _ll_register_callbacks cb 0x55fee1b55e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7803fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f78037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7808f2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7803fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46794/0 (socket says 172.21.15.2:46794) 2024-08-31T04:30:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7803fff640 1 -- 172.21.15.2:0/2434270898 learned_addr learned my addr 172.21.15.2:0/2434270898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f7808f2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54018/0 (socket says 172.21.15.2:54018) 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.963+0000 7f78037fe640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47934/0 (socket says 172.21.15.2:47934) 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 -- 172.21.15.2:0/2434270898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 msgr2=0x55fee1c493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 -- 172.21.15.2:0/2434270898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 msgr2=0x55fee1c55010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 -- 172.21.15.2:0/2434270898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee1b5f900 con 0x55fee186b1b0 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7808f2f640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7803fff640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77f401fa00 tx=0x7f77f4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=367878eee4b5fd42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f77e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f401d620 con 0x55fee186b1b0 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f77f401d7c0 con 0x55fee186b1b0 2024-08-31T04:30:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77fc036030 con 0x55fee186b1b0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.964+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77f4034050 con 0x55fee186b1b0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 10 client.25894 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fee1c57b60 con 0x55fee186b1b0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77fc036030 con 0x55fee186b1b0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f77f4011a50 con 0x55fee186b1b0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 10 client.25894 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 10 client.25894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 20 client.25894 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee18529f0 0x55fee1c5b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 4 client.25894 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fee1bb25d0 con 0x55fee18529f0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.965+0000 7f78037fe640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee18529f0 0x55fee1c5b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.966+0000 7f77e37fe640 10 client.25894 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:30:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.966+0000 7f78037fe640 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee18529f0 0x55fee1c5b150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d07ebc559f059791 server_cookie=a17172edb89d73f1 in_seq=0 out_seq=0 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.966+0000 7f77e37fe640 1 -- 172.21.15.2:0/2434270898 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fee1bb25d0 con 0x55fee18529f0 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.966+0000 7f77e37fe640 10 client.25894 handle_command_reply: tid=0 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.966+0000 7f7810f07740 1 client.25894 shutdown 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 msgr2=0x55fee1c48e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77f401fa00 tx=0x7f77f4004730 comp rx=0 tx=0).stop 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 shutdown_connections 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee18529f0 0x55fee1c5b150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1894070 0x55fee1c55010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f77e37fe640 0 client.25894 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 --2- 172.21.15.2:0/2434270898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c48e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 >> 172.21.15.2:0/2434270898 conn(0x55fee1888460 msgr2=0x55fee1c408b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 shutdown_connections 2024-08-31T04:30:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 1 -- 172.21.15.2:0/2434270898 wait complete. 2024-08-31T04:30:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.967+0000 7f7810f07740 20 client.25894 trim_cache size 0 max 16384 2024-08-31T04:30:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 Processor -- start 2024-08-31T04:30:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 -- start start 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c3f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 0x55fee1c54f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78041b1530 con 0x55fee1873390 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78041aedd0 con 0x55fee1894070 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7810f07740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78041acc20 con 0x55fee186b1b0 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54022/0 (socket says 172.21.15.2:54022) 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 -- 172.21.15.2:0/3612222603 learned_addr learned my addr 172.21.15.2:0/3612222603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7808f2f640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 0x55fee1c54f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 -- 172.21.15.2:0/3612222603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 msgr2=0x55fee1c3f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7803fff640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c3f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c3f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 -- 172.21.15.2:0/3612222603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 msgr2=0x55fee1c54f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 0x55fee1c54f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f78037fe640 1 -- 172.21.15.2:0/3612222603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee1c4a120 con 0x55fee1873390 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.981+0000 7f7808f2f640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 0x55fee1c54f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.982+0000 7f78037fe640 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c6a0 tx=0x7f77f800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dcc9da191e3339 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.982+0000 7f77e9ffb640 1 -- 172.21.15.2:0/3612222603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8010720 con 0x55fee1873390 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.982+0000 7f77e9ffb640 1 -- 172.21.15.2:0/3612222603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f80aba80 con 0x55fee1873390 2024-08-31T04:30:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.982+0000 7f77e9ffb640 1 -- 172.21.15.2:0/3612222603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80e3250 con 0x55fee1873390 2024-08-31T04:30:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- 172.21.15.2:0/3612222603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 msgr2=0x55fee1c4aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c6a0 tx=0x7f77f800ce60 comp rx=0 tx=0).stop 2024-08-31T04:30:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- 172.21.15.2:0/3612222603 shutdown_connections 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1873390 0x55fee1c4aa90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1894070 0x55fee1c54f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 --2- 172.21.15.2:0/3612222603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee186b1b0 0x55fee1c3f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- 172.21.15.2:0/3612222603 >> 172.21.15.2:0/3612222603 conn(0x55fee1888460 msgr2=0x55fee1c4a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- 172.21.15.2:0/3612222603 shutdown_connections 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- 172.21.15.2:0/3612222603 wait complete. 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.983+0000 7f7810f07740 1 -- start start 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 Processor -- start 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1cc4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ad290 con 0x55fee186b1b0 2024-08-31T04:30:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ae700 con 0x55fee1873390 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ad960 con 0x55fee1894070 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7810f07740 10 client.0 _ll_register_callbacks cb 0x7f77f4009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7803fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f78037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f78037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47952/0 (socket says 172.21.15.2:47952) 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f78037fe640 1 -- 172.21.15.2:0/1275238256 learned_addr learned my addr 172.21.15.2:0/1275238256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7808f2f640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1cc4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7803fff640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54032/0 (socket says 172.21.15.2:54032) 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.984+0000 7f7803fff640 1 -- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 msgr2=0x55fee1cc4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7803fff640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1cc4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7803fff640 1 -- 172.21.15.2:0/1275238256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 msgr2=0x55fee1c4d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7803fff640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7803fff640 1 -- 172.21.15.2:0/1275238256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee1c4df60 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f78037fe640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7803fff640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012d50 tx=0x7f77f40116d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a820b3f555d883 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f77e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f403e030 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f77f4011ad0 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f80aba80 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77f4048050 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7810f07740 10 client.16332 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fee1cc6070 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.985+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f80aba80 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f77f4004930 con 0x55fee186b1b0 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 10 client.16332 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 10 client.16332 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:30:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 20 client.16332 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee1827da0 0x55fee1cc8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 4 client.16332 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fee1bae070 con 0x55fee1827da0 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.986+0000 7f78037fe640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee1827da0 0x55fee1cc8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f78037fe640 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee1827da0 0x55fee1cc8820 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2266fa5ea3e36167 server_cookie=c703f1198b871a80 in_seq=0 out_seq=0 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f77e37fe640 10 client.16332 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f77e37fe640 1 -- 172.21.15.2:0/1275238256 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fee1bae070 con 0x55fee1827da0 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f77e37fe640 10 client.16332 handle_command_reply: tid=0 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 client.16332 shutdown 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 msgr2=0x55fee1c4d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012d50 tx=0x7f77f40116d0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 shutdown_connections 2024-08-31T04:30:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55fee1827da0 0x55fee1cc8820 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fee1894070 0x55fee1cc4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fee1873390 0x55fee1c4d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 --2- 172.21.15.2:0/1275238256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee186b1b0 0x55fee1c4d1f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f77e37fe640 0 client.16332 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 >> 172.21.15.2:0/1275238256 conn(0x55fee1888460 msgr2=0x55fee1c3eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 shutdown_connections 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 1 -- 172.21.15.2:0/1275238256 wait complete. 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.987+0000 7f7810f07740 20 client.16332 trim_cache size 0 max 16384 2024-08-31T04:30:33.994 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 msgr2=0x7f77ec0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 0x7f77ec0b71e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55fee1c3c3a0 tx=0x7f77f4005f90 comp rx=0 tx=0).stop 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 msgr2=0x7f780419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77f800e9f0 tx=0x7f77f800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 shutdown_connections 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77ec0b4cd0 0x7f77ec0b71e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7804108b10 0x7f780419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78041081c0 0x7f780419b5b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 --2- 172.21.15.2:0/1773562119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7804102880 0x7f780419b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 >> 172.21.15.2:0/1773562119 conn(0x7f7804079510 msgr2=0x7f7804104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 shutdown_connections 2024-08-31T04:30:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:33.988+0000 7f780a992640 1 -- 172.21.15.2:0/1773562119 wait complete. 2024-08-31T04:30:34.557 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:34 smithi002 ceph-mon[18656]: pgmap v493: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-08-31T04:30:34.566 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:34 smithi064 ceph-mon[22007]: pgmap v493: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-08-31T04:30:34.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:34 smithi132 ceph-mon[22335]: pgmap v493: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-08-31T04:30:34.672 INFO:tasks.workunit.client.0.smithi002.stdout: 1 474188 12.14 MB/sec execute 114 sec latency 25.644 ms 2024-08-31T04:30:35.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:30:35.277 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:35.673 INFO:tasks.workunit.client.0.smithi002.stdout: 1 476633 12.16 MB/sec execute 115 sec latency 57.603 ms 2024-08-31T04:30:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 -- 172.21.15.2:0/2381370017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c10dbb0 msgr2=0x7f983c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 --2- 172.21.15.2:0/2381370017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c10dbb0 0x7f983c1100c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9834009ca0 tx=0x7f983402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 -- 172.21.15.2:0/2381370017 shutdown_connections 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 --2- 172.21.15.2:0/2381370017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c10dbb0 0x7f983c1100c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 --2- 172.21.15.2:0/2381370017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c105030 0x7f983c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 --2- 172.21.15.2:0/2381370017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 -- 172.21.15.2:0/2381370017 >> 172.21.15.2:0/2381370017 conn(0x7f983c0794e0 msgr2=0x7f983c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 -- 172.21.15.2:0/2381370017 shutdown_connections 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.811+0000 7f98423da640 1 -- 172.21.15.2:0/2381370017 wait complete. 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.812+0000 7f98423da640 1 Processor -- start 2024-08-31T04:30:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.812+0000 7f98423da640 1 -- start start 2024-08-31T04:30:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.812+0000 7f98423da640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f98423da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f98423da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 0x7f983c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f98423da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f983c113830 con 0x7f983c105030 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f98423da640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1136b0 con 0x7f983c104600 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f98423da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1139b0 con 0x7f983c10dbb0 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42174/0 (socket says 172.21.15.2:42174) 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 -- 172.21.15.2:0/965650629 learned_addr learned my addr 172.21.15.2:0/965650629 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f9840977640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 0x7f983c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 -- 172.21.15.2:0/965650629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 msgr2=0x7f983c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 0x7f983c19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 -- 172.21.15.2:0/965650629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 msgr2=0x7f983c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 -- 172.21.15.2:0/965650629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c1a01f0 con 0x7f983c105030 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f9840977640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 0x7f983c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983bfff640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.813+0000 7f983b7fe640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f983000e9f0 tx=0x7f983000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.814+0000 7f98397fa640 1 -- 172.21.15.2:0/965650629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000ccc0 con 0x7f983c105030 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.814+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983c1a04e0 con 0x7f983c105030 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.814+0000 7f98397fa640 1 -- 172.21.15.2:0/965650629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98300108e0 con 0x7f983c105030 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.814+0000 7f98397fa640 1 -- 172.21.15.2:0/965650629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830018860 con 0x7f983c105030 2024-08-31T04:30:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.814+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983c1a6c40 con 0x7f983c105030 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.816+0000 7f984894f740 1 Processor -- start 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 -- start start 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f98397fa640 1 -- 172.21.15.2:0/965650629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9830018a00 con 0x7f983c105030 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda26a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 0x55ddda26ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ddda1e1680 con 0x55ddd9ea4390 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ddda1d0c10 con 0x55ddd9ec5070 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f984894f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ddda1d4bc0 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54610/0 (socket says 172.21.15.2:54610) 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 -- 172.21.15.2:0/2279541862 learned_addr learned my addr 172.21.15.2:0/2279541862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f983b7fe640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 0x55ddda26ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f983bfff640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda26a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 -- 172.21.15.2:0/2279541862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 msgr2=0x55ddda26a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda26a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 -- 172.21.15.2:0/2279541862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 msgr2=0x55ddda26ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 0x55ddda26ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f9840977640 1 -- 172.21.15.2:0/2279541862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd9f30650 con 0x55ddd9ec5070 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.817+0000 7f983b7fe640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 0x55ddda26ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f98397fa640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 0x7f98240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f9840977640 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9834033040 tx=0x7f983402f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee541eaff008b57a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f983bfff640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 0x7f98240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f98397fa640 1 -- 172.21.15.2:0/965650629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f98300e5c10 con 0x7f983c105030 2024-08-31T04:30:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f98227fc640 1 -- 172.21.15.2:0/2279541862 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834031650 con 0x55ddd9ec5070 2024-08-31T04:30:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f98227fc640 1 -- 172.21.15.2:0/2279541862 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9834036040 con 0x55ddd9ec5070 2024-08-31T04:30:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.818+0000 7f98227fc640 1 -- 172.21.15.2:0/2279541862 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834004460 con 0x55ddd9ec5070 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 -- 172.21.15.2:0/2279541862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 msgr2=0x55ddda26a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f983bfff640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 0x7f98240b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ddda268f90 tx=0x7f982c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9834033040 tx=0x7f983402f310 comp rx=0 tx=0).stop 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 -- 172.21.15.2:0/2279541862 shutdown_connections 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ea4390 0x55ddda26ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda26a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 --2- 172.21.15.2:0/2279541862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ec5070 0x55ddda26a310 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 -- 172.21.15.2:0/2279541862 >> 172.21.15.2:0/2279541862 conn(0x55ddd9eb9460 msgr2=0x55ddda268200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 -- 172.21.15.2:0/2279541862 shutdown_connections 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.819+0000 7f984894f740 1 -- 172.21.15.2:0/2279541862 wait complete. 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 -- start start 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 Processor -- start 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 0x55ddda275ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ec5070 0x55ddda281c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ddda033700 con 0x55ddd9ec5070 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ddda157750 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.820+0000 7f984894f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ddda278910 con 0x55ddd9ea4390 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f984894f740 10 client.0 _ll_register_callbacks cb 0x55ddda186e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f9840977640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ec5070 0x55ddda281c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54626/0 (socket says 172.21.15.2:54626) 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 -- 172.21.15.2:0/1631005544 learned_addr learned my addr 172.21.15.2:0/1631005544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983b7fe640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 0x55ddda275ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 -- 172.21.15.2:0/1631005544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 msgr2=0x55ddda275ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 0x55ddda275ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 -- 172.21.15.2:0/1631005544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ec5070 msgr2=0x55ddda281c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ec5070 0x55ddda281c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 -- 172.21.15.2:0/1631005544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddda190900 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983b7fe640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 0x55ddda275ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f983bfff640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f982c009580 tx=0x7f982c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a056eacad6e009 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f981b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:30:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c00f830 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9834036040 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.821+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f982c00f9d0 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f982c00fbd0 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 10 client.26063 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ddda2847a0 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9834036040 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f982c027070 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 10 client.26063 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 10 client.26063 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 20 client.26063 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9e839f0 0x55ddda287d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 4 client.26063 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddda1e35d0 con 0x55ddd9e839f0 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.822+0000 7f983b7fe640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9e839f0 0x55ddda287d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.823+0000 7f981b7fe640 10 client.26063 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.823+0000 7f983b7fe640 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9e839f0 0x55ddda287d20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f6738034581538f server_cookie=13ea448122c6265e in_seq=0 out_seq=0 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.823+0000 7f981b7fe640 1 -- 172.21.15.2:0/1631005544 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddda1e35d0 con 0x55ddd9e839f0 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.823+0000 7f981b7fe640 10 client.26063 handle_command_reply: tid=0 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.823+0000 7f984894f740 1 client.26063 shutdown 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 msgr2=0x55ddda275ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f982c009580 tx=0x7f982c004730 comp rx=0 tx=0).stop 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 shutdown_connections 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9e839f0 0x55ddda287d20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9ec5070 0x55ddda281c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f981b7fe640 0 client.26063 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9ea4390 0x55ddda275ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 --2- 172.21.15.2:0/1631005544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9e9c1b0 0x55ddda275ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 >> 172.21.15.2:0/1631005544 conn(0x55ddd9eb9460 msgr2=0x55ddda26d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 shutdown_connections 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 1 -- 172.21.15.2:0/1631005544 wait complete. 2024-08-31T04:30:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.824+0000 7f984894f740 20 client.26063 trim_cache size 0 max 16384 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 Processor -- start 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 -- start start 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e839f0 0x55ddda26db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda282070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b3800 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b10a0 con 0x55ddd9ea4390 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f984894f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1aeef0 con 0x55ddd9e839f0 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.838+0000 7f983b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42196/0 (socket says 172.21.15.2:42196) 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 -- 172.21.15.2:0/42847070 learned_addr learned my addr 172.21.15.2:0/42847070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983bfff640 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e839f0 0x55ddda26db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f9840977640 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda282070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 -- 172.21.15.2:0/42847070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e839f0 msgr2=0x55ddda26db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e839f0 0x55ddda26db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 -- 172.21.15.2:0/42847070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 msgr2=0x55ddda282070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda282070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 -- 172.21.15.2:0/42847070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddda26d170 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f983b7fe640 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f98300a9200 tx=0x7f98300096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54f2e1b8d7ec154 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f9821ffb640 1 -- 172.21.15.2:0/42847070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300b5200 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f9821ffb640 1 -- 172.21.15.2:0/42847070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9830010a90 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.839+0000 7f9821ffb640 1 -- 172.21.15.2:0/42847070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300ab520 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.840+0000 7f984894f740 1 -- 172.21.15.2:0/42847070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 msgr2=0x55ddda281b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f98300a9200 tx=0x7f98300096a0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 -- 172.21.15.2:0/42847070 shutdown_connections 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e9c1b0 0x55ddda281b30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda282070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 --2- 172.21.15.2:0/42847070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e839f0 0x55ddda26db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 -- 172.21.15.2:0/42847070 >> 172.21.15.2:0/42847070 conn(0x55ddd9eb9460 msgr2=0x55ddda26d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 -- 172.21.15.2:0/42847070 shutdown_connections 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 -- 172.21.15.2:0/42847070 wait complete. 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 -- start start 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.841+0000 7f984894f740 1 Processor -- start 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda27a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda2f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f983bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f983bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42208/0 (socket says 172.21.15.2:42208) 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f983bfff640 1 -- 172.21.15.2:0/3481613241 learned_addr learned my addr 172.21.15.2:0/3481613241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f983b7fe640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda27a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1af560 con 0x55ddd9e839f0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b09d0 con 0x55ddd9ea4390 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1afc30 con 0x55ddd9e9c1b0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f9840977640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda2f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.842+0000 7f984894f740 10 client.0 _ll_register_callbacks cb 0x7f982c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 -- 172.21.15.2:0/3481613241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 msgr2=0x55ddda27a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda27a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 -- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 msgr2=0x55ddda2f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda2f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddda2f1d20 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f983bfff640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c00fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a890a73ac0e45b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f981b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c03b020 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9830010a90 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f982c01fde0 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f982c046050 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f984894f740 10 client.16350 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.843+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ddda2f2f80 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9830010a90 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f982c027040 con 0x55ddd9e839f0 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 10 client.16350 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 10 client.16350 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:30:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 20 client.16350 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9ec5070 0x55ddda2f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 4 client.16350 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:30:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddda1df070 con 0x55ddd9ec5070 2024-08-31T04:30:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.844+0000 7f983b7fe640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9ec5070 0x55ddda2f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f981b7fe640 10 client.16350 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:30:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f983b7fe640 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9ec5070 0x55ddda2f57c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e11a9969ae350e08 server_cookie=df39daf221c6d710 in_seq=0 out_seq=0 2024-08-31T04:30:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f981b7fe640 1 -- 172.21.15.2:0/3481613241 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddda1df070 con 0x55ddd9ec5070 2024-08-31T04:30:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f981b7fe640 10 client.16350 handle_command_reply: tid=0 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 client.16350 shutdown 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 msgr2=0x55ddda27a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c00fb40 comp rx=0 tx=0).stop 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 shutdown_connections 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ddd9ea4390 0x55ddda2f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddd9e9c1b0 0x55ddda27a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55ddd9ec5070 0x55ddda2f57c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 --2- 172.21.15.2:0/3481613241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddd9e839f0 0x55ddda27a390 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 >> 172.21.15.2:0/3481613241 conn(0x55ddd9eb9460 msgr2=0x55ddda267b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.845+0000 7f981b7fe640 0 client.16350 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 shutdown_connections 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f984894f740 1 -- 172.21.15.2:0/3481613241 wait complete. 2024-08-31T04:30:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f984894f740 20 client.16350 trim_cache size 0 max 16384 2024-08-31T04:30:35.852 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:30:35.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 msgr2=0x7f98240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 0x7f98240b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ddda268f90 tx=0x7f982c005f90 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 msgr2=0x7f983c19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.846+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f983000e9f0 tx=0x7f983000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 shutdown_connections 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f98240b4ca0 0x7f98240b71b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f983c105030 0x7f983c19a820 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f983c10dbb0 0x7f983c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 --2- 172.21.15.2:0/965650629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f983c104600 0x7f983c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 >> 172.21.15.2:0/965650629 conn(0x7f983c0794e0 msgr2=0x7f983c106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 shutdown_connections 2024-08-31T04:30:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:35.847+0000 7f98423da640 1 -- 172.21.15.2:0/965650629 wait complete. 2024-08-31T04:30:36.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:36 smithi064 ceph-mon[22007]: pgmap v494: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 213 op/s 2024-08-31T04:30:36.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:36 smithi132 ceph-mon[22335]: pgmap v494: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 213 op/s 2024-08-31T04:30:36.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:36 smithi002 ceph-mon[18656]: pgmap v494: 129 pgs: 129 active+clean; 288 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 213 op/s 2024-08-31T04:30:36.673 INFO:tasks.workunit.client.0.smithi002.stdout: 1 478523 12.11 MB/sec execute 116 sec latency 97.468 ms 2024-08-31T04:30:37.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:30:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:37.673 INFO:tasks.workunit.client.0.smithi002.stdout: 1 480390 12.11 MB/sec execute 117 sec latency 73.619 ms 2024-08-31T04:30:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 -- 172.21.15.2:0/555674336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108160 msgr2=0x7f1bd0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/555674336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108160 0x7f1bd0108570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009900 tx=0x7f1bb802a410 comp rx=0 tx=0).stop 2024-08-31T04:30:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 -- 172.21.15.2:0/555674336 shutdown_connections 2024-08-31T04:30:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/555674336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108160 0x7f1bd0108570 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/555674336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108ab0 0x7f1bd010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/555674336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 0x7f1bd0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 -- 172.21.15.2:0/555674336 >> 172.21.15.2:0/555674336 conn(0x7f1bd00794e0 msgr2=0x7f1bd00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 -- 172.21.15.2:0/555674336 shutdown_connections 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.922+0000 7f1bd52ef640 1 -- 172.21.15.2:0/555674336 wait complete. 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 Processor -- start 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 -- start start 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 0x7f1bd0104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 0x7f1bd01053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01126e0 con 0x7f1bd0108ab0 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0112560 con 0x7f1bd0108160 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.923+0000 7f1bd52ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0112860 con 0x7f1bd0102820 2024-08-31T04:30:37.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42226/0 (socket says 172.21.15.2:42226) 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 0x7f1bd01053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 -- 172.21.15.2:0/381351235 learned_addr learned my addr 172.21.15.2:0/381351235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bceffd640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 0x7f1bd0104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 -- 172.21.15.2:0/381351235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 msgr2=0x7f1bd0104ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 0x7f1bd0104ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 -- 172.21.15.2:0/381351235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 msgr2=0x7f1bd01053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 0x7f1bd01053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 -- 172.21.15.2:0/381351235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd01a84b0 con 0x7f1bd0108ab0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 0x7f1bd01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800eb10 tx=0x7f1bc800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bccff9640 1 -- 172.21.15.2:0/381351235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8004b20 con 0x7f1bd0108ab0 2024-08-31T04:30:37.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bccff9640 1 -- 172.21.15.2:0/381351235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc8004cc0 con 0x7f1bd0108ab0 2024-08-31T04:30:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bccff9640 1 -- 172.21.15.2:0/381351235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8010670 con 0x7f1bd0108ab0 2024-08-31T04:30:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01a87a0 con 0x7f1bd0108ab0 2024-08-31T04:30:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.924+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd01a8cb0 con 0x7f1bd0108ab0 2024-08-31T04:30:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.928+0000 7f1bdb864740 1 Processor -- start 2024-08-31T04:30:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.928+0000 7f1bccff9640 1 -- 172.21.15.2:0/381351235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1bc8005020 con 0x7f1bd0108ab0 2024-08-31T04:30:37.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.928+0000 7f1bdb864740 1 -- start start 2024-08-31T04:30:37.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x560952966350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x560952966890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5609528dd680 con 0x5609525a0390 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5609528ccc10 con 0x5609525981b0 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bdb864740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5609528d0bc0 con 0x5609525c1070 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x560952966890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42236/0 (socket says 172.21.15.2:42236) 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bc7fff640 1 -- 172.21.15.2:0/3810847466 learned_addr learned my addr 172.21.15.2:0/3810847466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x560952966350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 -- 172.21.15.2:0/3810847466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 msgr2=0x560952966350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x560952966350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 -- 172.21.15.2:0/3810847466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 msgr2=0x560952966dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bceffd640 1 -- 172.21.15.2:0/3810847466 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56095262c650 con 0x5609525981b0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.929+0000 7f1bccff9640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 0x7f1bbc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bceffd640 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x560952966890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005d00 tx=0x7f1bc00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a0d7cc9cec5952 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 0x7f1bbc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bccff9640 1 -- 172.21.15.2:0/381351235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bc80e5e40 con 0x7f1bd0108ab0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bc57fa640 1 -- 172.21.15.2:0/3810847466 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001c680 con 0x5609525981b0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bc57fa640 1 -- 172.21.15.2:0/3810847466 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc000be20 con 0x5609525981b0 2024-08-31T04:30:37.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.930+0000 7f1bc57fa640 1 -- 172.21.15.2:0/3810847466 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0011a50 con 0x5609525981b0 2024-08-31T04:30:37.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- 172.21.15.2:0/3810847466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 msgr2=0x560952966890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 0x7f1bbc0b7230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031a90 tx=0x7f1bb8005780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x560952966890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005d00 tx=0x7f1bc00107a0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- 172.21.15.2:0/3810847466 shutdown_connections 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952966dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x560952966890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 --2- 172.21.15.2:0/3810847466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x560952966350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- 172.21.15.2:0/3810847466 >> 172.21.15.2:0/3810847466 conn(0x5609525b5460 msgr2=0x560952964240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- 172.21.15.2:0/3810847466 shutdown_connections 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- 172.21.15.2:0/3810847466 wait complete. 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 -- start start 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.931+0000 7f1bdb864740 1 Processor -- start 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 0x560952972020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x56095297de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56095272f700 con 0x5609525981b0 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560952853750 con 0x5609525a0390 2024-08-31T04:30:37.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560952974b30 con 0x5609525c1070 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bdb864740 10 client.0 _ll_register_callbacks cb 0x560952882e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42250/0 (socket says 172.21.15.2:42250) 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 -- 172.21.15.2:0/2348957731 learned_addr learned my addr 172.21.15.2:0/2348957731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 0x560952972020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x56095297de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 -- 172.21.15.2:0/2348957731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 msgr2=0x56095297de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x56095297de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 -- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 msgr2=0x560952972020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 0x560952972020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bceffd640 1 -- 172.21.15.2:0/2348957731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56095288c900 con 0x5609525981b0 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x56095297de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:37.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.932+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 0x560952972020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0011670 tx=0x7f1bc000ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad7247159d6fa7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bb67fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc002a060 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bc0005260 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc000be20 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1bc0031050 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bdb864740 10 client.16362 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560952980910 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.933+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc000be20 con 0x5609525981b0 2024-08-31T04:30:37.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f1bc0004aa0 con 0x5609525981b0 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 10 client.16362 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 20 client.16362 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56095257f9f0 0x560952983d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 4 client.16362 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609528df5d0 con 0x56095257f9f0 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56095257f9f0 0x560952983d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56095257f9f0 0x560952983d20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d045ee6bfd51a32 server_cookie=579d06d52de49aaf in_seq=0 out_seq=0 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.934+0000 7f1bb67fc640 10 client.16362 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:37.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2348957731 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609528df5d0 con 0x56095257f9f0 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bb67fc640 10 client.16362 handle_command_reply: tid=0 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 client.16362 shutdown 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 msgr2=0x560952971ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0011670 tx=0x7f1bc000ba20 comp rx=0 tx=0).stop 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 shutdown_connections 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56095257f9f0 0x560952983d20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525c1070 0x56095297de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525a0390 0x560952972020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bb67fc640 0 client.16362 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2348957731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525981b0 0x560952971ae0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 >> 172.21.15.2:0/2348957731 conn(0x5609525b5460 msgr2=0x5609529694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 shutdown_connections 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.935+0000 7f1bdb864740 1 -- 172.21.15.2:0/2348957731 wait complete. 2024-08-31T04:30:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.936+0000 7f1bdb864740 20 client.16362 trim_cache size 0 max 16384 2024-08-31T04:30:37.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 Processor -- start 2024-08-31T04:30:37.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 -- start start 2024-08-31T04:30:37.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525a0390 0x56095296f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525c1070 0x560952986d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b59c0 con 0x5609525c1070 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b3260 con 0x5609525981b0 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bdb864740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b10b0 con 0x5609525a0390 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bcf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525c1070 0x560952986d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54694/0 (socket says 172.21.15.2:54694) 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bceffd640 1 -- 172.21.15.2:0/1810566332 learned_addr learned my addr 172.21.15.2:0/1810566332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.949+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525a0390 0x56095296f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 -- 172.21.15.2:0/1810566332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525a0390 msgr2=0x56095296f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525a0390 0x56095296f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 -- 172.21.15.2:0/1810566332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525c1070 msgr2=0x560952986d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525c1070 0x560952986d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 -- 172.21.15.2:0/1810566332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609529691b0 con 0x5609525981b0 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bceffd640 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5a0 tx=0x7f1bc00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f0be93511f0aff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bc4ff9640 1 -- 172.21.15.2:0/1810566332 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc002a070 con 0x5609525981b0 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bc4ff9640 1 -- 172.21.15.2:0/1810566332 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc00057f0 con 0x5609525981b0 2024-08-31T04:30:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.950+0000 7f1bc4ff9640 1 -- 172.21.15.2:0/1810566332 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001ce60 con 0x5609525981b0 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- 172.21.15.2:0/1810566332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 msgr2=0x56095296ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5a0 tx=0x7f1bc00107a0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- 172.21.15.2:0/1810566332 shutdown_connections 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525c1070 0x560952986d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525a0390 0x56095296f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 --2- 172.21.15.2:0/1810566332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525981b0 0x56095296ecd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- 172.21.15.2:0/1810566332 >> 172.21.15.2:0/1810566332 conn(0x5609525b5460 msgr2=0x560952970360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- 172.21.15.2:0/1810566332 shutdown_connections 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- 172.21.15.2:0/1810566332 wait complete. 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.951+0000 7f1bdb864740 1 -- start start 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 Processor -- start 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 0x560952987260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525c1070 0x560952985cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b1720 con 0x5609525a0390 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b2b90 con 0x5609525c1070 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01b1df0 con 0x5609525981b0 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bdb864740 10 client.0 _ll_register_callbacks cb 0x7f1bb8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42262/0 (socket says 172.21.15.2:42262) 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bceffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 0x560952987260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 -- 172.21.15.2:0/2341371957 learned_addr learned my addr 172.21.15.2:0/2341371957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bcf7fe640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525c1070 0x560952985cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 -- 172.21.15.2:0/2341371957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 msgr2=0x560952987260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 0x560952987260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 -- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525c1070 msgr2=0x560952985cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525c1070 0x560952985cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bc7fff640 1 -- 172.21.15.2:0/2341371957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560952986210 con 0x5609525a0390 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.952+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 0x560952987260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bc7fff640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006b460 tx=0x7f1bb802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccaac4b48c131fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8061060 con 0x5609525a0390 2024-08-31T04:30:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f1bb8003800 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc00057f0 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1bb8068050 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 10 client.16368 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5609529ef140 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc00057f0 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f1bb8053050 con 0x5609525a0390 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 10 client.16368 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 20 client.16368 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560952554da0 0x5609529f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 4 client.16368 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.953+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609528db070 con 0x560952554da0 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.954+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560952554da0 0x5609529f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.954+0000 7f1bceffd640 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560952554da0 0x5609529f18e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67213f66d30f7928 server_cookie=3af3949b2f754738 in_seq=0 out_seq=0 2024-08-31T04:30:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.954+0000 7f1bb67fc640 10 client.16368 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bb67fc640 1 -- 172.21.15.2:0/2341371957 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609528db070 con 0x560952554da0 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bb67fc640 10 client.16368 handle_command_reply: tid=0 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 client.16368 shutdown 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 msgr2=0x560952985790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006b460 tx=0x7f1bb802a410 comp rx=0 tx=0).stop 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 shutdown_connections 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560952554da0 0x5609529f18e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5609525a0390 0x560952985790 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5609525c1070 0x560952985cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bb67fc640 0 client.16368 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 --2- 172.21.15.2:0/2341371957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5609525981b0 0x560952987260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 >> 172.21.15.2:0/2341371957 conn(0x5609525b5460 msgr2=0x560952967380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 shutdown_connections 2024-08-31T04:30:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 1 -- 172.21.15.2:0/2341371957 wait complete. 2024-08-31T04:30:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bdb864740 20 client.16368 trim_cache size 0 max 16384 2024-08-31T04:30:37.962 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:30:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 msgr2=0x7f1bbc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 0x7f1bbc0b7230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031a90 tx=0x7f1bb8005780 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 msgr2=0x7f1bd0105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.956+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800eb10 tx=0x7f1bc800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 shutdown_connections 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1bbc0b4d20 0x7f1bbc0b7230 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd0108ab0 0x7f1bd0105920 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bd0108160 0x7f1bd01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 --2- 172.21.15.2:0/381351235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd0102820 0x7f1bd0104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 >> 172.21.15.2:0/381351235 conn(0x7f1bd00794e0 msgr2=0x7f1bd006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 shutdown_connections 2024-08-31T04:30:37.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:37.957+0000 7f1bd52ef640 1 -- 172.21.15.2:0/381351235 wait complete. 2024-08-31T04:30:38.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:38 smithi064 ceph-mon[22007]: pgmap v495: 129 pgs: 129 active+clean; 295 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-08-31T04:30:38.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:38 smithi132 ceph-mon[22335]: pgmap v495: 129 pgs: 129 active+clean; 295 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-08-31T04:30:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:38 smithi002 ceph-mon[18656]: pgmap v495: 129 pgs: 129 active+clean; 295 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-08-31T04:30:38.673 INFO:tasks.workunit.client.0.smithi002.stdout: 1 482843 12.12 MB/sec execute 118 sec latency 60.825 ms 2024-08-31T04:30:39.674 INFO:tasks.workunit.client.0.smithi002.stdout: 1 484828 12.11 MB/sec execute 119 sec latency 29.135 ms 2024-08-31T04:30:39.736 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:30:39.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:30:39.994 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:40.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:40 smithi002 ceph-mon[18656]: pgmap v496: 129 pgs: 129 active+clean; 299 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2024-08-31T04:30:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 -- 172.21.15.2:0/49167768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 msgr2=0x7fc2b0103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 --2- 172.21.15.2:0/49167768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b0103b60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009900 tx=0x7fc2a002a410 comp rx=0 tx=0).stop 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 -- 172.21.15.2:0/49167768 shutdown_connections 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 --2- 172.21.15.2:0/49167768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b01099e0 0x7fc2b0110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 --2- 172.21.15.2:0/49167768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b0109090 0x7fc2b01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 --2- 172.21.15.2:0/49167768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b0103b60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 -- 172.21.15.2:0/49167768 >> 172.21.15.2:0/49167768 conn(0x7fc2b00ff1a0 msgr2=0x7fc2b01015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.528+0000 7fc2af59e640 1 -- 172.21.15.2:0/49167768 shutdown_connections 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.529+0000 7fc2af59e640 1 -- 172.21.15.2:0/49167768 wait complete. 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.529+0000 7fc2af59e640 1 Processor -- start 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 -- start start 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b0109090 0x7fc2b019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b01099e0 0x7fc2b019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b0113690 con 0x7fc2b0103750 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b0113510 con 0x7fc2b01099e0 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2af59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b0113810 con 0x7fc2b0109090 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42274/0 (socket says 172.21.15.2:42274) 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 -- 172.21.15.2:0/3061550031 learned_addr learned my addr 172.21.15.2:0/3061550031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2add9b640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b0109090 0x7fc2b019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b01099e0 0x7fc2b019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 -- 172.21.15.2:0/3061550031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b0109090 msgr2=0x7fc2b019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b0109090 0x7fc2b019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 -- 172.21.15.2:0/3061550031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b01099e0 msgr2=0x7fc2b019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b01099e0 0x7fc2b019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.530+0000 7fc2ae59c640 1 -- 172.21.15.2:0/3061550031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b019ff90 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0005940 tx=0x7fc2a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc29f7fe640 1 -- 172.21.15.2:0/3061550031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a003f030 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b01a0220 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc29f7fe640 1 -- 172.21.15.2:0/3061550031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a0003aa0 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc29f7fe640 1 -- 172.21.15.2:0/3061550031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0035070 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.531+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b01a0700 con 0x7fc2b0103750 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.534+0000 7fc2bafc1740 1 Processor -- start 2024-08-31T04:30:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.534+0000 7fc2bafc1740 1 -- start start 2024-08-31T04:30:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.534+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.534+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 0x5567764b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55677642d5f0 con 0x556776111350 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55677641cb80 con 0x5567760f0670 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556776420b30 con 0x5567760e8490 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc29f7fe640 1 -- 172.21.15.2:0/3061550031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc2a0042030 con 0x7fc2b0103750 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54728/0 (socket says 172.21.15.2:54728) 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 -- 172.21.15.2:0/2893548094 learned_addr learned my addr 172.21.15.2:0/2893548094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 0x5567764b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 -- 172.21.15.2:0/2893548094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 msgr2=0x5567764b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 0x5567764b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 -- 172.21.15.2:0/2893548094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 msgr2=0x5567764b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 -- 172.21.15.2:0/2893548094 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55677617c930 con 0x5567760f0670 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 0x5567764b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.535+0000 7fc2add9b640 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009c20 tx=0x7fc2a4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c6378183b6bcba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc29cff9640 1 -- 172.21.15.2:0/2893548094 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004030 con 0x5567760f0670 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc29cff9640 1 -- 172.21.15.2:0/2893548094 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a4005020 con 0x5567760f0670 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc29cff9640 1 -- 172.21.15.2:0/2893548094 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004d80 con 0x5567760f0670 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc29f7fe640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 0x7fc2980b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 0x7fc2980b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.536+0000 7fc29f7fe640 1 -- 172.21.15.2:0/3061550031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc2a0105fc0 con 0x7fc2b0103750 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- 172.21.15.2:0/2893548094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 msgr2=0x5567764b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 0x7fc2980b71e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8010620 tx=0x7fc2a8007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009c20 tx=0x7fc2a4011810 comp rx=0 tx=0).stop 2024-08-31T04:30:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- 172.21.15.2:0/2893548094 shutdown_connections 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760f0670 0x5567764b83d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760e8490 0x5567764b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/2893548094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- 172.21.15.2:0/2893548094 >> 172.21.15.2:0/2893548094 conn(0x556776105740 msgr2=0x5567764b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- 172.21.15.2:0/2893548094 shutdown_connections 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- 172.21.15.2:0/2893548094 wait complete. 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 -- start start 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.537+0000 7fc2bafc1740 1 Processor -- start 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55677627f890 con 0x556776111350 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5567763a3790 con 0x5567760e8490 2024-08-31T04:30:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5567764c6130 con 0x5567760f0670 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2bafc1740 10 client.0 _ll_register_callbacks cb 0x556776128ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54730/0 (socket says 172.21.15.2:54730) 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42300/0 (socket says 172.21.15.2:42300) 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1212162255 learned_addr learned my addr 172.21.15.2:0/1212162255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2add9b640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1212162255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 msgr2=0x5567764c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1212162255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 msgr2=0x5567764cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1212162255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567763daf30 con 0x5567760e8490 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0006010 tx=0x7fc2a01037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7712aa5cfa5e57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.538+0000 7fc295ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0049070 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc2a0108110 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a4005020 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2a00cbab0 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 10 client.26099 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567764d1e70 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a4005020 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fc2a003bc80 con 0x5567760e8490 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 10 client.26099 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 10 client.26099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 20 client.26099 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5567760cfcd0 0x5567764d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 4 client.26099 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55677642f540 con 0x5567760cfcd0 2024-08-31T04:30:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.539+0000 7fc2add9b640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5567760cfcd0 0x5567764d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.540+0000 7fc2add9b640 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5567760cfcd0 0x5567764d53b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4851c69b40460a95 server_cookie=aec8ad4bb6b27acc in_seq=0 out_seq=0 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.540+0000 7fc295ffb640 10 client.26099 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc295ffb640 1 -- 172.21.15.2:0/1212162255 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55677642f540 con 0x5567760cfcd0 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc295ffb640 10 client.26099 handle_command_reply: tid=0 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 client.26099 shutdown 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 msgr2=0x5567764c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0006010 tx=0x7fc2a01037f0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 shutdown_connections 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5567760cfcd0 0x5567764d53b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556776111350 0x5567764cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc295ffb640 0 client.26099 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1212162255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764c30c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 >> 172.21.15.2:0/1212162255 conn(0x556776105740 msgr2=0x5567764bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 shutdown_connections 2024-08-31T04:30:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1212162255 wait complete. 2024-08-31T04:30:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.541+0000 7fc2bafc1740 20 client.26099 trim_cache size 0 max 16384 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 Processor -- start 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 -- start start 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01b3490 con 0x5567760cfcd0 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01b0d30 con 0x5567760e8490 2024-08-31T04:30:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01aeb80 con 0x5567760f0670 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42316/0 (socket says 172.21.15.2:42316) 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1569214377 learned_addr learned my addr 172.21.15.2:0/1569214377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2add9b640 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1569214377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 msgr2=0x5567764b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1569214377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 msgr2=0x5567764b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.561+0000 7fc2ae59c640 1 -- 172.21.15.2:0/1569214377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567764b9c40 con 0x5567760cfcd0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01038f0 tx=0x7fc2a0005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78b46d2b383effd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc297fff640 1 -- 172.21.15.2:0/1569214377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0049070 con 0x5567760cfcd0 2024-08-31T04:30:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc297fff640 1 -- 172.21.15.2:0/1569214377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a00cbe50 con 0x5567760cfcd0 2024-08-31T04:30:40.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc297fff640 1 -- 172.21.15.2:0/1569214377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00ef0b0 con 0x5567760cfcd0 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1569214377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 msgr2=0x5567764c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.562+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01038f0 tx=0x7fc2a0005cb0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1569214377 shutdown_connections 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x5567764b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760e8490 0x5567764b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/1569214377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760cfcd0 0x5567764c4cf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1569214377 >> 172.21.15.2:0/1569214377 conn(0x556776105740 msgr2=0x5567764c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1569214377 shutdown_connections 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- 172.21.15.2:0/1569214377 wait complete. 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- start start 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 Processor -- start 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760cfcd0 0x5567764c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x55677653ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01af1f0 con 0x5567760e8490 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01b0660 con 0x5567760cfcd0 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01af8c0 con 0x5567760f0670 2024-08-31T04:30:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2bafc1740 10 client.0 _ll_register_callbacks cb 0x7fc2a0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.563+0000 7fc2add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760cfcd0 0x5567764c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42326/0 (socket says 172.21.15.2:42326) 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 -- 172.21.15.2:0/3467122657 learned_addr learned my addr 172.21.15.2:0/3467122657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2aed9d640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x55677653ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 -- 172.21.15.2:0/3467122657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 msgr2=0x55677653ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x55677653ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 -- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760cfcd0 msgr2=0x5567764c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760cfcd0 0x5567764c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 -- 172.21.15.2:0/3467122657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55677653f2b0 con 0x5567760e8490 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2add9b640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a40049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d0f639d467912a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc295ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a401e040 con 0x5567760e8490 2024-08-31T04:30:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc2a4004100 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a00cbe50 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2a4039050 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2bafc1740 10 client.16386 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.564+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556776540580 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a00cbe50 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fc2a4018070 con 0x5567760e8490 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 10 client.16386 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 20 client.16386 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556776111350 0x556776542ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 4 client.16386 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55677642afe0 con 0x556776111350 2024-08-31T04:30:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.565+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556776111350 0x556776542ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.566+0000 7fc295ffb640 10 client.16386 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.566+0000 7fc2ae59c640 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556776111350 0x556776542ba0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae626864c3fbcb0 server_cookie=f4722346910f12c1 in_seq=0 out_seq=0 2024-08-31T04:30:40.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:40 smithi132 ceph-mon[22335]: pgmap v496: 129 pgs: 129 active+clean; 299 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2024-08-31T04:30:40.572 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:40 smithi064 ceph-mon[22007]: pgmap v496: 129 pgs: 129 active+clean; 299 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2024-08-31T04:30:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc295ffb640 1 -- 172.21.15.2:0/3467122657 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55677642afe0 con 0x556776111350 2024-08-31T04:30:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc295ffb640 10 client.16386 handle_command_reply: tid=0 2024-08-31T04:30:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 client.16386 shutdown 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 msgr2=0x5567764c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a40049a0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 shutdown_connections 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556776111350 0x556776542ba0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567760e8490 0x5567764c7fc0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5567760f0670 0x55677653ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 --2- 172.21.15.2:0/3467122657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5567760cfcd0 0x5567764c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 >> 172.21.15.2:0/3467122657 conn(0x556776105740 msgr2=0x5567764c4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc295ffb640 0 client.16386 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.567+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 shutdown_connections 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2bafc1740 1 -- 172.21.15.2:0/3467122657 wait complete. 2024-08-31T04:30:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2bafc1740 20 client.16386 trim_cache size 0 max 16384 2024-08-31T04:30:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:30:40.574 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:30:40.574 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7661bd8a-eb71-4899-bea8-182e99f6e528", 2024-08-31T04:30:40.574 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:30:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 msgr2=0x7fc2980b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 0x7fc2980b71e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8010620 tx=0x7fc2a8007520 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 msgr2=0x7fc2b019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0005940 tx=0x7fc2a0004270 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 shutdown_connections 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b01099e0 0x7fc2b019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2b0109090 0x7fc2b019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc2980b4cd0 0x7fc2980b71e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 --2- 172.21.15.2:0/3061550031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b0103750 0x7fc2b019a0e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 >> 172.21.15.2:0/3061550031 conn(0x7fc2b00ff1a0 msgr2=0x7fc2b01015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 shutdown_connections 2024-08-31T04:30:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:40.568+0000 7fc2af59e640 1 -- 172.21.15.2:0/3061550031 wait complete. 2024-08-31T04:30:40.673 INFO:tasks.workunit.client.0.smithi002.stdout: 1 487151 12.13 MB/sec execute 120 sec latency 32.083 ms 2024-08-31T04:30:41.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:41 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:41 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:41 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:41 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:41 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:41 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:30:41.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:41 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:41 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:30:41.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:41 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:30:41.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:41 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:41 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:30:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:41 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:41 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:30:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:41 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:30:41.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:41 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:41.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 488853 12.07 MB/sec execute 121 sec latency 32.736 ms 2024-08-31T04:30:42.364 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:42 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:42.364 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:42 smithi002 ceph-mon[18656]: pgmap v497: 129 pgs: 129 active+clean; 300 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 -- 172.21.15.2:0/3224441247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108140 msgr2=0x7fd0dc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/3224441247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108140 0x7fd0dc108550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009900 tx=0x7fd0c402a410 comp rx=0 tx=0).stop 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 -- 172.21.15.2:0/3224441247 shutdown_connections 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/3224441247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108140 0x7fd0dc108550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/3224441247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108a90 0x7fd0dc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/3224441247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 -- 172.21.15.2:0/3224441247 >> 172.21.15.2:0/3224441247 conn(0x7fd0dc0794d0 msgr2=0x7fd0dc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 -- 172.21.15.2:0/3224441247 shutdown_connections 2024-08-31T04:30:42.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.467+0000 7fd0e11a7640 1 -- 172.21.15.2:0/3224441247 wait complete. 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.468+0000 7fd0e11a7640 1 Processor -- start 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.468+0000 7fd0e11a7640 1 -- start start 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108140 0x7fd0dc19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108a90 0x7fd0dc1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1126c0 con 0x7fd0dc108a90 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc112540 con 0x7fd0dc102800 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0e11a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc112840 con 0x7fd0dc108140 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54758/0 (socket says 172.21.15.2:54758) 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 -- 172.21.15.2:0/2156739057 learned_addr learned my addr 172.21.15.2:0/2156739057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0d259c640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108140 0x7fd0dc19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 -- 172.21.15.2:0/2156739057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108140 msgr2=0x7fd0dc19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108140 0x7fd0dc19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 -- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108a90 msgr2=0x7fd0dc1a1d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108a90 0x7fd0dc1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.469+0000 7fd0dad9d640 1 -- 172.21.15.2:0/2156739057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc1a2440 con 0x7fd0dc102800 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009d50 tx=0x7fd0cc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0d8d99640 1 -- 172.21.15.2:0/2156739057 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc003b70 con 0x7fd0dc102800 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0d8d99640 1 -- 172.21.15.2:0/2156739057 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc003d10 con 0x7fd0dc102800 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1a2730 con 0x7fd0dc102800 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0d8d99640 1 -- 172.21.15.2:0/2156739057 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0108a0 con 0x7fd0dc102800 2024-08-31T04:30:42.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.470+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1a8e90 con 0x7fd0dc102800 2024-08-31T04:30:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.473+0000 7fd0d8d99640 1 -- 172.21.15.2:0/2156739057 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd0cc004000 con 0x7fd0dc102800 2024-08-31T04:30:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.473+0000 7fd0e771c740 1 Processor -- start 2024-08-31T04:30:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.473+0000 7fd0e771c740 1 -- start start 2024-08-31T04:30:42.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a5894f3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a58946a630 con 0x55a58914e070 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a589459bc0 con 0x55a58912d390 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0e771c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a58945db70 con 0x55a5891251b0 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0db59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a5894f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0db59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a5894f3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42356/0 (socket says 172.21.15.2:42356) 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0db59e640 1 -- 172.21.15.2:0/2152236237 learned_addr learned my addr 172.21.15.2:0/2152236237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0d259c640 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0d259c640 1 -- 172.21.15.2:0/2152236237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 msgr2=0x55a5894f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0d259c640 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.474+0000 7fd0d259c640 1 -- 172.21.15.2:0/2152236237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 msgr2=0x55a5894f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d259c640 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a5894f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d259c640 1 -- 172.21.15.2:0/2152236237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5891b9650 con 0x55a58912d390 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d8d99640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 0x7fd0c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0db59e640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 0x7fd0c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d259c640 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f3d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4006010 tx=0x7fd0c4032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41f326b07d52079 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d8d99640 1 -- 172.21.15.2:0/2156739057 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd0cc0e61a0 con 0x7fd0dc102800 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d159a640 1 -- 172.21.15.2:0/2152236237 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c403f070 con 0x55a58912d390 2024-08-31T04:30:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.475+0000 7fd0d159a640 1 -- 172.21.15.2:0/2152236237 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c4004020 con 0x55a58912d390 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.476+0000 7fd0d159a640 1 -- 172.21.15.2:0/2152236237 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4035070 con 0x55a58912d390 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.476+0000 7fd0e771c740 1 -- 172.21.15.2:0/2152236237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 msgr2=0x55a5894f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.476+0000 7fd0db59e640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 0x7fd0c80b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400bbc0 tx=0x7fd0d400b310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.476+0000 7fd0e771c740 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f3d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4006010 tx=0x7fd0c4032ba0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 -- 172.21.15.2:0/2152236237 shutdown_connections 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f3d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 --2- 172.21.15.2:0/2152236237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a5894f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 -- 172.21.15.2:0/2152236237 >> 172.21.15.2:0/2152236237 conn(0x55a589142460 msgr2=0x55a5894f11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 -- 172.21.15.2:0/2152236237 shutdown_connections 2024-08-31T04:30:42.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 -- 172.21.15.2:0/2152236237 wait complete. 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 -- start start 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.477+0000 7fd0e771c740 1 Processor -- start 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a58950ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0d259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0d259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:54776/0 (socket says 172.21.15.2:54776) 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33892/0 (socket says 172.21.15.2:33892) 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0d259c640 1 -- 172.21.15.2:0/3693105764 learned_addr learned my addr 172.21.15.2:0/3693105764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5892bc700 con 0x55a58914e070 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a5893e0700 con 0x55a58912d390 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a589501b20 con 0x55a5891251b0 2024-08-31T04:30:42.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.478+0000 7fd0db59e640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a58950ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 -- 172.21.15.2:0/3693105764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 msgr2=0x55a5894fe9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 -- 172.21.15.2:0/3693105764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 msgr2=0x55a58950ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a58950ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5894198b0 con 0x55a58912d390 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0e771c740 10 client.0 _ll_register_callbacks cb 0x55a58940fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0d259c640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c4005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1648dbe3bd18ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c4004020 con 0x55a58912d390 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0c27fc640 1 -- 172.21.15.2:0/3693105764 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4035070 con 0x55a58912d390 2024-08-31T04:30:42.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.479+0000 7fd0c27fc640 1 -- 172.21.15.2:0/3693105764 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd0c40316a0 con 0x55a58912d390 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.480+0000 7fd0c27fc640 1 -- 172.21.15.2:0/3693105764 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0c4055050 con 0x55a58912d390 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.480+0000 7fd0e771c740 10 client.26117 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.480+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a58950d670 con 0x55a58912d390 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0c27fc640 1 -- 172.21.15.2:0/3693105764 <== mon.2 v2:172.21.15.64:3300/0 4 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fd0c40035f0 con 0x55a58912d390 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 10 client.26117 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 10 client.26117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 20 client.26117 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58910c9f0 0x55a5895109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 4 client.26117 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd0c4004020 con 0x55a58910c9f0 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.481+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58910c9f0 0x55a5895109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.482+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58910c9f0 0x55a5895109d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5364d2ba32fbb58d server_cookie=987f5b27c0783988 in_seq=0 out_seq=0 2024-08-31T04:30:42.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.482+0000 7fd0c27fc640 10 client.26117 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0c27fc640 1 -- 172.21.15.2:0/3693105764 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd0c4004020 con 0x55a58910c9f0 2024-08-31T04:30:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0c27fc640 10 client.26117 handle_command_reply: tid=0 2024-08-31T04:30:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 client.26117 shutdown 2024-08-31T04:30:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 msgr2=0x55a5894fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c4005e40 comp rx=0 tx=0).stop 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 shutdown_connections 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58910c9f0 0x55a5895109d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58914e070 0x55a58950ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0c27fc640 0 client.26117 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894fef20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 --2- 172.21.15.2:0/3693105764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.483+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 >> 172.21.15.2:0/3693105764 conn(0x55a589142460 msgr2=0x55a5894f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.484+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 shutdown_connections 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.484+0000 7fd0e771c740 1 -- 172.21.15.2:0/3693105764 wait complete. 2024-08-31T04:30:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.484+0000 7fd0e771c740 20 client.26117 trim_cache size 0 max 16384 2024-08-31T04:30:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.517+0000 7fd0e771c740 1 Processor -- start 2024-08-31T04:30:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.517+0000 7fd0e771c740 1 -- start start 2024-08-31T04:30:42.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b5960 con 0x55a58910c9f0 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b3200 con 0x55a58912d390 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0e771c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b1050 con 0x55a5891251b0 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42376/0 (socket says 172.21.15.2:42376) 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0dad9d640 1 -- 172.21.15.2:0/373495533 learned_addr learned my addr 172.21.15.2:0/373495533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0db59e640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0d259c640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0dad9d640 1 -- 172.21.15.2:0/373495533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 msgr2=0x55a5894f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.518+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0dad9d640 1 -- 172.21.15.2:0/373495533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 msgr2=0x55a5894f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0dad9d640 1 -- 172.21.15.2:0/373495533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5894ffca0 con 0x55a58910c9f0 2024-08-31T04:30:42.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0db59e640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:42.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009d20 tx=0x7fd0cc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e6ada02187b759 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0d0d99640 1 -- 172.21.15.2:0/373495533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0abf80 con 0x55a58910c9f0 2024-08-31T04:30:42.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0d0d99640 1 -- 172.21.15.2:0/373495533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc0acb70 con 0x55a58910c9f0 2024-08-31T04:30:42.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.519+0000 7fd0d0d99640 1 -- 172.21.15.2:0/373495533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0e3750 con 0x55a58910c9f0 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 -- 172.21.15.2:0/373495533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 msgr2=0x55a5895008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009d20 tx=0x7fd0cc020000 comp rx=0 tx=0).stop 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 -- 172.21.15.2:0/373495533 shutdown_connections 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a5894f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a5894f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 --2- 172.21.15.2:0/373495533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a5895008c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 -- 172.21.15.2:0/373495533 >> 172.21.15.2:0/373495533 conn(0x55a589142460 msgr2=0x55a5894f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.520+0000 7fd0e771c740 1 -- 172.21.15.2:0/373495533 shutdown_connections 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.521+0000 7fd0e771c740 1 -- 172.21.15.2:0/373495533 wait complete. 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.521+0000 7fd0e771c740 1 -- start start 2024-08-31T04:30:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.521+0000 7fd0e771c740 1 Processor -- start 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a589512260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42380/0 (socket says 172.21.15.2:42380) 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0dad9d640 1 -- 172.21.15.2:0/1707819321 learned_addr learned my addr 172.21.15.2:0/1707819321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a58957a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b16c0 con 0x55a58910c9f0 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0d259c640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a589512260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0db59e640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a58957a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b2b30 con 0x55a58912d390 2024-08-31T04:30:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.522+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b1d90 con 0x55a5891251b0 2024-08-31T04:30:42.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0dad9d640 1 -- 172.21.15.2:0/1707819321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 msgr2=0x55a589512260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a589512260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0dad9d640 1 -- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 msgr2=0x55a58957a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a58957a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0dad9d640 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a589512ae0 con 0x55a58910c9f0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0e771c740 10 client.0 _ll_register_callbacks cb 0x7fd0d400b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.523+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0cc0acb70 con 0x55a58910c9f0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0dad9d640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0ac400 tx=0x7fd0cc00cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97d14337f81f306 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0c27fc640 10 client.16401 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0c27fc640 1 -- 172.21.15.2:0/1707819321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0abf80 con 0x55a58910c9f0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0c27fc640 1 -- 172.21.15.2:0/1707819321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fd0cc0e3750 con 0x55a58910c9f0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0c27fc640 1 -- 172.21.15.2:0/1707819321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0cc0b0ce0 con 0x55a58910c9f0 2024-08-31T04:30:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 10 client.16401 fetch_fsmap learned FSMap version 29 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a58957b4d0 con 0x55a58910c9f0 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0c27fc640 1 -- 172.21.15.2:0/1707819321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fd0cc0a8700 con 0x55a58910c9f0 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 10 client.16401 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 20 client.16401 populate_metadata read hostname 'smithi002' 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58914e070 0x55a58957db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 4 client.16401 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.524+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a58946c580 con 0x55a58914e070 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.525+0000 7fd0d259c640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58914e070 0x55a58957db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.525+0000 7fd0d259c640 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58914e070 0x55a58957db10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85975c0f11de9de9 server_cookie=c4885a3c959a6512 in_seq=0 out_seq=0 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.525+0000 7fd0c27fc640 10 client.16401 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0c27fc640 1 -- 172.21.15.2:0/1707819321 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55a58946c580 con 0x55a58914e070 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0c27fc640 10 client.16401 handle_command_reply: tid=0 2024-08-31T04:30:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 client.16401 shutdown 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 msgr2=0x55a589511d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0ac400 tx=0x7fd0cc00cd40 comp rx=0 tx=0).stop 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 shutdown_connections 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a58914e070 0x55a58957db10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a58912d390 0x55a58957a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a5891251b0 0x55a589512260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 --2- 172.21.15.2:0/1707819321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a58910c9f0 0x55a589511d20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 >> 172.21.15.2:0/1707819321 conn(0x55a589142460 msgr2=0x55a5894f4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.526+0000 7fd0c27fc640 0 client.16401 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 shutdown_connections 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e771c740 1 -- 172.21.15.2:0/1707819321 wait complete. 2024-08-31T04:30:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e771c740 20 client.16401 trim_cache size 0 max 16384 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7661bd8a-eb71-4899-bea8-182e99f6e528", 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:30:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:30:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:30:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:30:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 msgr2=0x7fd0c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 0x7fd0c80b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400bbc0 tx=0x7fd0d400b310 comp rx=0 tx=0).stop 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 msgr2=0x7fd0dc19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009d50 tx=0x7fd0cc00c6a0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 shutdown_connections 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fd0c80b4ca0 0x7fd0c80b71b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc108a90 0x7fd0dc1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0dc108140 0x7fd0dc19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 --2- 172.21.15.2:0/2156739057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0dc102800 0x7fd0dc19c4d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 >> 172.21.15.2:0/2156739057 conn(0x7fd0dc0794d0 msgr2=0x7fd0dc1050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 shutdown_connections 2024-08-31T04:30:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:30:42.527+0000 7fd0e11a7640 1 -- 172.21.15.2:0/2156739057 wait complete. 2024-08-31T04:30:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:42 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:42.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:42 smithi064 ceph-mon[22007]: pgmap v497: 129 pgs: 129 active+clean; 300 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-31T04:30:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:42 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:30:42.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:42 smithi132 ceph-mon[22335]: pgmap v497: 129 pgs: 129 active+clean; 300 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-31T04:30:42.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 490911 12.09 MB/sec execute 122 sec latency 56.944 ms 2024-08-31T04:30:43.256 INFO:tasks.cephfs.filesystem:scrub status for tag:7661bd8a-eb71-4899-bea8-182e99f6e528 - {'path': '/', 'tag': '7661bd8a-eb71-4899-bea8-182e99f6e528', 'options': 'recursive,force'} 2024-08-31T04:30:43.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 493515 12.10 MB/sec execute 123 sec latency 29.403 ms 2024-08-31T04:30:44.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:44 smithi132 ceph-mon[22335]: pgmap v498: 129 pgs: 129 active+clean; 303 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 243 op/s 2024-08-31T04:30:44.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:44 smithi064 ceph-mon[22007]: pgmap v498: 129 pgs: 129 active+clean; 303 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 243 op/s 2024-08-31T04:30:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:44 smithi002 ceph-mon[18656]: pgmap v498: 129 pgs: 129 active+clean; 303 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 243 op/s 2024-08-31T04:30:44.674 INFO:tasks.workunit.client.0.smithi002.stdout: 1 495446 12.09 MB/sec execute 124 sec latency 27.028 ms 2024-08-31T04:30:45.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 497873 12.10 MB/sec execute 125 sec latency 16.496 ms 2024-08-31T04:30:46.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:46 smithi064 ceph-mon[22007]: pgmap v499: 129 pgs: 129 active+clean; 304 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 203 op/s 2024-08-31T04:30:46.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:46 smithi132 ceph-mon[22335]: pgmap v499: 129 pgs: 129 active+clean; 304 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 203 op/s 2024-08-31T04:30:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:46 smithi002 ceph-mon[18656]: pgmap v499: 129 pgs: 129 active+clean; 304 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 203 op/s 2024-08-31T04:30:46.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 500169 12.09 MB/sec execute 126 sec latency 42.887 ms 2024-08-31T04:30:47.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 502009 12.08 MB/sec execute 127 sec latency 38.686 ms 2024-08-31T04:30:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:48 smithi064 ceph-mon[22007]: pgmap v500: 129 pgs: 129 active+clean; 313 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-08-31T04:30:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:48 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:30:48.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:48 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:30:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:48 smithi132 ceph-mon[22335]: pgmap v500: 129 pgs: 129 active+clean; 313 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-08-31T04:30:48.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:48 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:30:48.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:48 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:30:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:48 smithi002 ceph-mon[18656]: pgmap v500: 129 pgs: 129 active+clean; 313 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-08-31T04:30:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:48 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:30:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:48 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:30:48.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 504717 12.11 MB/sec execute 128 sec latency 28.717 ms 2024-08-31T04:30:49.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 506675 12.07 MB/sec execute 129 sec latency 24.343 ms 2024-08-31T04:30:50.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:50 smithi064 ceph-mon[22007]: pgmap v501: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 202 op/s 2024-08-31T04:30:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:50 smithi132 ceph-mon[22335]: pgmap v501: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 202 op/s 2024-08-31T04:30:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:50 smithi002 ceph-mon[18656]: pgmap v501: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 202 op/s 2024-08-31T04:30:50.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 509011 12.08 MB/sec execute 130 sec latency 27.517 ms 2024-08-31T04:30:51.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 511790 12.13 MB/sec execute 131 sec latency 17.913 ms 2024-08-31T04:30:52.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:52 smithi064 ceph-mon[22007]: pgmap v502: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-08-31T04:30:52.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:52 smithi132 ceph-mon[22335]: pgmap v502: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-08-31T04:30:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:52 smithi002 ceph-mon[18656]: pgmap v502: 129 pgs: 129 active+clean; 315 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-08-31T04:30:52.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 513099 12.08 MB/sec execute 132 sec latency 51.947 ms 2024-08-31T04:30:53.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 515596 12.09 MB/sec execute 133 sec latency 14.901 ms 2024-08-31T04:30:54.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:54 smithi064 ceph-mon[22007]: pgmap v503: 129 pgs: 129 active+clean; 318 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:30:54.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:54 smithi132 ceph-mon[22335]: pgmap v503: 129 pgs: 129 active+clean; 318 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:30:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:54 smithi002 ceph-mon[18656]: pgmap v503: 129 pgs: 129 active+clean; 318 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:30:54.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 518022 12.09 MB/sec execute 134 sec latency 24.071 ms 2024-08-31T04:30:55.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 520192 12.09 MB/sec execute 135 sec latency 28.999 ms 2024-08-31T04:30:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:56 smithi002 ceph-mon[18656]: pgmap v504: 129 pgs: 129 active+clean; 324 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 206 op/s 2024-08-31T04:30:56.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 522664 12.11 MB/sec execute 136 sec latency 16.757 ms 2024-08-31T04:30:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:56 smithi064 ceph-mon[22007]: pgmap v504: 129 pgs: 129 active+clean; 324 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 206 op/s 2024-08-31T04:30:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:56 smithi132 ceph-mon[22335]: pgmap v504: 129 pgs: 129 active+clean; 324 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 206 op/s 2024-08-31T04:30:57.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 524355 12.06 MB/sec execute 137 sec latency 54.234 ms 2024-08-31T04:30:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:30:58 smithi002 ceph-mon[18656]: pgmap v505: 129 pgs: 129 active+clean; 327 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 262 op/s 2024-08-31T04:30:58.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 526497 12.07 MB/sec execute 138 sec latency 30.069 ms 2024-08-31T04:30:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:30:58 smithi064 ceph-mon[22007]: pgmap v505: 129 pgs: 129 active+clean; 327 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 262 op/s 2024-08-31T04:30:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:30:58 smithi132 ceph-mon[22335]: pgmap v505: 129 pgs: 129 active+clean; 327 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 262 op/s 2024-08-31T04:30:59.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 528937 12.08 MB/sec execute 139 sec latency 32.584 ms 2024-08-31T04:31:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:00 smithi002 ceph-mon[18656]: pgmap v506: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:00.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 530324 12.04 MB/sec execute 140 sec latency 50.939 ms 2024-08-31T04:31:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:00 smithi064 ceph-mon[22007]: pgmap v506: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:00 smithi132 ceph-mon[22335]: pgmap v506: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:01.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 531795 12.00 MB/sec execute 141 sec latency 52.308 ms 2024-08-31T04:31:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:02 smithi002 ceph-mon[18656]: pgmap v507: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-08-31T04:31:02.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 533566 12.00 MB/sec execute 142 sec latency 73.787 ms 2024-08-31T04:31:02.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:02 smithi132 ceph-mon[22335]: pgmap v507: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-08-31T04:31:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:02 smithi064 ceph-mon[22007]: pgmap v507: 129 pgs: 129 active+clean; 330 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-08-31T04:31:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:03 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:03 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:03 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:03 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:31:03.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 535483 11.97 MB/sec execute 143 sec latency 43.803 ms 2024-08-31T04:31:03.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:03 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:03.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:03 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:03.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:03 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:03.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:03 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:31:03.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:03 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:03.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:03 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:03.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:03 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:03.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:03 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:31:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:04 smithi002 ceph-mon[18656]: pgmap v508: 129 pgs: 129 active+clean; 332 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-08-31T04:31:04.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 537503 11.98 MB/sec execute 144 sec latency 34.946 ms 2024-08-31T04:31:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:04 smithi064 ceph-mon[22007]: pgmap v508: 129 pgs: 129 active+clean; 332 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-08-31T04:31:04.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:04 smithi132 ceph-mon[22335]: pgmap v508: 129 pgs: 129 active+clean; 332 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-08-31T04:31:05.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 540085 12.01 MB/sec execute 145 sec latency 20.962 ms 2024-08-31T04:31:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:06 smithi002 ceph-mon[18656]: pgmap v509: 129 pgs: 129 active+clean; 342 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 286 op/s 2024-08-31T04:31:06.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 541683 11.97 MB/sec execute 146 sec latency 17.880 ms 2024-08-31T04:31:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:06 smithi064 ceph-mon[22007]: pgmap v509: 129 pgs: 129 active+clean; 342 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 286 op/s 2024-08-31T04:31:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:06 smithi132 ceph-mon[22335]: pgmap v509: 129 pgs: 129 active+clean; 342 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 286 op/s 2024-08-31T04:31:07.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 543776 11.98 MB/sec execute 147 sec latency 114.768 ms 2024-08-31T04:31:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:08 smithi002 ceph-mon[18656]: pgmap v510: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:08.675 INFO:tasks.workunit.client.0.smithi002.stdout: 1 545296 11.94 MB/sec execute 148 sec latency 32.193 ms 2024-08-31T04:31:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:08 smithi064 ceph-mon[22007]: pgmap v510: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:08.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:08 smithi132 ceph-mon[22335]: pgmap v510: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:09.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 547672 11.95 MB/sec execute 149 sec latency 16.130 ms 2024-08-31T04:31:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:10 smithi002 ceph-mon[18656]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T04:31:10.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 550244 11.96 MB/sec execute 150 sec latency 28.326 ms 2024-08-31T04:31:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:10 smithi064 ceph-mon[22007]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T04:31:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:10 smithi132 ceph-mon[22335]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T04:31:11.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 552132 11.95 MB/sec execute 151 sec latency 31.204 ms 2024-08-31T04:31:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:12 smithi002 ceph-mon[18656]: pgmap v512: 129 pgs: 129 active+clean; 357 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 232 op/s 2024-08-31T04:31:12.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 554378 11.96 MB/sec execute 152 sec latency 71.204 ms 2024-08-31T04:31:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:12 smithi064 ceph-mon[22007]: pgmap v512: 129 pgs: 129 active+clean; 357 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 232 op/s 2024-08-31T04:31:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:12 smithi132 ceph-mon[22335]: pgmap v512: 129 pgs: 129 active+clean; 357 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 232 op/s 2024-08-31T04:31:13.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:31:13.570 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:13.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 555852 11.92 MB/sec execute 153 sec latency 26.637 ms 2024-08-31T04:31:14.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 -- 172.21.15.2:0/1999173412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 msgr2=0x7f0b70102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1999173412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70102c10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009ca0 tx=0x7f0b6802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 -- 172.21.15.2:0/1999173412 shutdown_connections 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1999173412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 0x7f0b7010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1999173412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1999173412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70102c10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 -- 172.21.15.2:0/1999173412 >> 172.21.15.2:0/1999173412 conn(0x7f0b700794d0 msgr2=0x7f0b700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 -- 172.21.15.2:0/1999173412 shutdown_connections 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 -- 172.21.15.2:0/1999173412 wait complete. 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.080+0000 7f0b7570d640 1 Processor -- start 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 -- start start 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 0x7f0b70199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112710 con 0x7f0b70102800 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112590 con 0x7f0b70108140 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b7570d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112890 con 0x7f0b70108a90 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41134/0 (socket says 172.21.15.2:41134) 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57152/0 (socket says 172.21.15.2:57152) 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/1260128949 learned_addr learned my addr 172.21.15.2:0/1260128949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 0x7f0b70199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/1260128949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 msgr2=0x7f0b70199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 0x7f0b70199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 msgr2=0x7f0b70198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.081+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/1260128949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701a84a0 con 0x7f0b70108140 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9c0 tx=0x7f0b5800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b67fff640 1 -- 172.21.15.2:0/1260128949 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800cd80 con 0x7f0b70108140 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b701a8790 con 0x7f0b70108140 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b67fff640 1 -- 172.21.15.2:0/1260128949 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b580054d0 con 0x7f0b70108140 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701a8d20 con 0x7f0b70108140 2024-08-31T04:31:14.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.082+0000 7f0b67fff640 1 -- 172.21.15.2:0/1260128949 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58010430 con 0x7f0b70108140 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 Processor -- start 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 -- start start 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b67fff640 1 -- 172.21.15.2:0/1260128949 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0b580105d0 con 0x7f0b70108140 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eff153c630 con 0x55eff11ff390 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eff152bbc0 con 0x55eff11f71b0 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.085+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eff152fb70 con 0x55eff1220070 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41140/0 (socket says 172.21.15.2:41140) 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 -- 172.21.15.2:0/103539298 learned_addr learned my addr 172.21.15.2:0/103539298 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 -- 172.21.15.2:0/103539298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 msgr2=0x55eff15c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 -- 172.21.15.2:0/103539298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 msgr2=0x55eff15c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 -- 172.21.15.2:0/103539298 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff128b650 con 0x55eff11f71b0 2024-08-31T04:31:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.086+0000 7f0b6effd640 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009ca0 tx=0x7f0b68009410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46cdeb4fd708dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b657fa640 1 -- 172.21.15.2:0/103539298 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68031cf0 con 0x55eff11f71b0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b657fa640 1 -- 172.21.15.2:0/103539298 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b68036030 con 0x55eff11f71b0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b67fff640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 0x7f0b5c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b67fff640 1 -- 172.21.15.2:0/1260128949 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0b580e5d90 con 0x7f0b70108140 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 0x7f0b5c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.087+0000 7f0b657fa640 1 -- 172.21.15.2:0/103539298 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680042a0 con 0x55eff11f71b0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 -- 172.21.15.2:0/103539298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 msgr2=0x55eff15c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 0x7f0b5c0b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009da0 tx=0x7f0b60005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009ca0 tx=0x7f0b68009410 comp rx=0 tx=0).stop 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 -- 172.21.15.2:0/103539298 shutdown_connections 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15c5800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/103539298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 -- 172.21.15.2:0/103539298 >> 172.21.15.2:0/103539298 conn(0x55eff1214460 msgr2=0x55eff15c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 -- 172.21.15.2:0/103539298 shutdown_connections 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.088+0000 7f0b7bc82740 1 -- 172.21.15.2:0/103539298 wait complete. 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 -- start start 2024-08-31T04:31:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 Processor -- start 2024-08-31T04:31:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 0x55eff15d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eff138e700 con 0x55eff11f71b0 2024-08-31T04:31:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eff14b2700 con 0x55eff11ff390 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eff15d3910 con 0x55eff1220070 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41154/0 (socket says 172.21.15.2:41154) 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/2247691792 learned_addr learned my addr 172.21.15.2:0/2247691792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.089+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 0x55eff15d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b7bc82740 10 client.0 _ll_register_callbacks cb 0x55eff14e1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/2247691792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 msgr2=0x55eff15d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/2247691792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 msgr2=0x55eff15d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 0x55eff15d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/2247691792 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff14eb8b0 con 0x55eff11ff390 2024-08-31T04:31:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 0x55eff15d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b580abd60 tx=0x7f0b580a7fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368a89dfa89a35ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b567fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580046c0 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0b580b5100 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.090+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b68036030 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b580abb70 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 10 client.26135 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eff15df660 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b68036030 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f0b580a7af0 con 0x55eff11ff390 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 10 client.26135 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 10 client.26135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 20 client.26135 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11de9f0 0x55eff15e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 4 client.26135 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eff153e580 con 0x55eff11de9f0 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.091+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11de9f0 0x55eff15e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.092+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11de9f0 0x55eff15e2bd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ecc6a3581a7d95 server_cookie=5d8b4b8a51ed1c16 in_seq=0 out_seq=0 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.092+0000 7f0b567fc640 10 client.26135 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.092+0000 7f0b567fc640 1 -- 172.21.15.2:0/2247691792 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eff153e580 con 0x55eff11de9f0 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.092+0000 7f0b567fc640 10 client.26135 handle_command_reply: tid=0 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.092+0000 7f0b7bc82740 1 client.26135 shutdown 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 msgr2=0x55eff15d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b580abd60 tx=0x7f0b580a7fe0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 shutdown_connections 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11de9f0 0x55eff15e2bd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1220070 0x55eff15d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11ff390 0x55eff15d0e40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2247691792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11f71b0 0x55eff15d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 >> 172.21.15.2:0/2247691792 conn(0x55eff1214460 msgr2=0x55eff15c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b567fc640 0 client.26135 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 shutdown_connections 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2247691792 wait complete. 2024-08-31T04:31:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.093+0000 7f0b7bc82740 20 client.26135 trim_cache size 0 max 16384 2024-08-31T04:31:14.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.129+0000 7f0b7bc82740 1 Processor -- start 2024-08-31T04:31:14.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.129+0000 7f0b7bc82740 1 -- start start 2024-08-31T04:31:14.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 0x55eff15c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b5960 con 0x55eff1220070 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b3200 con 0x55eff11f71b0 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b1050 con 0x55eff11ff390 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 0x55eff15c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57188/0 (socket says 172.21.15.2:57188) 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 -- 172.21.15.2:0/2958444491 learned_addr learned my addr 172.21.15.2:0/2958444491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:14.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 -- 172.21.15.2:0/2958444491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 msgr2=0x55eff15c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 0x55eff15c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 -- 172.21.15.2:0/2958444491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 msgr2=0x55eff15d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6f7fe640 1 -- 172.21.15.2:0/2958444491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff15c8120 con 0x55eff1220070 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.130+0000 7f0b6effd640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.131+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0b60004360 tx=0x7f0b60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb86452fca54338 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.131+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 0x55eff15c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.131+0000 7f0b64ff9640 1 -- 172.21.15.2:0/2958444491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60004450 con 0x55eff1220070 2024-08-31T04:31:14.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.131+0000 7f0b64ff9640 1 -- 172.21.15.2:0/2958444491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b6002e070 con 0x55eff1220070 2024-08-31T04:31:14.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.131+0000 7f0b64ff9640 1 -- 172.21.15.2:0/2958444491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600296c0 con 0x55eff1220070 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2958444491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 msgr2=0x55eff15c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0b60004360 tx=0x7f0b60017000 comp rx=0 tx=0).stop 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2958444491 shutdown_connections 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff1220070 0x55eff15c2780 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11ff390 0x55eff15c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/2958444491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff11f71b0 0x55eff15d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2958444491 >> 172.21.15.2:0/2958444491 conn(0x55eff1214460 msgr2=0x55eff15c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2958444491 shutdown_connections 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.132+0000 7f0b7bc82740 1 -- 172.21.15.2:0/2958444491 wait complete. 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 -- start start 2024-08-31T04:31:14.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 Processor -- start 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 0x55eff15d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 0x55eff15d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b16c0 con 0x55eff11ff390 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b2b30 con 0x55eff1220070 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701b1d90 con 0x55eff11f71b0 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b7bc82740 10 client.0 _ll_register_callbacks cb 0x7f0b5800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 0x55eff15d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 0x55eff15d4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:60682/0 (socket says 172.21.15.2:60682) 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b6e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b6effd640 1 -- 172.21.15.2:0/3187072432 learned_addr learned my addr 172.21.15.2:0/3187072432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.133+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 0x55eff15d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/3187072432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 msgr2=0x55eff15d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 0x55eff15d4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 msgr2=0x55eff15d57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 0x55eff15d57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 -- 172.21.15.2:0/3187072432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff164c6f0 con 0x55eff11ff390 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6f7fe640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 0x55eff15d57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b6e7fc640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15d52a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c6a0 tx=0x7f0b58009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dc8ba74b37d28b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b567fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ab9b0 con 0x55eff11ff390 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b6002e070 con 0x55eff11ff390 2024-08-31T04:31:14.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.134+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f0b580ab2c0 con 0x55eff11ff390 2024-08-31T04:31:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b580046c0 con 0x55eff11ff390 2024-08-31T04:31:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 10 client.16419 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eff164d980 con 0x55eff11ff390 2024-08-31T04:31:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b6002e070 con 0x55eff11ff390 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f0b580aad30 con 0x55eff11ff390 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 10 client.16419 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 20 client.16419 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11b3da0 0x55eff1650140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 4 client.16419 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eff153a020 con 0x55eff11b3da0 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.135+0000 7f0b6effd640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11b3da0 0x55eff1650140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b567fc640 10 client.16419 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b6effd640 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11b3da0 0x55eff1650140 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de06b3069b8fc942 server_cookie=99f3a4352d77416d in_seq=0 out_seq=0 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b567fc640 1 -- 172.21.15.2:0/3187072432 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55eff153a020 con 0x55eff11b3da0 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b567fc640 10 client.16419 handle_command_reply: tid=0 2024-08-31T04:31:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 client.16419 shutdown 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 msgr2=0x55eff15d52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15d52a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c6a0 tx=0x7f0b58009700 comp rx=0 tx=0).stop 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 shutdown_connections 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eff11b3da0 0x55eff1650140 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff11ff390 0x55eff15d52a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1220070 0x55eff15d57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 --2- 172.21.15.2:0/3187072432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff11f71b0 0x55eff15d4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 >> 172.21.15.2:0/3187072432 conn(0x55eff1214460 msgr2=0x55eff15d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.136+0000 7f0b567fc640 0 client.16419 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 shutdown_connections 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7bc82740 1 -- 172.21.15.2:0/3187072432 wait complete. 2024-08-31T04:31:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7bc82740 20 client.16419 trim_cache size 0 max 16384 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:14.147 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 msgr2=0x7f0b5c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 0x7f0b5c0b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009da0 tx=0x7f0b60005f90 comp rx=0 tx=0).stop 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 msgr2=0x7f0b70199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9c0 tx=0x7f0b5800ee80 comp rx=0 tx=0).stop 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 shutdown_connections 2024-08-31T04:31:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b70108a90 0x7f0b70199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b70108140 0x7f0b70199330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0b5c0b4ca0 0x7f0b5c0b71b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 --2- 172.21.15.2:0/1260128949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b70102800 0x7f0b70198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.137+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 >> 172.21.15.2:0/1260128949 conn(0x7f0b700794d0 msgr2=0x7f0b701011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.138+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 shutdown_connections 2024-08-31T04:31:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:14.138+0000 7f0b7570d640 1 -- 172.21.15.2:0/1260128949 wait complete. 2024-08-31T04:31:14.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:14 smithi002 ceph-mon[18656]: pgmap v513: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:14.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 558177 11.93 MB/sec execute 154 sec latency 37.046 ms 2024-08-31T04:31:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:14 smithi064 ceph-mon[22007]: pgmap v513: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:14.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:14 smithi132 ceph-mon[22335]: pgmap v513: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 264 op/s 2024-08-31T04:31:14.914 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:31:14.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:31:15.178 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:15.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 560134 11.90 MB/sec execute 155 sec latency 55.290 ms 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 -- 172.21.15.2:0/1154180595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018102800 msgr2=0x7fc018102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/1154180595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018102800 0x7fc018102c10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc014009900 tx=0x7fc01402a410 comp rx=0 tx=0).stop 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 -- 172.21.15.2:0/1154180595 shutdown_connections 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/1154180595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018108a90 0x7fc01810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/1154180595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc018108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/1154180595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018102800 0x7fc018102c10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 -- 172.21.15.2:0/1154180595 >> 172.21.15.2:0/1154180595 conn(0x7fc0180794d0 msgr2=0x7fc0180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 -- 172.21.15.2:0/1154180595 shutdown_connections 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.687+0000 7fc01fc9d640 1 -- 172.21.15.2:0/1154180595 wait complete. 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 Processor -- start 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 -- start start 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 0x7fc01819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc01819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc018112710 con 0x7fc018108a90 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc018112590 con 0x7fc018108140 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01fc9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc018112890 con 0x7fc018102800 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01e23a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01e23a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37038/0 (socket says 172.21.15.2:37038) 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01e23a640 1 -- 172.21.15.2:0/3865850536 learned_addr learned my addr 172.21.15.2:0/3865850536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.688+0000 7fc01d238640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc01819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01da39640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 0x7fc01819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 -- 172.21.15.2:0/3865850536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 msgr2=0x7fc01819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 0x7fc01819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 -- 172.21.15.2:0/3865850536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 msgr2=0x7fc01819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc01819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 -- 172.21.15.2:0/3865850536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0181a01a0 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01da39640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 0x7fc01819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01d238640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc01819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01e23a640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc01000eb10 tx=0x7fc01000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010004b20 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc010004cc0 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0181a0490 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010010670 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.689+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a6bf0 con 0x7fc018108a90 2024-08-31T04:31:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.690+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018102c10 con 0x7fc018108a90 2024-08-31T04:31:15.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.694+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc010005000 con 0x7fc018108a90 2024-08-31T04:31:15.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.694+0000 7fc00effd640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 0x7fc0040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.694+0000 7fc01da39640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 0x7fc0040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.695+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fc0100e61a0 con 0x7fc018108a90 2024-08-31T04:31:15.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.695+0000 7fc01da39640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 0x7fc0040b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc014031440 tx=0x7fc014009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:15.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.697+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc010056130 con 0x7fc018108a90 2024-08-31T04:31:15.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.924+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc01819b360 con 0x7fc018108a90 2024-08-31T04:31:15.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.925+0000 7fc00effd640 1 -- 172.21.15.2:0/3865850536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11898 (secure 0 0 0) 0x7fc01819b360 con 0x7fc018108a90 2024-08-31T04:31:15.926 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:31:15.927 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-08-31T04:30:29:275763+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:30:28.725461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:31:15.927 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 msgr2=0x7fc0040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 0x7fc0040b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc014031440 tx=0x7fc014009680 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 msgr2=0x7fc01819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc01000eb10 tx=0x7fc01000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 shutdown_connections 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fc0040b4ca0 0x7fc0040b71b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc018108a90 0x7fc01819fa70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc018108140 0x7fc01819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 --2- 172.21.15.2:0/3865850536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc018102800 0x7fc01819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 >> 172.21.15.2:0/3865850536 conn(0x7fc0180794d0 msgr2=0x7fc018101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 shutdown_connections 2024-08-31T04:31:15.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:15.927+0000 7fc01fc9d640 1 -- 172.21.15.2:0/3865850536 wait complete. 2024-08-31T04:31:16.636 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:16 smithi002 ceph-mon[18656]: pgmap v514: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T04:31:16.636 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:16 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3865850536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:16.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:31:16.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 562156 11.91 MB/sec execute 156 sec latency 27.467 ms 2024-08-31T04:31:16.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:16 smithi064 ceph-mon[22007]: pgmap v514: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T04:31:16.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:16 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3865850536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:16 smithi132 ceph-mon[22335]: pgmap v514: 129 pgs: 129 active+clean; 361 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T04:31:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:16 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3865850536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:17.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 -- 172.21.15.2:0/1850274899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738108a90 msgr2=0x7f273810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 --2- 172.21.15.2:0/1850274899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738108a90 0x7f273810f2c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2730009ca0 tx=0x7f273002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 -- 172.21.15.2:0/1850274899 shutdown_connections 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 --2- 172.21.15.2:0/1850274899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738108a90 0x7f273810f2c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 --2- 172.21.15.2:0/1850274899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 0x7f2738108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 --2- 172.21.15.2:0/1850274899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738102800 0x7f2738102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 -- 172.21.15.2:0/1850274899 >> 172.21.15.2:0/1850274899 conn(0x7f27380794d0 msgr2=0x7f27380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 -- 172.21.15.2:0/1850274899 shutdown_connections 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.473+0000 7f273cb10640 1 -- 172.21.15.2:0/1850274899 wait complete. 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.474+0000 7f273cb10640 1 Processor -- start 2024-08-31T04:31:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.474+0000 7f273cb10640 1 -- start start 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.474+0000 7f273cb10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273cb10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 0x7f273819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273cb10640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738108a90 0x7f273819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273cb10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27381126f0 con 0x7f2738102800 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273cb10640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2738112570 con 0x7f2738108a90 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273cb10640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2738112870 con 0x7f2738108140 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37054/0 (socket says 172.21.15.2:37054) 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 -- 172.21.15.2:0/862862937 learned_addr learned my addr 172.21.15.2:0/862862937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f2735d9b640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 0x7f273819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f2736d9d640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738108a90 0x7f273819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 -- 172.21.15.2:0/862862937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 msgr2=0x7f273819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 0x7f273819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 -- 172.21.15.2:0/862862937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738108a90 msgr2=0x7f273819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738108a90 0x7f273819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 -- 172.21.15.2:0/862862937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27381a0140 con 0x7f2738102800 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.475+0000 7f273659c640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f272800e9f0 tx=0x7f272800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.476+0000 7f27277fe640 1 -- 172.21.15.2:0/862862937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272800cd80 con 0x7f2738102800 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.476+0000 7f27277fe640 1 -- 172.21.15.2:0/862862937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27280108e0 con 0x7f2738102800 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.476+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27381a0430 con 0x7f2738102800 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.476+0000 7f27277fe640 1 -- 172.21.15.2:0/862862937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728018980 con 0x7f2738102800 2024-08-31T04:31:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.476+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27381a6b90 con 0x7f2738102800 2024-08-31T04:31:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.478+0000 7f2743085740 1 Processor -- start 2024-08-31T04:31:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 -- start start 2024-08-31T04:31:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f27277fe640 1 -- 172.21.15.2:0/862862937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2728018b20 con 0x7f2738102800 2024-08-31T04:31:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d7e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dab0cf5680 con 0x55dab09d9070 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dab0ce4c10 con 0x55dab09b8390 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2743085740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dab0ce8bc0 con 0x55dab09b01b0 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37066/0 (socket says 172.21.15.2:37066) 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.479+0000 7f2736d9d640 1 -- 172.21.15.2:0/1298334812 learned_addr learned my addr 172.21.15.2:0/1298334812 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f273659c640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d7e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2735d9b640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 -- 172.21.15.2:0/1298334812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 msgr2=0x55dab0d7e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d7e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 -- 172.21.15.2:0/1298334812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 msgr2=0x55dab0d7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 -- 172.21.15.2:0/1298334812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab0a44650 con 0x55dab09d9070 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2735d9b640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2736d9d640 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f27300098b0 tx=0x7f27300098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336b3a90bbf7d8f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f27277fe640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 0x7f27200b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2724ff9640 1 -- 172.21.15.2:0/1298334812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730031e30 con 0x55dab09d9070 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2724ff9640 1 -- 172.21.15.2:0/1298334812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2730036030 con 0x55dab09d9070 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.480+0000 7f2724ff9640 1 -- 172.21.15.2:0/1298334812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730004310 con 0x55dab09d9070 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f273659c640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 0x7f27200b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f27277fe640 1 -- 172.21.15.2:0/862862937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f27280e5cc0 con 0x7f2738102800 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f2743085740 1 -- 172.21.15.2:0/1298334812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 msgr2=0x55dab0d7e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f2743085740 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f27300098b0 tx=0x7f27300098e0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f273659c640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 0x7f27200b72b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27280e3590 tx=0x7f27280e9720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f2743085740 1 -- 172.21.15.2:0/1298334812 shutdown_connections 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.481+0000 7f2743085740 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d7e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 --2- 172.21.15.2:0/1298334812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09d9070 0x55dab0d7e310 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- 172.21.15.2:0/1298334812 >> 172.21.15.2:0/1298334812 conn(0x55dab09cd460 msgr2=0x55dab0d7c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- 172.21.15.2:0/1298334812 shutdown_connections 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- 172.21.15.2:0/1298334812 wait complete. 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- start start 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 Processor -- start 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 0x55dab0d8de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 0x55dab0d99fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dab0b47700 con 0x55dab09b8390 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dab0c6b750 con 0x55dab09b01b0 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.482+0000 7f2743085740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dab0d90c70 con 0x55dab09d9070 2024-08-31T04:31:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2743085740 10 client.0 _ll_register_callbacks cb 0x55dab0c9ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 0x55dab0d8de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37072/0 (socket says 172.21.15.2:37072) 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 -- 172.21.15.2:0/2923695716 learned_addr learned my addr 172.21.15.2:0/2923695716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 0x55dab0d8de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34406/0 (socket says 172.21.15.2:34406) 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 0x55dab0d99fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 -- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 msgr2=0x55dab0d99fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 0x55dab0d99fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 -- 172.21.15.2:0/2923695716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 msgr2=0x55dab0d8de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 0x55dab0d8de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 -- 172.21.15.2:0/2923695716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab0ca4900 con 0x55dab09b8390 2024-08-31T04:31:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 0x55dab0d99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2735d9b640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f272c012750 tx=0x7f272c012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4065851c90b4a26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f271dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c012e60 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f272c004020 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.483+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2730036030 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f272c025050 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 10 client.16437 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab0d9ca30 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2730036030 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f272c003cd0 con 0x55dab09b8390 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 10 client.16437 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 10 client.16437 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 20 client.16437 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09979f0 0x55dab0d9ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 4 client.16437 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.484+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dab0cf75d0 con 0x55dab09979f0 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.485+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09979f0 0x55dab0d9ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.485+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09979f0 0x55dab0d9ff50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e544bc4e72623e5 server_cookie=7b85ea103b7de138 in_seq=0 out_seq=0 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.485+0000 7f271dffb640 10 client.16437 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f271dffb640 1 -- 172.21.15.2:0/2923695716 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dab0cf75d0 con 0x55dab09979f0 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f271dffb640 10 client.16437 handle_command_reply: tid=0 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 client.16437 shutdown 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 msgr2=0x55dab0d8e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f272c012750 tx=0x7f272c012c10 comp rx=0 tx=0).stop 2024-08-31T04:31:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 shutdown_connections 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09979f0 0x55dab0d9ff50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09b8390 0x55dab0d8e360 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09d9070 0x55dab0d99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 --2- 172.21.15.2:0/2923695716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b01b0 0x55dab0d8de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f271dffb640 0 client.16437 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.486+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 >> 172.21.15.2:0/2923695716 conn(0x55dab09cd460 msgr2=0x55dab0d7a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.487+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 shutdown_connections 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.487+0000 7f2743085740 1 -- 172.21.15.2:0/2923695716 wait complete. 2024-08-31T04:31:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.487+0000 7f2743085740 20 client.16437 trim_cache size 0 max 16384 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.516+0000 7f2743085740 1 Processor -- start 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.516+0000 7f2743085740 1 -- start start 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.516+0000 7f2743085740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2743085740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d99ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2743085740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d834b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2743085740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27381b14d0 con 0x55dab09979f0 2024-08-31T04:31:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2743085740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27381aed70 con 0x55dab09b8390 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2743085740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27381acbc0 con 0x55dab09b01b0 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2736d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37076/0 (socket says 172.21.15.2:37076) 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.517+0000 7f2736d9d640 1 -- 172.21.15.2:0/2478923127 learned_addr learned my addr 172.21.15.2:0/2478923127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.518+0000 7f2736d9d640 1 -- 172.21.15.2:0/2478923127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 msgr2=0x55dab0d99ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.518+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d99ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.518+0000 7f2736d9d640 1 -- 172.21.15.2:0/2478923127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 msgr2=0x55dab0d834b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.518+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d834b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.518+0000 7f2736d9d640 1 -- 172.21.15.2:0/2478923127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab0d90950 con 0x55dab09979f0 2024-08-31T04:31:17.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.519+0000 7f2736d9d640 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2730000f80 tx=0x7f273002f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c1dcc9d6058442 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.520+0000 7f271ffff640 1 -- 172.21.15.2:0/2478923127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730003a80 con 0x55dab09979f0 2024-08-31T04:31:17.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.520+0000 7f271ffff640 1 -- 172.21.15.2:0/2478923127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2730036040 con 0x55dab09979f0 2024-08-31T04:31:17.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.520+0000 7f271ffff640 1 -- 172.21.15.2:0/2478923127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730004380 con 0x55dab09979f0 2024-08-31T04:31:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.521+0000 7f2743085740 1 -- 172.21.15.2:0/2478923127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 msgr2=0x55dab0d7c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.521+0000 7f2743085740 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2730000f80 tx=0x7f273002f390 comp rx=0 tx=0).stop 2024-08-31T04:31:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 -- 172.21.15.2:0/2478923127 shutdown_connections 2024-08-31T04:31:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d834b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d99ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 --2- 172.21.15.2:0/2478923127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d7c250 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 -- 172.21.15.2:0/2478923127 >> 172.21.15.2:0/2478923127 conn(0x55dab09cd460 msgr2=0x55dab0d7bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 -- 172.21.15.2:0/2478923127 shutdown_connections 2024-08-31T04:31:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.522+0000 7f2743085740 1 -- 172.21.15.2:0/2478923127 wait complete. 2024-08-31T04:31:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.523+0000 7f2743085740 1 -- start start 2024-08-31T04:31:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.523+0000 7f2743085740 1 Processor -- start 2024-08-31T04:31:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d92f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ad230 con 0x55dab09979f0 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ae6a0 con 0x55dab09b8390 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ad900 con 0x55dab09b01b0 2024-08-31T04:31:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.524+0000 7f2743085740 10 client.0 _ll_register_callbacks cb 0x7f272c00a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.526+0000 7f2735d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.526+0000 7f2735d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53312/0 (socket says 172.21.15.2:53312) 2024-08-31T04:31:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.526+0000 7f2735d9b640 1 -- 172.21.15.2:0/576569949 learned_addr learned my addr 172.21.15.2:0/576569949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.526+0000 7f2736d9d640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.526+0000 7f2736d9d640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d92f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 -- 172.21.15.2:0/576569949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 msgr2=0x55dab0d92f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d92f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 -- 172.21.15.2:0/576569949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 msgr2=0x55dab0d96580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d96580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 -- 172.21.15.2:0/576569949 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab0d935c0 con 0x55dab09b01b0 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f2735d9b640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f272c0058c0 tx=0x7f272c01aa20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5aafc0ee26afed0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.527+0000 7f271dffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.528+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c0107a0 con 0x55dab09b01b0 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.528+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f272c01ab40 con 0x55dab09b01b0 2024-08-31T04:31:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.528+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2730036040 con 0x55dab09b01b0 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.528+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f272c038050 con 0x55dab09b01b0 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.529+0000 7f2743085740 10 client.25999 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.529+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab0e1c740 con 0x55dab09b01b0 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.529+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f272c010e90 con 0x55dab09b01b0 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.529+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f272c005260 con 0x55dab09b01b0 2024-08-31T04:31:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.529+0000 7f2743085740 10 client.25999 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.530+0000 7f2743085740 10 client.25999 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.530+0000 7f2743085740 20 client.25999 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.530+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09d9070 0x55dab0e1ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.530+0000 7f2743085740 4 client.25999 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.530+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2730036040 con 0x55dab09d9070 2024-08-31T04:31:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.531+0000 7f2736d9d640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09d9070 0x55dab0e1ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.536+0000 7f2736d9d640 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09d9070 0x55dab0e1ef80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc1b4ae9f73cc77e server_cookie=3eb2ddea2743e8e6 in_seq=0 out_seq=0 2024-08-31T04:31:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.536+0000 7f271dffb640 10 client.25999 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:31:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.536+0000 7f271dffb640 1 -- 172.21.15.2:0/576569949 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2730036040 con 0x55dab09d9070 2024-08-31T04:31:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.537+0000 7f271dffb640 10 client.25999 handle_command_reply: tid=0 2024-08-31T04:31:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.537+0000 7f2743085740 1 client.25999 shutdown 2024-08-31T04:31:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 msgr2=0x55dab0d92a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f272c0058c0 tx=0x7f272c01aa20 comp rx=0 tx=0).stop 2024-08-31T04:31:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 shutdown_connections 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55dab09d9070 0x55dab0e1ef80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dab09b8390 0x55dab0d92f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dab09b01b0 0x55dab0d92a40 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f272c0058c0 tx=0x7f272c01aa20 comp rx=0 tx=0).stop 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 --2- 172.21.15.2:0/576569949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dab09979f0 0x55dab0d96580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 >> 172.21.15.2:0/576569949 conn(0x55dab09cd460 msgr2=0x55dab0d834b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.538+0000 7f271dffb640 0 client.25999 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:31:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.542+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 shutdown_connections 2024-08-31T04:31:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.544+0000 7f2743085740 1 -- 172.21.15.2:0/576569949 wait complete. 2024-08-31T04:31:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.545+0000 7f2743085740 20 client.25999 trim_cache size 0 max 16384 2024-08-31T04:31:17.546 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:31:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.548+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 msgr2=0x7f27200b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.548+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 0x7f27200b72b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27280e3590 tx=0x7f27280e9720 comp rx=0 tx=0).stop 2024-08-31T04:31:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.548+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 msgr2=0x7f273819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.548+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f272800e9f0 tx=0x7f272800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 shutdown_connections 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2738108a90 0x7f273819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2738108140 0x7f273819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f27200b4da0 0x7f27200b72b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 --2- 172.21.15.2:0/862862937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2738102800 0x7f273819a1d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 >> 172.21.15.2:0/862862937 conn(0x7f27380794d0 msgr2=0x7f273806af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 shutdown_connections 2024-08-31T04:31:17.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:17.549+0000 7f273cb10640 1 -- 172.21.15.2:0/862862937 wait complete. 2024-08-31T04:31:17.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 564168 11.91 MB/sec execute 157 sec latency 63.922 ms 2024-08-31T04:31:18.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:18 smithi002 ceph-mon[18656]: pgmap v515: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 266 op/s 2024-08-31T04:31:18.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:31:18.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:18 smithi132 ceph-mon[22335]: pgmap v515: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 266 op/s 2024-08-31T04:31:18.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 565787 11.88 MB/sec execute 158 sec latency 27.757 ms 2024-08-31T04:31:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:18 smithi064 ceph-mon[22007]: pgmap v515: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 266 op/s 2024-08-31T04:31:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:19.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 -- 172.21.15.2:0/3825456885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108150 msgr2=0x7f12f8108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 --2- 172.21.15.2:0/3825456885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108150 0x7f12f8108560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009900 tx=0x7f12e802a410 comp rx=0 tx=0).stop 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 -- 172.21.15.2:0/3825456885 shutdown_connections 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 --2- 172.21.15.2:0/3825456885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8108aa0 0x7f12f810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 --2- 172.21.15.2:0/3825456885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108150 0x7f12f8108560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 --2- 172.21.15.2:0/3825456885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8102810 0x7f12f8102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.499+0000 7f12ff414640 1 -- 172.21.15.2:0/3825456885 >> 172.21.15.2:0/3825456885 conn(0x7f12f80794d0 msgr2=0x7f12f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.500+0000 7f12ff414640 1 -- 172.21.15.2:0/3825456885 shutdown_connections 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.500+0000 7f12ff414640 1 -- 172.21.15.2:0/3825456885 wait complete. 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.500+0000 7f12ff414640 1 Processor -- start 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.500+0000 7f12ff414640 1 -- start start 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 0x7f12f819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108aa0 0x7f12f819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81126d0 con 0x7f12f8108150 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8112550 con 0x7f12f8108aa0 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12ff414640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8112850 con 0x7f12f8102810 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 0x7f12f819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37106/0 (socket says 172.21.15.2:37106) 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 0x7f12f819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53336/0 (socket says 172.21.15.2:53336) 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 -- 172.21.15.2:0/3960810077 learned_addr learned my addr 172.21.15.2:0/3960810077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108aa0 0x7f12f819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 -- 172.21.15.2:0/3960810077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 msgr2=0x7f12f819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 0x7f12f819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 -- 172.21.15.2:0/3960810077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108aa0 msgr2=0x7f12f819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108aa0 0x7f12f819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.501+0000 7f12fc9af640 1 -- 172.21.15.2:0/3960810077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f81a6370 con 0x7f12f8108150 2024-08-31T04:31:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f12e8032fd0 tx=0x7f12e8031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12ee7fc640 1 -- 172.21.15.2:0/3960810077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e803f030 con 0x7f12f8108150 2024-08-31T04:31:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f81a6600 con 0x7f12f8108150 2024-08-31T04:31:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f81a6b30 con 0x7f12f8108150 2024-08-31T04:31:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12ee7fc640 1 -- 172.21.15.2:0/3960810077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12e80043d0 con 0x7f12f8108150 2024-08-31T04:31:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.502+0000 7f12ee7fc640 1 -- 172.21.15.2:0/3960810077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8035070 con 0x7f12f8108150 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f12ee7fc640 1 -- 172.21.15.2:0/3960810077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f12e8042030 con 0x7f12f8108150 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 Processor -- start 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 -- start start 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 0x55eff18ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 0x55eff18ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eff1823680 con 0x55eff14e6390 2024-08-31T04:31:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eff1812c10 con 0x55eff1507070 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f1305989740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eff1816bc0 con 0x55eff14de1b0 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.505+0000 7f12fd9b1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 0x55eff18ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 0x55eff18ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd9b1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 0x55eff18ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34452/0 (socket says 172.21.15.2:34452) 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd9b1640 1 -- 172.21.15.2:0/837046882 learned_addr learned my addr 172.21.15.2:0/837046882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12ee7fc640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 0x7f12e40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 -- 172.21.15.2:0/837046882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 msgr2=0x55eff18ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 0x55eff18ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 -- 172.21.15.2:0/837046882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 msgr2=0x55eff18acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 -- 172.21.15.2:0/837046882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff1572650 con 0x55eff14de1b0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12ee7fc640 1 -- 172.21.15.2:0/3960810077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f12e8105bb0 con 0x7f12f8108150 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 0x55eff18ac850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009bf0 tx=0x7f12f4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cbc4dda6a4dc3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12e37fe640 1 -- 172.21.15.2:0/837046882 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4004050 con 0x55eff14de1b0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.506+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 0x7f12e40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.507+0000 7f12e37fe640 1 -- 172.21.15.2:0/837046882 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f40054d0 con 0x55eff14de1b0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.507+0000 7f12e37fe640 1 -- 172.21.15.2:0/837046882 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4004d60 con 0x55eff14de1b0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- 172.21.15.2:0/837046882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 msgr2=0x55eff18ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 0x55eff18ac850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009bf0 tx=0x7f12f4011810 comp rx=0 tx=0).stop 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 0x7f12e40b7260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f12f00105d0 tx=0x7f12f0004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- 172.21.15.2:0/837046882 shutdown_connections 2024-08-31T04:31:19.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14de1b0 0x55eff18ac850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 --2- 172.21.15.2:0/837046882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff1507070 0x55eff18ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- 172.21.15.2:0/837046882 >> 172.21.15.2:0/837046882 conn(0x55eff14fb460 msgr2=0x55eff18aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- 172.21.15.2:0/837046882 shutdown_connections 2024-08-31T04:31:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- 172.21.15.2:0/837046882 wait complete. 2024-08-31T04:31:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.508+0000 7f1305989740 1 -- start start 2024-08-31T04:31:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 Processor -- start 2024-08-31T04:31:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 0x55eff18c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eff1675700 con 0x55eff14e6390 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eff1799750 con 0x55eff14de1b0 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eff18baaf0 con 0x55eff1507070 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f1305989740 10 client.0 _ll_register_callbacks cb 0x55eff17c8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fd9b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 0x55eff18c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18b7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37126/0 (socket says 172.21.15.2:37126) 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34464/0 (socket says 172.21.15.2:34464) 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.509+0000 7f12fc9af640 1 -- 172.21.15.2:0/2502913795 learned_addr learned my addr 172.21.15.2:0/2502913795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 -- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 msgr2=0x55eff18b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 -- 172.21.15.2:0/2502913795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 msgr2=0x55eff18b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 -- 172.21.15.2:0/2502913795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff17d2900 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 0x55eff18c3e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12f000fc90 tx=0x7f12f0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef3f5c2194798dba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0027600 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f12f00277a0 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12f40054d0 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12f0032050 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f1305989740 10 client.26011 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.510+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eff18c6900 con 0x55eff1507070 2024-08-31T04:31:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f40054d0 con 0x55eff1507070 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f12f001b890 con 0x55eff1507070 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 10 client.26011 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 10 client.26011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 20 client.26011 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff14c59f0 0x55eff18c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 4 client.26011 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eff18255d0 con 0x55eff14c59f0 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.511+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff14c59f0 0x55eff18c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.512+0000 7f12e0ff9640 10 client.26011 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:31:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.512+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff14c59f0 0x55eff18c9e40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5544201b8220b882 server_cookie=96c11c28e53d8508 in_seq=0 out_seq=0 2024-08-31T04:31:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f12e0ff9640 1 -- 172.21.15.2:0/2502913795 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eff18255d0 con 0x55eff14c59f0 2024-08-31T04:31:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f12e0ff9640 10 client.26011 handle_command_reply: tid=0 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 client.26011 shutdown 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 msgr2=0x55eff18c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 0x55eff18c3e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12f000fc90 tx=0x7f12f0004ab0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 shutdown_connections 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff14c59f0 0x55eff18c9e40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff1507070 0x55eff18c3e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f12e0ff9640 0 client.26011 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 --2- 172.21.15.2:0/2502913795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 >> 172.21.15.2:0/2502913795 conn(0x55eff14fb460 msgr2=0x55eff18af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 shutdown_connections 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 1 -- 172.21.15.2:0/2502913795 wait complete. 2024-08-31T04:31:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.513+0000 7f1305989740 20 client.26011 trim_cache size 0 max 16384 2024-08-31T04:31:19.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 Processor -- start 2024-08-31T04:31:19.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 -- start start 2024-08-31T04:31:19.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14c59f0 0x55eff18b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14e6390 0x55eff18c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b3870 con 0x55eff14de1b0 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b1110 con 0x55eff14c59f0 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f1305989740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81aef60 con 0x55eff14e6390 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37132/0 (socket says 172.21.15.2:37132) 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f12fc9af640 1 -- 172.21.15.2:0/3102376719 learned_addr learned my addr 172.21.15.2:0/3102376719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14c59f0 0x55eff18b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.527+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14e6390 0x55eff18c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 -- 172.21.15.2:0/3102376719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14e6390 msgr2=0x55eff18c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14e6390 0x55eff18c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 -- 172.21.15.2:0/3102376719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14c59f0 msgr2=0x55eff18b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14c59f0 0x55eff18b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 -- 172.21.15.2:0/3102376719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff18b5f90 con 0x55eff14de1b0 2024-08-31T04:31:19.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f12e8102f90 tx=0x7f12e8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c75aa7eb0440d9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12e2ffd640 1 -- 172.21.15.2:0/3102376719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8049070 con 0x55eff14de1b0 2024-08-31T04:31:19.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12e2ffd640 1 -- 172.21.15.2:0/3102376719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12e80cbbc0 con 0x55eff14de1b0 2024-08-31T04:31:19.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.528+0000 7f12e2ffd640 1 -- 172.21.15.2:0/3102376719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e80d4d10 con 0x55eff14de1b0 2024-08-31T04:31:19.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- 172.21.15.2:0/3102376719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 msgr2=0x55eff18c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f12e8102f90 tx=0x7f12e8009880 comp rx=0 tx=0).stop 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- 172.21.15.2:0/3102376719 shutdown_connections 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14de1b0 0x55eff18c3d10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14e6390 0x55eff18c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 --2- 172.21.15.2:0/3102376719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14c59f0 0x55eff18b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- 172.21.15.2:0/3102376719 >> 172.21.15.2:0/3102376719 conn(0x55eff14fb460 msgr2=0x55eff18b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- 172.21.15.2:0/3102376719 shutdown_connections 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- 172.21.15.2:0/3102376719 wait complete. 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.529+0000 7f1305989740 1 -- start start 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 Processor -- start 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18bced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81af5d0 con 0x55eff14e6390 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b0a40 con 0x55eff14de1b0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81afca0 con 0x55eff14c59f0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f1305989740 10 client.0 _ll_register_callbacks cb 0x7f12f0009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fd9b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18bced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fc9af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34488/0 (socket says 172.21.15.2:34488) 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fd1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53364/0 (socket says 172.21.15.2:53364) 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.530+0000 7f12fc9af640 1 -- 172.21.15.2:0/3762156316 learned_addr learned my addr 172.21.15.2:0/3762156316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 -- 172.21.15.2:0/3762156316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 msgr2=0x55eff18c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 -- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 msgr2=0x55eff18bc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 -- 172.21.15.2:0/3762156316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff18bd610 con 0x55eff14e6390 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fc9af640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12fd9b1640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18bced0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f12f001be50 tx=0x7f12f001b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350a63bea60c0a45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f003a070 con 0x55eff14e6390 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e80cbbc0 con 0x55eff14e6390 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f12f0036600 con 0x55eff14e6390 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12f000f870 con 0x55eff14e6390 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f1305989740 10 client.16461 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:19.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.531+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eff19356c0 con 0x55eff14e6390 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f001ccb0 con 0x55eff14e6390 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f12f0027520 con 0x55eff14e6390 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 10 client.16461 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 10 client.16461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 20 client.16461 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff1507070 0x55eff1937e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 4 client.16461 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f12e80cbbc0 con 0x55eff1507070 2024-08-31T04:31:19.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.532+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff1507070 0x55eff1937e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f12e0ff9640 10 client.16461 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:31:19.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f12fd1b0640 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff1507070 0x55eff1937e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1a61697d795135a server_cookie=4e57708163da20e4 in_seq=0 out_seq=0 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f12e0ff9640 1 -- 172.21.15.2:0/3762156316 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f12e80cbbc0 con 0x55eff1507070 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f12e0ff9640 10 client.16461 handle_command_reply: tid=0 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 client.16461 shutdown 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 msgr2=0x55eff18bced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18bced0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f12f001be50 tx=0x7f12f001b660 comp rx=0 tx=0).stop 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 shutdown_connections 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55eff1507070 0x55eff1937e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eff14e6390 0x55eff18bced0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eff14de1b0 0x55eff18bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 --2- 172.21.15.2:0/3762156316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eff14c59f0 0x55eff18c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 >> 172.21.15.2:0/3762156316 conn(0x55eff14fb460 msgr2=0x55eff18add00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.533+0000 7f12e0ff9640 0 client.16461 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:31:19.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 shutdown_connections 2024-08-31T04:31:19.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f1305989740 1 -- 172.21.15.2:0/3762156316 wait complete. 2024-08-31T04:31:19.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f1305989740 20 client.16461 trim_cache size 0 max 16384 2024-08-31T04:31:19.540 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 msgr2=0x7f12e40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 0x7f12e40b7260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f12f00105d0 tx=0x7f12f0004a40 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 msgr2=0x7f12f819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.534+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f12e8032fd0 tx=0x7f12e8031a20 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 shutdown_connections 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f12e40b4d50 0x7f12e40b7260 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8108150 0x7f12f819b620 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12f8108aa0 0x7f12f819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 --2- 172.21.15.2:0/3960810077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f8102810 0x7f12f819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 >> 172.21.15.2:0/3960810077 conn(0x7f12f80794d0 msgr2=0x7f12f8104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 shutdown_connections 2024-08-31T04:31:19.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:19.535+0000 7f12ff414640 1 -- 172.21.15.2:0/3960810077 wait complete. 2024-08-31T04:31:19.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 568318 11.91 MB/sec execute 159 sec latency 56.852 ms 2024-08-31T04:31:20.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:31:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:20.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:20 smithi002 ceph-mon[18656]: pgmap v516: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2024-08-31T04:31:20.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 569953 11.88 MB/sec execute 160 sec latency 29.782 ms 2024-08-31T04:31:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:20 smithi064 ceph-mon[22007]: pgmap v516: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2024-08-31T04:31:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:20 smithi132 ceph-mon[22335]: pgmap v516: 129 pgs: 129 active+clean; 371 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 -- 172.21.15.2:0/3948806098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90101e30 msgr2=0x7fac90102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 --2- 172.21.15.2:0/3948806098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90101e30 0x7fac90102240 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fac80009900 tx=0x7fac8002a410 comp rx=0 tx=0).stop 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 -- 172.21.15.2:0/3948806098 shutdown_connections 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 --2- 172.21.15.2:0/3948806098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106970 0x7fac90110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 --2- 172.21.15.2:0/3948806098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90106020 0x7fac90106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 --2- 172.21.15.2:0/3948806098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90101e30 0x7fac90102240 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 -- 172.21.15.2:0/3948806098 >> 172.21.15.2:0/3948806098 conn(0x7fac90077a00 msgr2=0x7fac90077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 -- 172.21.15.2:0/3948806098 shutdown_connections 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.085+0000 7fac96099640 1 -- 172.21.15.2:0/3948806098 wait complete. 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 Processor -- start 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 -- start start 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106020 0x7fac9019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90106970 0x7fac9019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac90113840 con 0x7fac90106970 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac901136c0 con 0x7fac90101e30 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac96099640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac901139c0 con 0x7fac90106020 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34506/0 (socket says 172.21.15.2:34506) 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac8f7fe640 1 -- 172.21.15.2:0/3646826649 learned_addr learned my addr 172.21.15.2:0/3646826649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac8ffff640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90106970 0x7fac9019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.086+0000 7fac8effd640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106020 0x7fac9019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 -- 172.21.15.2:0/3646826649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106020 msgr2=0x7fac9019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106020 0x7fac9019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 -- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90106970 msgr2=0x7fac9019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90106970 0x7fac9019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 -- 172.21.15.2:0/3646826649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac901a0200 con 0x7fac90101e30 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac80005940 tx=0x7fac800040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8cff9640 1 -- 172.21.15.2:0/3646826649 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8003f030 con 0x7fac90101e30 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac901a0490 con 0x7fac90101e30 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8cff9640 1 -- 172.21.15.2:0/3646826649 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac800044c0 con 0x7fac90101e30 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac8cff9640 1 -- 172.21.15.2:0/3646826649 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80035070 con 0x7fac90101e30 2024-08-31T04:31:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.087+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac901a6c50 con 0x7fac90101e30 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 Processor -- start 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 -- start start 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8cff9640 1 -- 172.21.15.2:0/3646826649 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fac80042030 con 0x7fac90101e30 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bb7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bb7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639b7b2e680 con 0x5639b77f1390 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5639b7b1dc10 con 0x5639b77e91b0 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac9c60e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5639b7b21bc0 con 0x5639b7812070 2024-08-31T04:31:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bb7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:34512/0 (socket says 172.21.15.2:34512) 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bb7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.090+0000 7fac8f7fe640 1 -- 172.21.15.2:0/154682280 learned_addr learned my addr 172.21.15.2:0/154682280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 -- 172.21.15.2:0/154682280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 msgr2=0x5639b7bb7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bb7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 -- 172.21.15.2:0/154682280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 msgr2=0x5639b7bb7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 -- 172.21.15.2:0/154682280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b787d650 con 0x5639b77f1390 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8ffff640 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bb7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8effd640 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bb7d90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fac900755c0 tx=0x7fac84011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec515a5bf0c9533 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8cff9640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 0x7fac780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac75ffb640 1 -- 172.21.15.2:0/154682280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84004050 con 0x5639b77f1390 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8cff9640 1 -- 172.21.15.2:0/3646826649 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac80105e20 con 0x7fac90101e30 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac8ffff640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 0x7fac780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac75ffb640 1 -- 172.21.15.2:0/154682280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac840054d0 con 0x5639b77f1390 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.091+0000 7fac75ffb640 1 -- 172.21.15.2:0/154682280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84004ba0 con 0x5639b77f1390 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 -- 172.21.15.2:0/154682280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 msgr2=0x5639b7bb7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac8ffff640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 0x7fac780b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac8800afd0 tx=0x7fac8800a4d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bb7d90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fac900755c0 tx=0x7fac84011810 comp rx=0 tx=0).stop 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 -- 172.21.15.2:0/154682280 shutdown_connections 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bb7d90 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bb7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 --2- 172.21.15.2:0/154682280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bb7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 -- 172.21.15.2:0/154682280 >> 172.21.15.2:0/154682280 conn(0x5639b7806460 msgr2=0x5639b7bb5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 -- 172.21.15.2:0/154682280 shutdown_connections 2024-08-31T04:31:21.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.092+0000 7fac9c60e740 1 -- 172.21.15.2:0/154682280 wait complete. 2024-08-31T04:31:21.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 -- start start 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 Processor -- start 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bcee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639b7980700 con 0x5639b77f1390 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5639b7aa4750 con 0x5639b77e91b0 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5639b7bc5af0 con 0x5639b7812070 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.093+0000 7fac9c60e740 10 client.0 _ll_register_callbacks cb 0x5639b7ad3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37190/0 (socket says 172.21.15.2:37190) 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 -- 172.21.15.2:0/3137922711 learned_addr learned my addr 172.21.15.2:0/3137922711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8ffff640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bcee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 -- 172.21.15.2:0/3137922711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 msgr2=0x5639b7bcee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bcee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 -- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 msgr2=0x5639b7bc2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bc2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 -- 172.21.15.2:0/3137922711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b7add900 con 0x5639b77f1390 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bc2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac8effd640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fac8401b040 tx=0x7fac84004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c759e45cd8e8c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac6effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84028070 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac840037f0 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.094+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac840054d0 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac8401d040 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 10 client.16473 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5639b7bd1890 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac840054d0 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fac84004de0 con 0x5639b77f1390 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 10 client.16473 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 20 client.16473 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b77d09f0 0x5639b7bd4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 4 client.16473 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639b7b305d0 con 0x5639b77d09f0 2024-08-31T04:31:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.095+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b77d09f0 0x5639b7bd4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.096+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b77d09f0 0x5639b7bd4c50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9b274fcdf7709fc server_cookie=6aef25b2c96cf307 in_seq=0 out_seq=0 2024-08-31T04:31:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.096+0000 7fac6effd640 10 client.16473 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac6effd640 1 -- 172.21.15.2:0/3137922711 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639b7b305d0 con 0x5639b77d09f0 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac6effd640 10 client.16473 handle_command_reply: tid=0 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 client.16473 shutdown 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 msgr2=0x5639b7bc2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fac8401b040 tx=0x7fac84004520 comp rx=0 tx=0).stop 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 shutdown_connections 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b77d09f0 0x5639b7bd4c50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc2f50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b7812070 0x5639b7bcee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac6effd640 0 client.16473 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 --2- 172.21.15.2:0/3137922711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77e91b0 0x5639b7bc2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 >> 172.21.15.2:0/3137922711 conn(0x5639b7806460 msgr2=0x5639b7bba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 shutdown_connections 2024-08-31T04:31:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.098+0000 7fac9c60e740 1 -- 172.21.15.2:0/3137922711 wait complete. 2024-08-31T04:31:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.099+0000 7fac9c60e740 20 client.16473 trim_cache size 0 max 16384 2024-08-31T04:31:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 Processor -- start 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 -- start start 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bbfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77f1390 0x5639b7bc0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac901b3790 con 0x5639b77d09f0 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac901b1030 con 0x5639b77f1390 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac9c60e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac901aee80 con 0x5639b77e91b0 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.112+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37196/0 (socket says 172.21.15.2:37196) 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 -- 172.21.15.2:0/2101488805 learned_addr learned my addr 172.21.15.2:0/2101488805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8ffff640 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77f1390 0x5639b7bc0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8effd640 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bbfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 -- 172.21.15.2:0/2101488805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 msgr2=0x5639b7bbfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bbfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 -- 172.21.15.2:0/2101488805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77f1390 msgr2=0x5639b7bc0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77f1390 0x5639b7bc0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 -- 172.21.15.2:0/2101488805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b7bc3ab0 con 0x5639b77d09f0 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fac80032a80 tx=0x7fac800b1f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a185b13e1df4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac757fa640 1 -- 172.21.15.2:0/2101488805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80049040 con 0x5639b77d09f0 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac757fa640 1 -- 172.21.15.2:0/2101488805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac800cbcb0 con 0x5639b77d09f0 2024-08-31T04:31:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.113+0000 7fac757fa640 1 -- 172.21.15.2:0/2101488805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80003de0 con 0x5639b77d09f0 2024-08-31T04:31:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 -- 172.21.15.2:0/2101488805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 msgr2=0x5639b7bced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fac80032a80 tx=0x7fac800b1f90 comp rx=0 tx=0).stop 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 -- 172.21.15.2:0/2101488805 shutdown_connections 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77f1390 0x5639b7bc0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bbfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 --2- 172.21.15.2:0/2101488805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77d09f0 0x5639b7bced10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 -- 172.21.15.2:0/2101488805 >> 172.21.15.2:0/2101488805 conn(0x5639b7806460 msgr2=0x5639b7bc1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 -- 172.21.15.2:0/2101488805 shutdown_connections 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.114+0000 7fac9c60e740 1 -- 172.21.15.2:0/2101488805 wait complete. 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 -- start start 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 Processor -- start 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 0x5639b7bc6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac901af4f0 con 0x5639b77f1390 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac901b0960 con 0x5639b77d09f0 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac901afbc0 con 0x5639b77e91b0 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac9c60e740 10 client.0 _ll_register_callbacks cb 0x7fac80109840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.115+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:53424/0 (socket says 172.21.15.2:53424) 2024-08-31T04:31:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 -- 172.21.15.2:0/123799050 learned_addr learned my addr 172.21.15.2:0/123799050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 0x5639b7bc6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 -- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 msgr2=0x5639b7bc6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 0x5639b7bc6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 -- 172.21.15.2:0/123799050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 msgr2=0x5639b7bc79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 -- 172.21.15.2:0/123799050 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b7c42af0 con 0x5639b77e91b0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8ffff640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 0x5639b7bc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac8effd640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac84023440 tx=0x7fac84005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6224b2dd262477cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac6effd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84028070 con 0x5639b77e91b0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7fac840239e0 con 0x5639b77e91b0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.116+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac800cbcb0 con 0x5639b77e91b0 2024-08-31T04:31:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac84005b90 con 0x5639b77e91b0 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 10 client.26029 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5639b7c43d70 con 0x5639b77e91b0 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac800cbcb0 con 0x5639b77e91b0 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fac8402d440 con 0x5639b77e91b0 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 10 client.26029 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 10 client.26029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 20 client.26029 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b7812070 0x5639b7c463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 4 client.26029 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639b7b2c070 con 0x5639b7812070 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.117+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b7812070 0x5639b7c463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.118+0000 7fac6effd640 10 client.26029 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.118+0000 7fac8f7fe640 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b7812070 0x5639b7c463a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b746472d70bfa4d6 server_cookie=86031dc95526cc1b in_seq=0 out_seq=0 2024-08-31T04:31:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac6effd640 1 -- 172.21.15.2:0/123799050 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639b7b2c070 con 0x5639b7812070 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac6effd640 10 client.26029 handle_command_reply: tid=0 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 client.26029 shutdown 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 msgr2=0x5639b7bc7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac84023440 tx=0x7fac84005f80 comp rx=0 tx=0).stop 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 shutdown_connections 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5639b7812070 0x5639b7c463a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.120+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639b77f1390 0x5639b7bc79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5639b77e91b0 0x5639b7bc7480 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 1 --2- 172.21.15.2:0/123799050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5639b77d09f0 0x5639b7bc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac6effd640 0 client.26029 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 >> 172.21.15.2:0/123799050 conn(0x5639b7806460 msgr2=0x5639b7bb8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 shutdown_connections 2024-08-31T04:31:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 1 -- 172.21.15.2:0/123799050 wait complete. 2024-08-31T04:31:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac9c60e740 20 client.26029 trim_cache size 0 max 16384 2024-08-31T04:31:21.126 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:31:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 msgr2=0x7fac780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 0x7fac780b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac8800afd0 tx=0x7fac8800a4d0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 msgr2=0x7fac9019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac80005940 tx=0x7fac800040c0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 shutdown_connections 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fac780b4ca0 0x7fac780b71b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90106970 0x7fac9019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac90106020 0x7fac9019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 --2- 172.21.15.2:0/3646826649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac90101e30 0x7fac9019a290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 >> 172.21.15.2:0/3646826649 conn(0x7fac90077a00 msgr2=0x7fac901072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 shutdown_connections 2024-08-31T04:31:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:21.121+0000 7fac96099640 1 -- 172.21.15.2:0/3646826649 wait complete. 2024-08-31T04:31:21.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 572206 11.89 MB/sec execute 161 sec latency 33.668 ms 2024-08-31T04:31:22.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:22 smithi064 ceph-mon[22007]: pgmap v517: 129 pgs: 129 active+clean; 374 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-08-31T04:31:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:22 smithi002 ceph-mon[18656]: pgmap v517: 129 pgs: 129 active+clean; 374 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-08-31T04:31:22.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 574088 11.85 MB/sec execute 162 sec latency 63.527 ms 2024-08-31T04:31:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:22 smithi132 ceph-mon[22335]: pgmap v517: 129 pgs: 129 active+clean; 374 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-08-31T04:31:22.863 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:31:22.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:31:23.126 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:23.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 575982 11.86 MB/sec execute 163 sec latency 122.324 ms 2024-08-31T04:31:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 -- 172.21.15.2:0/753670975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508077120 msgr2=0x7ff508075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 --2- 172.21.15.2:0/753670975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508077120 0x7ff508075550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009860 tx=0x7ff4f802a340 comp rx=0 tx=0).stop 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 -- 172.21.15.2:0/753670975 shutdown_connections 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 --2- 172.21.15.2:0/753670975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508075b70 0x7ff508075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 --2- 172.21.15.2:0/753670975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 0x7ff5081166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 --2- 172.21.15.2:0/753670975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508077120 0x7ff508075550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 -- 172.21.15.2:0/753670975 >> 172.21.15.2:0/753670975 conn(0x7ff5080ff3a0 msgr2=0x7ff5081017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 -- 172.21.15.2:0/753670975 shutdown_connections 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.661+0000 7ff50d85d640 1 -- 172.21.15.2:0/753670975 wait complete. 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.662+0000 7ff50d85d640 1 Processor -- start 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.662+0000 7ff50d85d640 1 -- start start 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508075b70 0x7ff5081a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 0x7ff5081a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff508119e40 con 0x7ff508077120 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff508119cc0 con 0x7ff508075b70 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff50d85d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff508119fc0 con 0x7ff508114200 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37220/0 (socket says 172.21.15.2:37220) 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 -- 172.21.15.2:0/2396362460 learned_addr learned my addr 172.21.15.2:0/2396362460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff506ffd640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508075b70 0x7ff5081a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5077fe640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 0x7ff5081a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 -- 172.21.15.2:0/2396362460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 msgr2=0x7ff5081a6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 0x7ff5081a6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 -- 172.21.15.2:0/2396362460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508075b70 msgr2=0x7ff5081a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508075b70 0x7ff5081a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 -- 172.21.15.2:0/2396362460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5081a6780 con 0x7ff508077120 2024-08-31T04:31:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.663+0000 7ff5067fc640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00e9f0 tx=0x7ff4fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.664+0000 7ff50c85b640 1 -- 172.21.15.2:0/2396362460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00ccc0 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.664+0000 7ff50c85b640 1 -- 172.21.15.2:0/2396362460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4fc0108e0 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.664+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5081a6a70 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.664+0000 7ff50c85b640 1 -- 172.21.15.2:0/2396362460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc018880 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.664+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081ad1d0 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 Processor -- start 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 -- start start 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff50c85b640 1 -- 172.21.15.2:0/2396362460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff4fc018a20 con 0x7ff508077120 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b17cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7750670 0x560dd7b18200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560dd7a8d5f0 con 0x560dd7771350 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560dd7a7cb80 con 0x560dd7748490 2024-08-31T04:31:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.666+0000 7ff513dd2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560dd7a80b30 con 0x560dd7750670 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37236/0 (socket says 172.21.15.2:37236) 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5077fe640 1 -- 172.21.15.2:0/2681668063 learned_addr learned my addr 172.21.15.2:0/2681668063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b17cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5067fc640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7750670 0x560dd7b18200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 -- 172.21.15.2:0/2681668063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7750670 msgr2=0x560dd7b18200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7750670 0x560dd7b18200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 -- 172.21.15.2:0/2681668063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 msgr2=0x560dd7b17780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 -- 172.21.15.2:0/2681668063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd77dc930 con 0x560dd7748490 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5077fe640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff506ffd640 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b17cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005940 tx=0x7ff4f8005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=571ec9196fcf8dd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff50c85b640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 0x7ff4f00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff5077fe640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 0x7ff4f00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.667+0000 7ff4edffb640 1 -- 172.21.15.2:0/2681668063 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8041070 con 0x560dd7748490 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff4edffb640 1 -- 172.21.15.2:0/2681668063 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f80044d0 con 0x560dd7748490 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff50c85b640 1 -- 172.21.15.2:0/2396362460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff4fc0e5b90 con 0x7ff508077120 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff4edffb640 1 -- 172.21.15.2:0/2681668063 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8037040 con 0x560dd7748490 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff513dd2740 1 -- 172.21.15.2:0/2681668063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 msgr2=0x560dd7b17cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff5077fe640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 0x7ff4f00b7230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff500011890 tx=0x7ff500009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.668+0000 7ff513dd2740 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b17cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005940 tx=0x7ff4f8005d30 comp rx=0 tx=0).stop 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 -- 172.21.15.2:0/2681668063 shutdown_connections 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7750670 0x560dd7b18200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b17cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 --2- 172.21.15.2:0/2681668063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b17780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 -- 172.21.15.2:0/2681668063 >> 172.21.15.2:0/2681668063 conn(0x560dd7765740 msgr2=0x560dd7b15670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 -- 172.21.15.2:0/2681668063 shutdown_connections 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 -- 172.21.15.2:0/2681668063 wait complete. 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 -- start start 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.669+0000 7ff513dd2740 1 Processor -- start 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 0x560dd7b22ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b23430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560dd78df890 con 0x560dd7771350 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560dd7a03790 con 0x560dd7750670 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560dd7b25fa0 con 0x560dd7748490 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff513dd2740 10 client.0 _ll_register_callbacks cb 0x560dd7788ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37242/0 (socket says 172.21.15.2:37242) 2024-08-31T04:31:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b23430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 -- 172.21.15.2:0/3413305880 learned_addr learned my addr 172.21.15.2:0/3413305880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 0x560dd7b22ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 -- 172.21.15.2:0/3413305880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 msgr2=0x560dd7b22ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 0x560dd7b22ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 -- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 msgr2=0x560dd7b23430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b23430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 -- 172.21.15.2:0/3413305880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd7a3af30 con 0x560dd7771350 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 0x560dd7b22ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff5077fe640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff50000fbe0 tx=0x7ff500004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6954c078d1288bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.670+0000 7ff4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000fe50 con 0x560dd7771350 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f80044d0 con 0x560dd7771350 2024-08-31T04:31:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff500017030 con 0x560dd7771350 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff500004b20 con 0x560dd7771350 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 10 client.16491 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560dd7b31d90 con 0x560dd7771350 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f80044d0 con 0x560dd7771350 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ff500004030 con 0x560dd7771350 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 10 client.16491 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 20 client.16491 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd772fcd0 0x560dd7b35380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 4 client.16491 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.671+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dd7a8f540 con 0x560dd772fcd0 2024-08-31T04:31:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.672+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd772fcd0 0x560dd7b35380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.672+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd772fcd0 0x560dd7b35380 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e35b93c1951875c8 server_cookie=931bcc19bf7caff5 in_seq=0 out_seq=0 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.672+0000 7ff4e6ffd640 10 client.16491 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.673+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3413305880 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560dd7a8f540 con 0x560dd772fcd0 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.673+0000 7ff4e6ffd640 10 client.16491 handle_command_reply: tid=0 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.673+0000 7ff513dd2740 1 client.16491 shutdown 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 msgr2=0x560dd7b2f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff50000fbe0 tx=0x7ff500004ab0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 shutdown_connections 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd772fcd0 0x560dd7b35380 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7771350 0x560dd7b2f2c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b23430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3413305880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7748490 0x560dd7b22ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff4e6ffd640 0 client.16491 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 >> 172.21.15.2:0/3413305880 conn(0x560dd7765740 msgr2=0x560dd7b187b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 shutdown_connections 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 1 -- 172.21.15.2:0/3413305880 wait complete. 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.674+0000 7ff513dd2740 20 client.16491 trim_cache size 0 max 16384 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 Processor -- start 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 -- start start 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b14ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b9dc0 con 0x560dd7748490 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b7660 con 0x560dd7750670 2024-08-31T04:31:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff513dd2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b54b0 con 0x560dd7771350 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37254/0 (socket says 172.21.15.2:37254) 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 -- 172.21.15.2:0/301372613 learned_addr learned my addr 172.21.15.2:0/301372613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff5067fc640 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b14ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff5077fe640 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 -- 172.21.15.2:0/301372613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 msgr2=0x560dd7b151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 -- 172.21.15.2:0/301372613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 msgr2=0x560dd7b14ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.693+0000 7ff506ffd640 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b14ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.694+0000 7ff506ffd640 1 -- 172.21.15.2:0/301372613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd7b21e50 con 0x560dd7748490 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.694+0000 7ff506ffd640 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x560dd7b25bb0 tx=0x7ff4f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d51eb1d24ffd7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.694+0000 7ff4ed7fa640 1 -- 172.21.15.2:0/301372613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8037040 con 0x560dd7748490 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.694+0000 7ff4ed7fa640 1 -- 172.21.15.2:0/301372613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f8030900 con 0x560dd7748490 2024-08-31T04:31:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.694+0000 7ff4ed7fa640 1 -- 172.21.15.2:0/301372613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8041040 con 0x560dd7748490 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- 172.21.15.2:0/301372613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 msgr2=0x560dd7b18ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x560dd7b25bb0 tx=0x7ff4f8000bc0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- 172.21.15.2:0/301372613 shutdown_connections 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7750670 0x560dd7b14ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 --2- 172.21.15.2:0/301372613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7748490 0x560dd7b18ec0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- 172.21.15.2:0/301372613 >> 172.21.15.2:0/301372613 conn(0x560dd7765740 msgr2=0x560dd7b187b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- 172.21.15.2:0/301372613 shutdown_connections 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- 172.21.15.2:0/301372613 wait complete. 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 -- start start 2024-08-31T04:31:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.695+0000 7ff513dd2740 1 Processor -- start 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b27160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b27be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b5b20 con 0x560dd7750670 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b6f90 con 0x560dd7748490 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081b61f0 con 0x560dd7771350 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff513dd2740 10 client.0 _ll_register_callbacks cb 0x7ff500011e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37260/0 (socket says 172.21.15.2:37260) 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 -- 172.21.15.2:0/3320388024 learned_addr learned my addr 172.21.15.2:0/3320388024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff506ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b27160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5077fe640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b27be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 -- 172.21.15.2:0/3320388024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 msgr2=0x560dd7b27be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b27be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 -- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 msgr2=0x560dd7b27160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b27160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 -- 172.21.15.2:0/3320388024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd7b9ed80 con 0x560dd7750670 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b27160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff5067fc640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0abea0 tx=0x7ff4fc009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe347327d21a9873 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.696+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0aba20 con 0x560dd7750670 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff4fc0930b0 con 0x560dd7750670 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f8030900 con 0x560dd7750670 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff4fc0abf10 con 0x560dd7750670 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 10 client.16497 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560dd7ba0000 con 0x560dd7750670 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f8030900 con 0x560dd7750670 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ff4fc0ee040 con 0x560dd7750670 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 10 client.16497 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 20 client.16497 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd7705080 0x560dd7ba27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 4 client.16497 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.697+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560dd7a8afe0 con 0x560dd7705080 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.698+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd7705080 0x560dd7ba27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.698+0000 7ff506ffd640 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd7705080 0x560dd7ba27c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a13eb1e9b13e4e6 server_cookie=47f2487ac720f34e in_seq=0 out_seq=0 2024-08-31T04:31:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.698+0000 7ff4e6ffd640 10 client.16497 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "109ab462-ff90-4306-b2e5-e84968c31aa5", 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff4e6ffd640 1 -- 172.21.15.2:0/3320388024 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560dd7a8afe0 con 0x560dd7705080 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff4e6ffd640 10 client.16497 handle_command_reply: tid=0 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 client.16497 shutdown 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 msgr2=0x560dd7b276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0abea0 tx=0x7ff4fc009600 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 shutdown_connections 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560dd7705080 0x560dd7ba27c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd7750670 0x560dd7b276a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560dd7771350 0x560dd7b27be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff4e6ffd640 0 client.16497 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 --2- 172.21.15.2:0/3320388024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560dd7748490 0x560dd7b27160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 >> 172.21.15.2:0/3320388024 conn(0x560dd7765740 msgr2=0x560dd7b19120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 shutdown_connections 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.701+0000 7ff513dd2740 1 -- 172.21.15.2:0/3320388024 wait complete. 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff513dd2740 20 client.16497 trim_cache size 0 max 16384 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 msgr2=0x7ff4f00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 0x7ff4f00b7230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff500011890 tx=0x7ff500009500 comp rx=0 tx=0).stop 2024-08-31T04:31:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 msgr2=0x7ff5081a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00e9f0 tx=0x7ff4fc00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 shutdown_connections 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff4f00b4d20 0x7ff4f00b7230 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff508077120 0x7ff5081a0db0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff508114200 0x7ff5081a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 --2- 172.21.15.2:0/2396362460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff508075b70 0x7ff5081a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 >> 172.21.15.2:0/2396362460 conn(0x7ff5080ff3a0 msgr2=0x7ff508110100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 shutdown_connections 2024-08-31T04:31:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:23.702+0000 7ff50d85d640 1 -- 172.21.15.2:0/2396362460 wait complete. 2024-08-31T04:31:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:24 smithi002 ceph-mon[18656]: pgmap v518: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2024-08-31T04:31:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:24 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:31:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:24 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:24.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 577858 11.83 MB/sec execute 164 sec latency 67.669 ms 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:24 smithi064 ceph-mon[22007]: pgmap v518: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:24 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:24 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:24 smithi132 ceph-mon[22335]: pgmap v518: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:24 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:31:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:24 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:24.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:31:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:25.568 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:25 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:31:25.568 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:25 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:25.568 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:25 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:31:25.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:25 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 -- 172.21.15.2:0/2100551601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc109250 msgr2=0x7efcdc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 --2- 172.21.15.2:0/2100551601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc109250 0x7efcdc109660 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efccc009900 tx=0x7efccc02a410 comp rx=0 tx=0).stop 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 -- 172.21.15.2:0/2100551601 shutdown_connections 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 --2- 172.21.15.2:0/2100551601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc109250 0x7efcdc109660 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 --2- 172.21.15.2:0/2100551601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109ba0 0x7efcdc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 --2- 172.21.15.2:0/2100551601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc101d10 0x7efcdc102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 -- 172.21.15.2:0/2100551601 >> 172.21.15.2:0/2100551601 conn(0x7efcdc077a00 msgr2=0x7efcdc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 -- 172.21.15.2:0/2100551601 shutdown_connections 2024-08-31T04:31:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.673+0000 7efce46f4640 1 -- 172.21.15.2:0/2100551601 wait complete. 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.674+0000 7efce46f4640 1 Processor -- start 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.674+0000 7efce46f4640 1 -- start start 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109250 0x7efcdc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc109ba0 0x7efcdc103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc113860 con 0x7efcdc101d10 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc1136e0 con 0x7efcdc109250 2024-08-31T04:31:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce46f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc1139e0 con 0x7efcdc109ba0 2024-08-31T04:31:25.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 579785 11.84 MB/sec execute 165 sec latency 36.095 ms 2024-08-31T04:31:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47798/0 (socket says 172.21.15.2:47798) 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 -- 172.21.15.2:0/1561791733 learned_addr learned my addr 172.21.15.2:0/1561791733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce1c8f640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109250 0x7efcdc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2c91640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc109ba0 0x7efcdc103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 -- 172.21.15.2:0/1561791733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc109ba0 msgr2=0x7efcdc103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc109ba0 0x7efcdc103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 -- 172.21.15.2:0/1561791733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109250 msgr2=0x7efcdc1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109250 0x7efcdc1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.675+0000 7efce2490640 1 -- 172.21.15.2:0/1561791733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc1a84f0 con 0x7efcdc101d10 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efce2490640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009fd0 tx=0x7efcd800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efcd37fe640 1 -- 172.21.15.2:0/1561791733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8024070 con 0x7efcdc101d10 2024-08-31T04:31:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcdc199fa0 con 0x7efcdc101d10 2024-08-31T04:31:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc19a500 con 0x7efcdc101d10 2024-08-31T04:31:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efcd37fe640 1 -- 172.21.15.2:0/1561791733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcd801f440 con 0x7efcdc101d10 2024-08-31T04:31:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.676+0000 7efcd37fe640 1 -- 172.21.15.2:0/1561791733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd801d5a0 con 0x7efcdc101d10 2024-08-31T04:31:25.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.679+0000 7efceac69740 1 Processor -- start 2024-08-31T04:31:25.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 -- start start 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efcd37fe640 1 -- 172.21.15.2:0/1561791733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7efcd8027070 con 0x7efcdc101d10 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba191800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba191d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5613ba108630 con 0x5613b9dc31b0 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5613ba0f7bc0 con 0x5613b9dec070 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efceac69740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5613ba0fbb70 con 0x5613b9dcb390 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efce2c91640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efce1c8f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba191d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efce2c91640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40970/0 (socket says 172.21.15.2:40970) 2024-08-31T04:31:25.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efce2c91640 1 -- 172.21.15.2:0/1549605353 learned_addr learned my addr 172.21.15.2:0/1549605353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:25.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.680+0000 7efce2490640 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba191800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 -- 172.21.15.2:0/1549605353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 msgr2=0x5613ba191d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba191d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 -- 172.21.15.2:0/1549605353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 msgr2=0x5613ba191800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba191800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 -- 172.21.15.2:0/1549605353 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b9e57650 con 0x5613b9dec070 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efcd37fe640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 0x7efcc80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2c91640 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009fd0 tx=0x7efcd40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2cd08db1acf64e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efce2490640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 0x7efcc80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efcd37fe640 1 -- 172.21.15.2:0/1561791733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7efcd80edb30 con 0x7efcdc101d10 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.681+0000 7efcd0ff9640 1 -- 172.21.15.2:0/1549605353 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004d20 con 0x5613b9dec070 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.682+0000 7efcd0ff9640 1 -- 172.21.15.2:0/1549605353 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcd4004050 con 0x5613b9dec070 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.682+0000 7efcd0ff9640 1 -- 172.21.15.2:0/1549605353 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4005280 con 0x5613b9dec070 2024-08-31T04:31:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 -- 172.21.15.2:0/1549605353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 msgr2=0x5613ba1912c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efce2490640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 0x7efcc80b7230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcd80eaf10 tx=0x7efcd80f15d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009fd0 tx=0x7efcd40118d0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 -- 172.21.15.2:0/1549605353 shutdown_connections 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba191800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba191d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 --2- 172.21.15.2:0/1549605353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1912c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 -- 172.21.15.2:0/1549605353 >> 172.21.15.2:0/1549605353 conn(0x5613b9de0460 msgr2=0x5613ba18f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 -- 172.21.15.2:0/1549605353 shutdown_connections 2024-08-31T04:31:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.683+0000 7efceac69740 1 -- 172.21.15.2:0/1549605353 wait complete. 2024-08-31T04:31:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 -- start start 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 Processor -- start 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5613b9f5a700 con 0x5613b9dcb390 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5613ba07e700 con 0x5613b9dec070 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5613ba19faa0 con 0x5613b9dc31b0 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efceac69740 10 client.0 _ll_register_callbacks cb 0x5613ba0addc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efce1c8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efce2c91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efce1c8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba19cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47816/0 (socket says 172.21.15.2:47816) 2024-08-31T04:31:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efce2c91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:37850/0 (socket says 172.21.15.2:37850) 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.684+0000 7efce1c8f640 1 -- 172.21.15.2:0/3258811926 learned_addr learned my addr 172.21.15.2:0/3258811926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 -- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 msgr2=0x5613ba1a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 -- 172.21.15.2:0/3258811926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 msgr2=0x5613ba19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 -- 172.21.15.2:0/3258811926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ba0b78b0 con 0x5613b9dc31b0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efce2c91640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcd4003fd0 tx=0x7efcd4009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5657562c2658cbe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efcc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.685+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd402c020 con 0x5613b9dc31b0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7efcd400f4e0 con 0x5613b9dc31b0 2024-08-31T04:31:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd4004050 con 0x5613b9dc31b0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efcd4037050 con 0x5613b9dc31b0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 10 client.26059 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5613ba1ab810 con 0x5613b9dc31b0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcd4004050 con 0x5613b9dc31b0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7efcd4028470 con 0x5613b9dc31b0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 10 client.26059 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 10 client.26059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 20 client.26059 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9daa9f0 0x5613ba1aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 4 client.26059 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.686+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613ba10a580 con 0x5613b9daa9f0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.687+0000 7efce1c8f640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9daa9f0 0x5613ba1aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.687+0000 7efcc5ffb640 10 client.26059 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.687+0000 7efce1c8f640 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9daa9f0 0x5613ba1aec80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6a6cdf967c962d server_cookie=3c6f8b700c995faa in_seq=0 out_seq=0 2024-08-31T04:31:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.688+0000 7efcc5ffb640 1 -- 172.21.15.2:0/3258811926 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613ba10a580 con 0x5613b9daa9f0 2024-08-31T04:31:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.688+0000 7efcc5ffb640 10 client.26059 handle_command_reply: tid=0 2024-08-31T04:31:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.688+0000 7efceac69740 1 client.26059 shutdown 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 msgr2=0x5613ba19ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcd4003fd0 tx=0x7efcd4009be0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 shutdown_connections 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9daa9f0 0x5613ba1aec80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 --2- 172.21.15.2:0/3258811926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dc31b0 0x5613ba19ca60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 >> 172.21.15.2:0/3258811926 conn(0x5613b9de0460 msgr2=0x5613ba194450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efcc5ffb640 0 client.26059 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 shutdown_connections 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 1 -- 172.21.15.2:0/3258811926 wait complete. 2024-08-31T04:31:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.689+0000 7efceac69740 20 client.26059 trim_cache size 0 max 16384 2024-08-31T04:31:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.710+0000 7efceac69740 1 Processor -- start 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.710+0000 7efceac69740 1 -- start start 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba1a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0012ab0 con 0x5613b9dc31b0 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0010350 con 0x5613b9dec070 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efceac69740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efcc000e1a0 con 0x5613b9dcb390 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47824/0 (socket says 172.21.15.2:47824) 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 -- 172.21.15.2:0/3832431212 learned_addr learned my addr 172.21.15.2:0/3832431212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce1c8f640 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba1a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 -- 172.21.15.2:0/3832431212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 msgr2=0x5613ba1a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba1a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 -- 172.21.15.2:0/3832431212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 msgr2=0x5613ba1943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.711+0000 7efce2c91640 1 -- 172.21.15.2:0/3832431212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ba18faa0 con 0x5613b9dc31b0 2024-08-31T04:31:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.712+0000 7efce2c91640 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009560 tx=0x7efcd4004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfeb79f83981306 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.712+0000 7efcc7fff640 1 -- 172.21.15.2:0/3832431212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd402c070 con 0x5613b9dc31b0 2024-08-31T04:31:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.712+0000 7efcc7fff640 1 -- 172.21.15.2:0/3832431212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcd4003b30 con 0x5613b9dc31b0 2024-08-31T04:31:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.712+0000 7efcc7fff640 1 -- 172.21.15.2:0/3832431212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004bf0 con 0x5613b9dc31b0 2024-08-31T04:31:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 -- 172.21.15.2:0/3832431212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 msgr2=0x5613ba19cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009560 tx=0x7efcd4004000 comp rx=0 tx=0).stop 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 -- 172.21.15.2:0/3832431212 shutdown_connections 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dec070 0x5613ba1943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dcb390 0x5613ba1a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 --2- 172.21.15.2:0/3832431212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dc31b0 0x5613ba19cf20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 -- 172.21.15.2:0/3832431212 >> 172.21.15.2:0/3832431212 conn(0x5613b9de0460 msgr2=0x5613ba19c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 -- 172.21.15.2:0/3832431212 shutdown_connections 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.713+0000 7efceac69740 1 -- 172.21.15.2:0/3832431212 wait complete. 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 -- start start 2024-08-31T04:31:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 Processor -- start 2024-08-31T04:31:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dc31b0 0x5613ba1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dec070 0x5613ba1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcc000e810 con 0x5613b9dcb390 2024-08-31T04:31:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efcc000fc80 con 0x5613b9dc31b0 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efcc000eee0 con 0x5613b9dec070 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efceac69740 10 client.0 _ll_register_callbacks cb 0x7efcd40098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efce1c8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efce1c8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47830/0 (socket says 172.21.15.2:47830) 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efce1c8f640 1 -- 172.21.15.2:0/857880764 learned_addr learned my addr 172.21.15.2:0/857880764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efce2c91640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dc31b0 0x5613ba1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.714+0000 7efce2c91640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dec070 0x5613ba1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 -- 172.21.15.2:0/857880764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dec070 msgr2=0x5613ba1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dec070 0x5613ba1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 -- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dc31b0 msgr2=0x5613ba1a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dc31b0 0x5613ba1a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 -- 172.21.15.2:0/857880764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ba2186b0 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efce1c8f640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efcdc075850 tx=0x7efccc032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b97bd43bfb7f69e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efcc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc035040 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7efccc005040 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd4003b30 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efccc056050 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efceac69740 10 client.16515 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.715+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5613ba2199d0 con 0x5613b9dcb390 2024-08-31T04:31:25.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcd4003b30 con 0x5613b9dcb390 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7efccc0035f0 con 0x5613b9dcb390 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 10 client.16515 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 20 client.16515 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9d7fda0 0x5613ba21c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 4 client.16515 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613ba106020 con 0x5613b9d7fda0 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efce2c91640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9d7fda0 0x5613ba21c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efcc5ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.716+0000 7efce2c91640 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9d7fda0 0x5613ba21c210 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6b05dc0ef1b3b server_cookie=67ae8070c42c649d in_seq=0 out_seq=0 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efcc5ffb640 1 -- 172.21.15.2:0/857880764 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x5613ba106020 con 0x5613b9d7fda0 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efcc5ffb640 10 client.16515 handle_command_reply: tid=0 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 client.16515 shutdown 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 msgr2=0x5613ba1a13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efcdc075850 tx=0x7efccc032f90 comp rx=0 tx=0).stop 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 shutdown_connections 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5613b9d7fda0 0x5613ba21c210 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613b9dcb390 0x5613ba1a13d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5613b9dec070 0x5613ba1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 --2- 172.21.15.2:0/857880764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5613b9dc31b0 0x5613ba1a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efcc5ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.718+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 >> 172.21.15.2:0/857880764 conn(0x5613b9de0460 msgr2=0x5613ba194390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.719+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 shutdown_connections 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.719+0000 7efceac69740 1 -- 172.21.15.2:0/857880764 wait complete. 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.719+0000 7efceac69740 20 client.16515 trim_cache size 0 max 16384 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:31:25.725 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "109ab462-ff90-4306-b2e5-e84968c31aa5", 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.726 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.727 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.728 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.730 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:25.731 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:31:25.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 msgr2=0x7efcc80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 0x7efcc80b7230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcd80eaf10 tx=0x7efcd80f15d0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 msgr2=0x7efcdc102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009fd0 tx=0x7efcd800edd0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 shutdown_connections 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcdc109ba0 0x7efcdc103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc109250 0x7efcdc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efcc80b4d20 0x7efcc80b7230 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 --2- 172.21.15.2:0/1561791733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc101d10 0x7efcdc102cb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 >> 172.21.15.2:0/1561791733 conn(0x7efcdc077a00 msgr2=0x7efcdc1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 shutdown_connections 2024-08-31T04:31:25.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:25.720+0000 7efce46f4640 1 -- 172.21.15.2:0/1561791733 wait complete. 2024-08-31T04:31:25.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:25 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:31:25.897 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:25 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:25.898 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:25 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:31:25.898 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:25 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:25.898 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:25 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:31:25.898 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:25 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:25.899 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:25 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:31:25.899 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:25 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:31:26.404 INFO:tasks.cephfs.filesystem:scrub status for tag:109ab462-ff90-4306-b2e5-e84968c31aa5 - {'path': '/', 'tag': '109ab462-ff90-4306-b2e5-e84968c31aa5', 'options': 'recursive,force'} 2024-08-31T04:31:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:26 smithi002 ceph-mon[18656]: pgmap v519: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:31:26.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 582370 11.85 MB/sec execute 166 sec latency 35.591 ms 2024-08-31T04:31:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:26 smithi064 ceph-mon[22007]: pgmap v519: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:31:26.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:26 smithi132 ceph-mon[22335]: pgmap v519: 129 pgs: 129 active+clean; 378 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:31:27.676 INFO:tasks.workunit.client.0.smithi002.stdout: 1 584222 11.84 MB/sec execute 167 sec latency 29.801 ms 2024-08-31T04:31:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:28 smithi002 ceph-mon[18656]: pgmap v520: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.7 MiB/s wr, 302 op/s 2024-08-31T04:31:28.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 586343 11.85 MB/sec execute 168 sec latency 92.609 ms 2024-08-31T04:31:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:28 smithi064 ceph-mon[22007]: pgmap v520: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.7 MiB/s wr, 302 op/s 2024-08-31T04:31:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:28 smithi132 ceph-mon[22335]: pgmap v520: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.7 MiB/s wr, 302 op/s 2024-08-31T04:31:29.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 588441 11.82 MB/sec execute 169 sec latency 24.263 ms 2024-08-31T04:31:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:30 smithi002 ceph-mon[18656]: pgmap v521: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:30.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 590344 11.82 MB/sec execute 170 sec latency 29.223 ms 2024-08-31T04:31:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:30 smithi064 ceph-mon[22007]: pgmap v521: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:30 smithi132 ceph-mon[22335]: pgmap v521: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 210 op/s 2024-08-31T04:31:31.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 592888 11.84 MB/sec execute 171 sec latency 17.334 ms 2024-08-31T04:31:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:32 smithi002 ceph-mon[18656]: pgmap v522: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-31T04:31:32.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 594574 11.83 MB/sec execute 172 sec latency 35.215 ms 2024-08-31T04:31:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:32 smithi064 ceph-mon[22007]: pgmap v522: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-31T04:31:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:32 smithi132 ceph-mon[22335]: pgmap v522: 129 pgs: 129 active+clean; 386 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-31T04:31:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:33 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:31:33.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:33 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:31:33.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 596527 11.81 MB/sec execute 173 sec latency 48.748 ms 2024-08-31T04:31:33.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:33 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:31:33.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:33 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:31:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:33 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:31:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:33 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:31:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:34 smithi002 ceph-mon[18656]: pgmap v523: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-08-31T04:31:34.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 598096 11.80 MB/sec execute 174 sec latency 157.357 ms 2024-08-31T04:31:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:34 smithi064 ceph-mon[22007]: pgmap v523: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-08-31T04:31:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:34 smithi132 ceph-mon[22335]: pgmap v523: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-08-31T04:31:35.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 600471 11.81 MB/sec execute 175 sec latency 17.131 ms 2024-08-31T04:31:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:36 smithi002 ceph-mon[18656]: pgmap v524: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2024-08-31T04:31:36.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 602346 11.78 MB/sec execute 176 sec latency 27.773 ms 2024-08-31T04:31:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:36 smithi064 ceph-mon[22007]: pgmap v524: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2024-08-31T04:31:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:36 smithi132 ceph-mon[22335]: pgmap v524: 129 pgs: 129 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2024-08-31T04:31:37.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 604480 11.79 MB/sec execute 177 sec latency 48.194 ms 2024-08-31T04:31:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:38 smithi002 ceph-mon[18656]: pgmap v525: 129 pgs: 129 active+clean; 401 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2024-08-31T04:31:38.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 606290 11.76 MB/sec execute 178 sec latency 126.690 ms 2024-08-31T04:31:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:38 smithi064 ceph-mon[22007]: pgmap v525: 129 pgs: 129 active+clean; 401 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2024-08-31T04:31:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:38 smithi132 ceph-mon[22335]: pgmap v525: 129 pgs: 129 active+clean; 401 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2024-08-31T04:31:39.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 608258 11.77 MB/sec execute 179 sec latency 43.704 ms 2024-08-31T04:31:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:40 smithi002 ceph-mon[18656]: pgmap v526: 129 pgs: 129 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 196 op/s 2024-08-31T04:31:40.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 610965 11.80 MB/sec execute 180 sec latency 14.819 ms 2024-08-31T04:31:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:40 smithi064 ceph-mon[22007]: pgmap v526: 129 pgs: 129 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 196 op/s 2024-08-31T04:31:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:40 smithi132 ceph-mon[22335]: pgmap v526: 129 pgs: 129 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 196 op/s 2024-08-31T04:31:41.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 612599 11.77 MB/sec execute 181 sec latency 28.143 ms 2024-08-31T04:31:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:42 smithi002 ceph-mon[18656]: pgmap v527: 129 pgs: 129 active+clean; 405 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T04:31:42.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 614966 11.78 MB/sec execute 182 sec latency 12.747 ms 2024-08-31T04:31:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:42 smithi064 ceph-mon[22007]: pgmap v527: 129 pgs: 129 active+clean; 405 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T04:31:42.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:42 smithi132 ceph-mon[22335]: pgmap v527: 129 pgs: 129 active+clean; 405 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T04:31:43.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 616639 11.75 MB/sec execute 183 sec latency 127.844 ms 2024-08-31T04:31:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:44 smithi002 ceph-mon[18656]: pgmap v528: 129 pgs: 129 active+clean; 409 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 271 op/s 2024-08-31T04:31:44.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 618586 11.75 MB/sec execute 184 sec latency 35.036 ms 2024-08-31T04:31:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:44 smithi064 ceph-mon[22007]: pgmap v528: 129 pgs: 129 active+clean; 409 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 271 op/s 2024-08-31T04:31:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:44 smithi132 ceph-mon[22335]: pgmap v528: 129 pgs: 129 active+clean; 409 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 271 op/s 2024-08-31T04:31:45.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 620965 11.76 MB/sec execute 185 sec latency 43.081 ms 2024-08-31T04:31:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:46 smithi002 ceph-mon[18656]: pgmap v529: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 240 op/s 2024-08-31T04:31:46.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 622912 11.76 MB/sec execute 186 sec latency 17.357 ms 2024-08-31T04:31:46.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:46 smithi064 ceph-mon[22007]: pgmap v529: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 240 op/s 2024-08-31T04:31:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:46 smithi132 ceph-mon[22335]: pgmap v529: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 240 op/s 2024-08-31T04:31:47.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 625288 11.77 MB/sec execute 187 sec latency 17.321 ms 2024-08-31T04:31:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:48 smithi002 ceph-mon[18656]: pgmap v530: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 265 op/s 2024-08-31T04:31:48.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 626685 11.74 MB/sec execute 188 sec latency 72.190 ms 2024-08-31T04:31:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:48 smithi064 ceph-mon[22007]: pgmap v530: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 265 op/s 2024-08-31T04:31:48.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:48 smithi132 ceph-mon[22335]: pgmap v530: 129 pgs: 129 active+clean; 415 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 265 op/s 2024-08-31T04:31:49.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 628993 11.75 MB/sec execute 189 sec latency 37.206 ms 2024-08-31T04:31:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:50 smithi002 ceph-mon[18656]: pgmap v531: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 209 op/s 2024-08-31T04:31:50.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 631042 11.72 MB/sec execute 190 sec latency 31.804 ms 2024-08-31T04:31:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:50 smithi064 ceph-mon[22007]: pgmap v531: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 209 op/s 2024-08-31T04:31:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:50 smithi132 ceph-mon[22335]: pgmap v531: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 209 op/s 2024-08-31T04:31:51.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 632974 11.73 MB/sec execute 191 sec latency 21.634 ms 2024-08-31T04:31:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:52 smithi002 ceph-mon[18656]: pgmap v532: 129 pgs: 129 active+clean; 424 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 255 op/s 2024-08-31T04:31:52.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 635521 11.74 MB/sec execute 192 sec latency 28.943 ms 2024-08-31T04:31:52.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:52 smithi064 ceph-mon[22007]: pgmap v532: 129 pgs: 129 active+clean; 424 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 255 op/s 2024-08-31T04:31:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:52 smithi132 ceph-mon[22335]: pgmap v532: 129 pgs: 129 active+clean; 424 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 255 op/s 2024-08-31T04:31:53.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 637119 11.73 MB/sec execute 193 sec latency 77.228 ms 2024-08-31T04:31:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:54 smithi002 ceph-mon[18656]: pgmap v533: 129 pgs: 129 active+clean; 425 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T04:31:54.677 INFO:tasks.workunit.client.0.smithi002.stdout: 1 639405 11.73 MB/sec execute 194 sec latency 19.554 ms 2024-08-31T04:31:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:54 smithi064 ceph-mon[22007]: pgmap v533: 129 pgs: 129 active+clean; 425 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T04:31:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:54 smithi132 ceph-mon[22335]: pgmap v533: 129 pgs: 129 active+clean; 425 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T04:31:55.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 641146 11.71 MB/sec execute 195 sec latency 30.158 ms 2024-08-31T04:31:56.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:31:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:56 smithi002 ceph-mon[18656]: pgmap v534: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-08-31T04:31:56.673 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:56.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 643402 11.72 MB/sec execute 196 sec latency 20.443 ms 2024-08-31T04:31:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:56 smithi132 ceph-mon[22335]: pgmap v534: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-08-31T04:31:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:56 smithi064 ceph-mon[22007]: pgmap v534: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-08-31T04:31:57.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 -- 172.21.15.2:0/2196141097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c108a90 msgr2=0x7f759c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 --2- 172.21.15.2:0/2196141097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c108a90 0x7f759c10f2c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7594009ca0 tx=0x7f759402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 -- 172.21.15.2:0/2196141097 shutdown_connections 2024-08-31T04:31:57.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 --2- 172.21.15.2:0/2196141097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c108a90 0x7f759c10f2c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 --2- 172.21.15.2:0/2196141097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108140 0x7f759c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 --2- 172.21.15.2:0/2196141097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c102800 0x7f759c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 -- 172.21.15.2:0/2196141097 >> 172.21.15.2:0/2196141097 conn(0x7f759c0794d0 msgr2=0x7f759c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 -- 172.21.15.2:0/2196141097 shutdown_connections 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.154+0000 7f75a32dd640 1 -- 172.21.15.2:0/2196141097 wait complete. 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.155+0000 7f75a32dd640 1 Processor -- start 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.155+0000 7f75a32dd640 1 -- start start 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c102800 0x7f759c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108a90 0x7f759c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f759c112710 con 0x7f759c102800 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f759c112590 con 0x7f759c108140 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a32dd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f759c112890 con 0x7f759c108a90 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a1079640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c102800 0x7f759c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47374/0 (socket says 172.21.15.2:47374) 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 -- 172.21.15.2:0/1066633989 learned_addr learned my addr 172.21.15.2:0/1066633989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a187a640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108a90 0x7f759c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 -- 172.21.15.2:0/1066633989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108a90 msgr2=0x7f759c19fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108a90 0x7f759c19fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 -- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c102800 msgr2=0x7f759c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c102800 0x7f759c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 -- 172.21.15.2:0/1066633989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c1a0160 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.156+0000 7f75a0878640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9f0 tx=0x7f758c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.157+0000 7f75927fc640 1 -- 172.21.15.2:0/1066633989 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00ccc0 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.157+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c1a0450 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.157+0000 7f75927fc640 1 -- 172.21.15.2:0/1066633989 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f758c0054d0 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.157+0000 7f75927fc640 1 -- 172.21.15.2:0/1066633989 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c010430 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.157+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c1a6bb0 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.159+0000 7f75a9852740 1 Processor -- start 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75927fc640 1 -- 172.21.15.2:0/1066633989 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f758c0046c0 con 0x7f759c108140 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 -- start start 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 0x55a41efd42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 0x55a41efd4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efd4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a41ef4b630 con 0x55a41ec2f070 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a41ef3abc0 con 0x55a41ec0e390 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.160+0000 7f75a9852740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a41ef3eb70 con 0x55a41ec061b0 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a187a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 0x55a41efd42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75927fc640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 0x7f75880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 0x55a41efd4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a187a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 0x55a41efd42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46428/0 (socket says 172.21.15.2:46428) 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a187a640 1 -- 172.21.15.2:0/555102410 learned_addr learned my addr 172.21.15.2:0/555102410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a0878640 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efd4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75927fc640 1 -- 172.21.15.2:0/1066633989 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f758c0e5cb0 con 0x7f759c108140 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 -- 172.21.15.2:0/555102410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 msgr2=0x55a41efd4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efd4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 -- 172.21.15.2:0/555102410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 msgr2=0x55a41efd42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 0x55a41efd42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 -- 172.21.15.2:0/555102410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41ec9a650 con 0x55a41ec061b0 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a187a640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 0x7f75880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.161+0000 7f75a1079640 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 0x55a41efd4800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7598009c20 tx=0x7f7598011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91167d83f2bd3486 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.162+0000 7f75877fe640 1 -- 172.21.15.2:0/555102410 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759801e070 con 0x55a41ec061b0 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.162+0000 7f75877fe640 1 -- 172.21.15.2:0/555102410 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7598009dd0 con 0x55a41ec061b0 2024-08-31T04:31:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.162+0000 7f75877fe640 1 -- 172.21.15.2:0/555102410 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75980187d0 con 0x55a41ec061b0 2024-08-31T04:31:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 -- 172.21.15.2:0/555102410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 msgr2=0x55a41efd4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 0x55a41efd4800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7598009c20 tx=0x7f7598011810 comp rx=0 tx=0).stop 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a187a640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 0x7f75880b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7594035000 tx=0x7f75940095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 -- 172.21.15.2:0/555102410 shutdown_connections 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efd4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec061b0 0x55a41efd4800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 --2- 172.21.15.2:0/555102410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec2f070 0x55a41efd42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 -- 172.21.15.2:0/555102410 >> 172.21.15.2:0/555102410 conn(0x55a41ec23460 msgr2=0x55a41efd21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.163+0000 7f75a9852740 1 -- 172.21.15.2:0/555102410 shutdown_connections 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.164+0000 7f75a9852740 1 -- 172.21.15.2:0/555102410 wait complete. 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.164+0000 7f75a9852740 1 -- start start 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.164+0000 7f75a9852740 1 Processor -- start 2024-08-31T04:31:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 0x55a41efdfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec0e390 0x55a41efe0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a41ed9d700 con 0x55a41ec0e390 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a41eec1700 con 0x55a41ec061b0 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a41efe6eb0 con 0x55a41ec2f070 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a9852740 10 client.0 _ll_register_callbacks cb 0x55a41eef0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a0878640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec0e390 0x55a41efe0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.165+0000 7f75a1079640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 0x55a41efdfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:44284/0 (socket says 172.21.15.2:44284) 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 -- 172.21.15.2:0/3443885414 learned_addr learned my addr 172.21.15.2:0/3443885414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 -- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 msgr2=0x55a41efdfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 0x55a41efdfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 -- 172.21.15.2:0/3443885414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec0e390 msgr2=0x55a41efe0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec0e390 0x55a41efe0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 -- 172.21.15.2:0/3443885414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41eefa8b0 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a1079640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 0x55a41efdfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f75a187a640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7594031fc0 tx=0x7f759402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac764896e158febe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.166+0000 7f7584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594003b80 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f7594003d20 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7598009dd0 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f759405c050 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f75a9852740 10 client.26077 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a41eff2d30 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.167+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7598009dd0 con 0x55a41ec2f070 2024-08-31T04:31:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f759402f990 con 0x55a41ec2f070 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 10 client.26077 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 10 client.26077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 20 client.26077 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebed9f0 0x55a41eff6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 4 client.26077 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a41ef4d580 con 0x55a41ebed9f0 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.168+0000 7f75a1079640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebed9f0 0x55a41eff6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.169+0000 7f7584ff9640 10 client.26077 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.169+0000 7f75a1079640 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebed9f0 0x55a41eff6250 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636925598a834696 server_cookie=21c4cd4ef7f32a20 in_seq=0 out_seq=0 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.170+0000 7f7584ff9640 1 -- 172.21.15.2:0/3443885414 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a41ef4d580 con 0x55a41ebed9f0 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.170+0000 7f7584ff9640 10 client.26077 handle_command_reply: tid=0 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.170+0000 7f75a9852740 1 client.26077 shutdown 2024-08-31T04:31:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 msgr2=0x55a41eff01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7594031fc0 tx=0x7f759402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 shutdown_connections 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebed9f0 0x55a41eff6250 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec0e390 0x55a41efe0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff01d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 --2- 172.21.15.2:0/3443885414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec061b0 0x55a41efdfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f7584ff9640 0 client.26077 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 >> 172.21.15.2:0/3443885414 conn(0x55a41ec23460 msgr2=0x55a41efd74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 shutdown_connections 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 1 -- 172.21.15.2:0/3443885414 wait complete. 2024-08-31T04:31:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.171+0000 7f75a9852740 20 client.26077 trim_cache size 0 max 16384 2024-08-31T04:31:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.189+0000 7f75a9852740 1 Processor -- start 2024-08-31T04:31:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.189+0000 7f75a9852740 1 -- start start 2024-08-31T04:31:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41eff00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1b1600 con 0x55a41ec061b0 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1aeea0 con 0x55a41ec0e390 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a9852740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1accf0 con 0x55a41ec2f070 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46442/0 (socket says 172.21.15.2:46442) 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 -- 172.21.15.2:0/1725294422 learned_addr learned my addr 172.21.15.2:0/1725294422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a0878640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41eff00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a187a640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 -- 172.21.15.2:0/1725294422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 msgr2=0x55a41eff0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 -- 172.21.15.2:0/1725294422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 msgr2=0x55a41eff00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41eff00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a1079640 1 -- 172.21.15.2:0/1725294422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41efdea20 con 0x55a41ec061b0 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a0878640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41eff00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.190+0000 7f75a187a640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.191+0000 7f75a1079640 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7598014040 tx=0x7f75980183b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e1dadcce4c2d56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.191+0000 7f7586ffd640 1 -- 172.21.15.2:0/1725294422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598032070 con 0x55a41ec061b0 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.191+0000 7f7586ffd640 1 -- 172.21.15.2:0/1725294422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759802a070 con 0x55a41ec061b0 2024-08-31T04:31:57.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.191+0000 7f7586ffd640 1 -- 172.21.15.2:0/1725294422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759801e040 con 0x55a41ec061b0 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- 172.21.15.2:0/1725294422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 msgr2=0x55a41efd21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7598014040 tx=0x7f75980183b0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- 172.21.15.2:0/1725294422 shutdown_connections 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41eff0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41eff00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 --2- 172.21.15.2:0/1725294422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efd21e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- 172.21.15.2:0/1725294422 >> 172.21.15.2:0/1725294422 conn(0x55a41ec23460 msgr2=0x55a41efd1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- 172.21.15.2:0/1725294422 shutdown_connections 2024-08-31T04:31:57.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- 172.21.15.2:0/1725294422 wait complete. 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 -- start start 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.192+0000 7f75a9852740 1 Processor -- start 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efec690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41efe9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1ad360 con 0x55a41ec061b0 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1ae7d0 con 0x55a41ec0e390 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f759c1ada30 con 0x55a41ec2f070 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a9852740 10 client.0 _ll_register_callbacks cb 0x7f7594009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a0878640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41efe9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a0878640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47408/0 (socket says 172.21.15.2:47408) 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a0878640 1 -- 172.21.15.2:0/654864573 learned_addr learned my addr 172.21.15.2:0/654864573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a1079640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 -- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 msgr2=0x55a41efe8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 -- 172.21.15.2:0/654864573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 msgr2=0x55a41efec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.193+0000 7f75a187a640 1 -- 172.21.15.2:0/654864573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41efe9670 con 0x55a41ec2f070 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f75a0878640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f75a187a640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41efe9130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f759402fd90 tx=0x7f759402f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbccddbb3eb22a97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f7584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594065060 con 0x55a41ec2f070 2024-08-31T04:31:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759802a070 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f75940305c0 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f759406c050 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f75a9852740 10 client.26083 fetch_fsmap learned FSMap version 29 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a41f061950 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.194+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759802a070 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f759405f040 con 0x55a41ec2f070 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 10 client.26083 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 10 client.26083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 20 client.26083 populate_metadata read hostname 'smithi002' 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebc2da0 0x55a41f064140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 4 client.26083 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a41ef49020 con 0x55a41ebc2da0 2024-08-31T04:31:57.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a1079640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebc2da0 0x55a41f064140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f7584ff9640 10 client.26083 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.195+0000 7f75a1079640 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebc2da0 0x55a41f064140 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f43c2e786530e4fe server_cookie=91385129cbd39cf in_seq=0 out_seq=0 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f7584ff9640 1 -- 172.21.15.2:0/654864573 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55a41ef49020 con 0x55a41ebc2da0 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f7584ff9640 10 client.26083 handle_command_reply: tid=0 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 client.26083 shutdown 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 msgr2=0x55a41efe9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41efe9130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f759402fd90 tx=0x7f759402f890 comp rx=0 tx=0).stop 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 shutdown_connections 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a41ebc2da0 0x55a41f064140 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a41ec2f070 0x55a41efe9130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a41ec0e390 0x55a41efe8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f7584ff9640 0 client.26083 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 --2- 172.21.15.2:0/654864573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41ec061b0 0x55a41efec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 >> 172.21.15.2:0/654864573 conn(0x55a41ec23460 msgr2=0x55a41efd73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 shutdown_connections 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 1 -- 172.21.15.2:0/654864573 wait complete. 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.197+0000 7f75a9852740 20 client.26083 trim_cache size 0 max 16384 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:31:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:31:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:31:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 msgr2=0x7f75880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 0x7f75880b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7594035000 tx=0x7f75940095c0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 msgr2=0x7f759c19a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:57.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9f0 tx=0x7f758c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 shutdown_connections 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f759c108a90 0x7f759c19fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f759c108140 0x7f759c19a790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75880b4ca0 0x7f75880b71b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 --2- 172.21.15.2:0/1066633989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759c102800 0x7f759c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 >> 172.21.15.2:0/1066633989 conn(0x7f759c0794d0 msgr2=0x7f759c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 shutdown_connections 2024-08-31T04:31:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:57.198+0000 7f75a32dd640 1 -- 172.21.15.2:0/1066633989 wait complete. 2024-08-31T04:31:57.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 645770 11.72 MB/sec execute 197 sec latency 29.512 ms 2024-08-31T04:31:57.998 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:31:57.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:31:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:58.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 647323 11.70 MB/sec execute 198 sec latency 61.094 ms 2024-08-31T04:31:58.730 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:58 smithi002 ceph-mon[18656]: pgmap v535: 129 pgs: 129 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:31:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:58 smithi064 ceph-mon[22007]: pgmap v535: 129 pgs: 129 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:31:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:58 smithi132 ceph-mon[22335]: pgmap v535: 129 pgs: 129 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2024-08-31T04:31:58.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 -- 172.21.15.2:0/149758074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 msgr2=0x7f4f28108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 --2- 172.21.15.2:0/149758074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f28108550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009860 tx=0x7f4f1c02a340 comp rx=0 tx=0).stop 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 -- 172.21.15.2:0/149758074 shutdown_connections 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 --2- 172.21.15.2:0/149758074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f2810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 --2- 172.21.15.2:0/149758074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f28108550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 --2- 172.21.15.2:0/149758074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f28102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 -- 172.21.15.2:0/149758074 >> 172.21.15.2:0/149758074 conn(0x7f4f280794d0 msgr2=0x7f4f280798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 -- 172.21.15.2:0/149758074 shutdown_connections 2024-08-31T04:31:58.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 -- 172.21.15.2:0/149758074 wait complete. 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.823+0000 7f4f30716640 1 Processor -- start 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 -- start start 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f2819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f2819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281126e0 con 0x7f4f28108a90 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28112560 con 0x7f4f28102800 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f30716640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28112860 con 0x7f4f28108140 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:58.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2dcb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f2819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2e4b2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f2819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46470/0 (socket says 172.21.15.2:46470) 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 -- 172.21.15.2:0/2432241186 learned_addr learned my addr 172.21.15.2:0/2432241186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 -- 172.21.15.2:0/2432241186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 msgr2=0x7f4f2819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f2819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 -- 172.21.15.2:0/2432241186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 msgr2=0x7f4f2819c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:58.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f2819c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2ecb3640 1 -- 172.21.15.2:0/2432241186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281a2410 con 0x7f4f28108a90 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.824+0000 7f4f2e4b2640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f2819c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f2ecb3640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e970 tx=0x7f4f2000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000ccc0 con 0x7f4f28108a90 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f281a2700 con 0x7f4f28108a90 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f2000ce60 con 0x7f4f28108a90 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20010430 con 0x7f4f28108a90 2024-08-31T04:31:58.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.825+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281a8e60 con 0x7f4f28108a90 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.826+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28102c10 con 0x7f4f28108a90 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.827+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4f20004fb0 con 0x7f4f28108a90 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.828+0000 7f4f277fe640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 0x7f4f100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.828+0000 7f4f2e4b2640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 0x7f4f100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.828+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f4f200e5e80 con 0x7f4f28108a90 2024-08-31T04:31:58.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.829+0000 7f4f2e4b2640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 0x7f4f100b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005fd0 tx=0x7f4f18010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:58.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:58.832+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f20056130 con 0x7f4f28108a90 2024-08-31T04:31:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.063+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f2819d5d0 con 0x7f4f28108a90 2024-08-31T04:31:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.064+0000 7f4f277fe640 1 -- 172.21.15.2:0/2432241186 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11898 (secure 0 0 0) 0x7f4f2819d5d0 con 0x7f4f28108a90 2024-08-31T04:31:59.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:31:59.066 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-08-31T04:30:29:275763+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:30:28.725461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:31:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 msgr2=0x7f4f100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 0x7f4f100b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005fd0 tx=0x7f4f18010040 comp rx=0 tx=0).stop 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 msgr2=0x7f4f281a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e970 tx=0x7f4f2000ed70 comp rx=0 tx=0).stop 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 shutdown_connections 2024-08-31T04:31:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4f100b4ca0 0x7f4f100b71b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f28108a90 0x7f4f281a1ce0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f28108140 0x7f4f2819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 --2- 172.21.15.2:0/2432241186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102800 0x7f4f2819c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.066+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 >> 172.21.15.2:0/2432241186 conn(0x7f4f280794d0 msgr2=0x7f4f2806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.067+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 shutdown_connections 2024-08-31T04:31:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:31:59.067+0000 7f4f30716640 1 -- 172.21.15.2:0/2432241186 wait complete. 2024-08-31T04:31:59.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:31:59 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2432241186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:59.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 649718 11.71 MB/sec execute 199 sec latency 20.236 ms 2024-08-31T04:31:59.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:31:59.816 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:31:59 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2432241186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:59.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:31:59 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2432241186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:32:00.081 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:00.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:00 smithi002 ceph-mon[18656]: pgmap v536: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 235 op/s 2024-08-31T04:32:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/2216313667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc10dbd0 msgr2=0x7ff3bc1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/2216313667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1100c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009ca0 tx=0x7ff3b402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/2216313667 shutdown_connections 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/2216313667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1100c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/2216313667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/2216313667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc104770 0x7ff3bc104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.599+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/2216313667 >> 172.21.15.2:0/2216313667 conn(0x7ff3bc0794e0 msgr2=0x7ff3bc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.600+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/2216313667 shutdown_connections 2024-08-31T04:32:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.600+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/2216313667 wait complete. 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.600+0000 7ff3c1bb2640 1 Processor -- start 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 -- start start 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc113850 con 0x7ff3bc104770 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1136d0 con 0x7ff3bc1050c0 2024-08-31T04:32:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3c1bb2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1139d0 con 0x7ff3bc10dbd0 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46494/0 (socket says 172.21.15.2:46494) 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47458/0 (socket says 172.21.15.2:47458) 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/4139446400 learned_addr learned my addr 172.21.15.2:0/4139446400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.601+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 -- 172.21.15.2:0/4139446400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 msgr2=0x7ff3bc1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 -- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 msgr2=0x7ff3bc19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 -- 172.21.15.2:0/4139446400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc1a2370 con 0x7ff3bc1050c0 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3baffd640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc06aad0 tx=0x7ff3b000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.602+0000 7ff3b8ff9640 1 -- 172.21.15.2:0/4139446400 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000cc40 con 0x7ff3bc1050c0 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.603+0000 7ff3b8ff9640 1 -- 172.21.15.2:0/4139446400 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b000cde0 con 0x7ff3bc1050c0 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.603+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc1a2660 con 0x7ff3bc1050c0 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.603+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc1a8dc0 con 0x7ff3bc1050c0 2024-08-31T04:32:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.603+0000 7ff3b8ff9640 1 -- 172.21.15.2:0/4139446400 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0004a00 con 0x7ff3bc1050c0 2024-08-31T04:32:00.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.605+0000 7ff3c8127740 1 Processor -- start 2024-08-31T04:32:00.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 -- start start 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca217a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca217ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ca20f1680 con 0x555ca1dac1b0 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ca20e0c10 con 0x555ca1dd5070 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3c8127740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555ca20e4bc0 con 0x555ca1db4390 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46502/0 (socket says 172.21.15.2:46502) 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/2255953962 learned_addr learned my addr 172.21.15.2:0/2255953962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:00.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca217a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.606+0000 7ff3b8ff9640 1 -- 172.21.15.2:0/4139446400 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff3b0004ba0 con 0x7ff3bc1050c0 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3baffd640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca217ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/2255953962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 msgr2=0x555ca217ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca217ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/2255953962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 msgr2=0x555ca217a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca217a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/2255953962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ca1e40650 con 0x555ca1dac1b0 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca217a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0115c0 tx=0x7ff3ac011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb50fbc13667eb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.607+0000 7ff3baffd640 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca217ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:32:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3a1ffb640 1 -- 172.21.15.2:0/2255953962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac005020 con 0x555ca1dac1b0 2024-08-31T04:32:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3a1ffb640 1 -- 172.21.15.2:0/2255953962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3ac0047a0 con 0x555ca1dac1b0 2024-08-31T04:32:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3a1ffb640 1 -- 172.21.15.2:0/2255953962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00f940 con 0x555ca1dac1b0 2024-08-31T04:32:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3b8ff9640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 0x7ff3a40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3b8ff9640 1 -- 172.21.15.2:0/4139446400 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff3b00e5950 con 0x7ff3bc1050c0 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.608+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 0x7ff3a40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 -- 172.21.15.2:0/2255953962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 msgr2=0x555ca217a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0115c0 tx=0x7ff3ac011a80 comp rx=0 tx=0).stop 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 0x7ff3a40b7230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004af0 tx=0x7ff3b4005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 -- 172.21.15.2:0/2255953962 shutdown_connections 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dac1b0 0x555ca217a850 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca217ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2255953962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca217a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 -- 172.21.15.2:0/2255953962 >> 172.21.15.2:0/2255953962 conn(0x555ca1dc9460 msgr2=0x555ca2178200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 -- 172.21.15.2:0/2255953962 shutdown_connections 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.609+0000 7ff3c8127740 1 -- 172.21.15.2:0/2255953962 wait complete. 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.610+0000 7ff3c8127740 1 -- start start 2024-08-31T04:32:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.610+0000 7ff3c8127740 1 Processor -- start 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.610+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 0x555ca2185a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.610+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca2185f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.610+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3c8127740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ca1f43700 con 0x555ca1dd5070 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3c8127740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ca2067750 con 0x555ca1dac1b0 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3c8127740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555ca2188b40 con 0x555ca1db4390 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3c8127740 10 client.0 _ll_register_callbacks cb 0x555ca2096e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46506/0 (socket says 172.21.15.2:46506) 2024-08-31T04:32:00.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bbfff640 1 -- 172.21.15.2:0/3147085901 learned_addr learned my addr 172.21.15.2:0/3147085901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca2185f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 0x555ca2185a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 msgr2=0x555ca2185f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca2185f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/3147085901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 msgr2=0x555ca2191e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bb7fe640 1 -- 172.21.15.2:0/3147085901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ca20a0900 con 0x555ca1dac1b0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.611+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 0x555ca2185a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac01b040 tx=0x7ff3ac005080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212ea9207808e895 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff39affd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac01d050 con 0x555ca1dac1b0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3ac0047a0 con 0x555ca1dac1b0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff3ac005480 con 0x555ca1dac1b0 2024-08-31T04:32:00.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3ac032050 con 0x555ca1dac1b0 2024-08-31T04:32:00.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff3c8127740 10 client.26270 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:00.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.612+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ca21947c0 con 0x555ca1dac1b0 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3ac0047a0 con 0x555ca1dac1b0 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ff3ac024570 con 0x555ca1dac1b0 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 10 client.26270 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 10 client.26270 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 20 client.26270 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca1d939f0 0x555ca2197b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 4 client.26270 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ca20f35d0 con 0x555ca1d939f0 2024-08-31T04:32:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.613+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca1d939f0 0x555ca2197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.614+0000 7ff39affd640 10 client.26270 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.614+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca1d939f0 0x555ca2197b80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d237388a05e85e02 server_cookie=7570f570c0418660 in_seq=0 out_seq=0 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.615+0000 7ff39affd640 1 -- 172.21.15.2:0/3147085901 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ca20f35d0 con 0x555ca1d939f0 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.615+0000 7ff39affd640 10 client.26270 handle_command_reply: tid=0 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.615+0000 7ff3c8127740 1 client.26270 shutdown 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.615+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 msgr2=0x555ca2185a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.615+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 0x555ca2185a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac01b040 tx=0x7ff3ac005080 comp rx=0 tx=0).stop 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 shutdown_connections 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca1d939f0 0x555ca2197b80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2191e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca2185f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3147085901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dac1b0 0x555ca2185a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 >> 172.21.15.2:0/3147085901 conn(0x555ca1dc9460 msgr2=0x555ca217b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff39affd640 0 client.26270 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 shutdown_connections 2024-08-31T04:32:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 1 -- 172.21.15.2:0/3147085901 wait complete. 2024-08-31T04:32:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.616+0000 7ff3c8127740 20 client.26270 trim_cache size 0 max 16384 2024-08-31T04:32:00.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.634+0000 7ff3c8127740 1 Processor -- start 2024-08-31T04:32:00.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.634+0000 7ff3c8127740 1 -- start start 2024-08-31T04:32:00.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca21811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 0x555ca2182c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b5a40 con 0x555ca1dd5070 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b32e0 con 0x555ca1d68da0 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3c8127740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b1130 con 0x555ca1db4390 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46510/0 (socket says 172.21.15.2:46510) 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 -- 172.21.15.2:0/3531533042 learned_addr learned my addr 172.21.15.2:0/3531533042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 0x555ca2182c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca21811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 -- 172.21.15.2:0/3531533042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 msgr2=0x555ca21811e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca21811e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 -- 172.21.15.2:0/3531533042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 msgr2=0x555ca2182c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 0x555ca2182c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3baffd640 1 -- 172.21.15.2:0/3531533042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ca21885e0 con 0x555ca1dd5070 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.635+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 0x555ca2182c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.636+0000 7ff3baffd640 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00a7ca0 tx=0x7ff3b0093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d096f3638a31abb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.636+0000 7ff3a17fa640 1 -- 172.21.15.2:0/3531533042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b001c040 con 0x555ca1dd5070 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.636+0000 7ff3a17fa640 1 -- 172.21.15.2:0/3531533042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b00ab730 con 0x555ca1dd5070 2024-08-31T04:32:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.636+0000 7ff3a17fa640 1 -- 172.21.15.2:0/3531533042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0005020 con 0x555ca1dd5070 2024-08-31T04:32:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 -- 172.21.15.2:0/3531533042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 msgr2=0x555ca2184890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00a7ca0 tx=0x7ff3b0093040 comp rx=0 tx=0).stop 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 -- 172.21.15.2:0/3531533042 shutdown_connections 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1dd5070 0x555ca2184890 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1d68da0 0x555ca2182c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 --2- 172.21.15.2:0/3531533042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1db4390 0x555ca21811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 -- 172.21.15.2:0/3531533042 >> 172.21.15.2:0/3531533042 conn(0x555ca1dc9460 msgr2=0x555ca2184180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 -- 172.21.15.2:0/3531533042 shutdown_connections 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.637+0000 7ff3c8127740 1 -- 172.21.15.2:0/3531533042 wait complete. 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 -- start start 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 Processor -- start 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1d68da0 0x555ca218e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 0x555ca2189710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b17a0 con 0x555ca1db4390 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b2c10 con 0x555ca1dd5070 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1b1e70 con 0x555ca1d68da0 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.638+0000 7ff3c8127740 10 client.0 _ll_register_callbacks cb 0x7ff3ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47508/0 (socket says 172.21.15.2:47508) 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 -- 172.21.15.2:0/2143131199 learned_addr learned my addr 172.21.15.2:0/2143131199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3baffd640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 0x555ca2189710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 -- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1d68da0 msgr2=0x555ca218e260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1d68da0 0x555ca218e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 -- 172.21.15.2:0/2143131199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 msgr2=0x555ca2189710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 0x555ca2189710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 -- 172.21.15.2:0/2143131199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ca218a190 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3baffd640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 0x555ca2189710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff3bbfff640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4031a60 tx=0x7ff3b40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3bfa761a83d807 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.639+0000 7ff39affd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4058060 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7ff3b4004250 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b00ab730 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3b405f050 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 10 client.26276 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ca2202070 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b4036040 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ff3b40305c0 con 0x555ca1dd5070 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 10 client.26276 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 10 client.26276 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:32:00.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 20 client.26276 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:00.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca2202880 0x555ca2204ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:00.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 4 client.26276 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:00.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.640+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff3b00ab730 con 0x555ca2202880 2024-08-31T04:32:00.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.641+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca2202880 0x555ca2204ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3bb7fe640 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca2202880 0x555ca2204ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c28437a862b66693 server_cookie=8ff76710374359d7 in_seq=0 out_seq=0 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff39affd640 10 client.26276 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff39affd640 1 -- 172.21.15.2:0/2143131199 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff3b00ab730 con 0x555ca2202880 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff39affd640 10 client.26276 handle_command_reply: tid=0 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 client.26276 shutdown 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 msgr2=0x555ca2189c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4031a60 tx=0x7ff3b40095c0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 shutdown_connections 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x555ca2202880 0x555ca2204ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ca1db4390 0x555ca2189710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ca1dd5070 0x555ca2189c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 --2- 172.21.15.2:0/2143131199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555ca1d68da0 0x555ca218e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 >> 172.21.15.2:0/2143131199 conn(0x555ca1dc9460 msgr2=0x555ca2184b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.642+0000 7ff39affd640 0 client.26276 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 shutdown_connections 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c8127740 1 -- 172.21.15.2:0/2143131199 wait complete. 2024-08-31T04:32:00.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c8127740 20 client.26276 trim_cache size 0 max 16384 2024-08-31T04:32:00.649 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 msgr2=0x7ff3a40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 0x7ff3a40b7230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004af0 tx=0x7ff3b4005c30 comp rx=0 tx=0).stop 2024-08-31T04:32:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 msgr2=0x7ff3bc19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc06aad0 tx=0x7ff3b000ee50 comp rx=0 tx=0).stop 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.643+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 shutdown_connections 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3bc10dbd0 0x7ff3bc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3bc1050c0 0x7ff3bc19c9a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff3a40b4d20 0x7ff3a40b7230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 --2- 172.21.15.2:0/4139446400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3bc104770 0x7ff3bc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 >> 172.21.15.2:0/4139446400 conn(0x7ff3bc0794e0 msgr2=0x7ff3bc10c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 shutdown_connections 2024-08-31T04:32:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:00.644+0000 7ff3c1bb2640 1 -- 172.21.15.2:0/4139446400 wait complete. 2024-08-31T04:32:00.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 650899 11.68 MB/sec execute 200 sec latency 54.544 ms 2024-08-31T04:32:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:00 smithi064 ceph-mon[22007]: pgmap v536: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 235 op/s 2024-08-31T04:32:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:00 smithi132 ceph-mon[22335]: pgmap v536: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 235 op/s 2024-08-31T04:32:01.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:32:01.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 651500 11.64 MB/sec execute 201 sec latency 75.374 ms 2024-08-31T04:32:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 -- 172.21.15.2:0/1894538898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 msgr2=0x7f929010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 --2- 172.21.15.2:0/1894538898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f929010f2c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9288009ca0 tx=0x7f928802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 -- 172.21.15.2:0/1894538898 shutdown_connections 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 --2- 172.21.15.2:0/1894538898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f929010f2c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 --2- 172.21.15.2:0/1894538898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290108140 0x7f9290108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 --2- 172.21.15.2:0/1894538898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290102800 0x7f9290102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 -- 172.21.15.2:0/1894538898 >> 172.21.15.2:0/1894538898 conn(0x7f92900794d0 msgr2=0x7f92900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 -- 172.21.15.2:0/1894538898 shutdown_connections 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.251+0000 7f9294822640 1 -- 172.21.15.2:0/1894538898 wait complete. 2024-08-31T04:32:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.252+0000 7f9294822640 1 Processor -- start 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.252+0000 7f9294822640 1 -- start start 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.252+0000 7f9294822640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 0x7f929019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.252+0000 7f9294822640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290108140 0x7f929019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f9294822640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f9294822640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9290112710 con 0x7f9290108a90 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f9294822640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9290112590 con 0x7f9290102800 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f9294822640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9290112890 con 0x7f9290108140 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 0x7f929019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46532/0 (socket says 172.21.15.2:46532) 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928ed9d640 1 -- 172.21.15.2:0/4033532572 learned_addr learned my addr 172.21.15.2:0/4033532572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928dd9b640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290108140 0x7f929019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 -- 172.21.15.2:0/4033532572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290108140 msgr2=0x7f929019c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290108140 0x7f929019c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 -- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 msgr2=0x7f92901a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 -- 172.21.15.2:0/4033532572 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92901a2370 con 0x7f9290102800 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928ed9d640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f928e59c640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 0x7f929019c400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f928000e9f0 tx=0x7f928000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.253+0000 7f927f7fe640 1 -- 172.21.15.2:0/4033532572 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000ccc0 con 0x7f9290102800 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.254+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92901a2660 con 0x7f9290102800 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.254+0000 7f927f7fe640 1 -- 172.21.15.2:0/4033532572 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280005020 con 0x7f9290102800 2024-08-31T04:32:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.254+0000 7f927f7fe640 1 -- 172.21.15.2:0/4033532572 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004a00 con 0x7f9290102800 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.254+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901a8dc0 con 0x7f9290102800 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.256+0000 7f927f7fe640 1 -- 172.21.15.2:0/4033532572 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9280004ba0 con 0x7f9290102800 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.256+0000 7f929ad97740 1 Processor -- start 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 -- start start 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb30d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557cddaa7680 con 0x557cdd7621b0 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557cdda96c10 con 0x557cdd78b070 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f929ad97740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557cdda9abc0 con 0x557cdd76a390 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47544/0 (socket says 172.21.15.2:47544) 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46544/0 (socket says 172.21.15.2:46544) 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928ed9d640 1 -- 172.21.15.2:0/1959932116 learned_addr learned my addr 172.21.15.2:0/1959932116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f927f7fe640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 0x7f92780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 -- 172.21.15.2:0/1959932116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 msgr2=0x557cddb30310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 -- 172.21.15.2:0/1959932116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 msgr2=0x557cddb30850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928dd9b640 1 -- 172.21.15.2:0/1959932116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd7f6650 con 0x557cdd76a390 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928e59c640 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.257+0000 7f928ed9d640 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f928ed9d640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 0x7f92780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f927f7fe640 1 -- 172.21.15.2:0/4033532572 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f92800e58c0 con 0x7f9290102800 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f928dd9b640 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb30d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f929006a840 tx=0x7f9284011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a66e17807546fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f927cff9640 1 -- 172.21.15.2:0/1959932116 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284004050 con 0x557cdd76a390 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f927cff9640 1 -- 172.21.15.2:0/1959932116 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92840054d0 con 0x557cdd76a390 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.258+0000 7f927cff9640 1 -- 172.21.15.2:0/1959932116 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284004c40 con 0x557cdd76a390 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.259+0000 7f929ad97740 1 -- 172.21.15.2:0/1959932116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 msgr2=0x557cddb30d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.259+0000 7f928ed9d640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 0x7f92780b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9288009960 tx=0x7f92880095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.259+0000 7f929ad97740 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb30d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f929006a840 tx=0x7f9284011810 comp rx=0 tx=0).stop 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 -- 172.21.15.2:0/1959932116 shutdown_connections 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb30850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb30d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 --2- 172.21.15.2:0/1959932116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb30310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 -- 172.21.15.2:0/1959932116 >> 172.21.15.2:0/1959932116 conn(0x557cdd77f460 msgr2=0x557cddb2e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 -- 172.21.15.2:0/1959932116 shutdown_connections 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 -- 172.21.15.2:0/1959932116 wait complete. 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 -- start start 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.260+0000 7f929ad97740 1 Processor -- start 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 0x557cddb3bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557cdd8f9700 con 0x557cdd78b070 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557cdda1d750 con 0x557cdd7621b0 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557cddb3eaf0 con 0x557cdd76a390 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f929ad97740 10 client.0 _ll_register_callbacks cb 0x557cdda4ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46560/0 (socket says 172.21.15.2:46560) 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 -- 172.21.15.2:0/3176906984 learned_addr learned my addr 172.21.15.2:0/3176906984 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928dd9b640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928e59c640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 0x557cddb3bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 -- 172.21.15.2:0/3176906984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 msgr2=0x557cddb3bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb3bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 -- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 msgr2=0x557cddb3bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 0x557cddb3bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928ed9d640 1 -- 172.21.15.2:0/3176906984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdda56900 con 0x557cdd78b070 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.261+0000 7f928e59c640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 0x557cddb3bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f928ed9d640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9288006010 tx=0x7f928802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c09d3a8425bec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f9275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288004450 con 0x557cdd78b070 2024-08-31T04:32:02.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92840054d0 con 0x557cdd78b070 2024-08-31T04:32:02.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f92880045f0 con 0x557cdd78b070 2024-08-31T04:32:02.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92880047f0 con 0x557cdd78b070 2024-08-31T04:32:02.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f929ad97740 10 client.16569 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:02.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.262+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557cddb4a880 con 0x557cdd78b070 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92840054d0 con 0x557cdd78b070 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f9288052020 con 0x557cdd78b070 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 10 client.16569 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 10 client.16569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 20 client.16569 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd7499f0 0x557cddb4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 4 client.16569 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cddaa95d0 con 0x557cdd7499f0 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f928e59c640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd7499f0 0x557cddb4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.263+0000 7f9275ffb640 10 client.16569 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f928e59c640 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd7499f0 0x557cddb4ddc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72c6ae9cd8ca8e5c server_cookie=a0e938a2db6838b7 in_seq=0 out_seq=0 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f9275ffb640 1 -- 172.21.15.2:0/3176906984 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557cddaa95d0 con 0x557cdd7499f0 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f9275ffb640 10 client.16569 handle_command_reply: tid=0 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f929ad97740 1 client.16569 shutdown 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 msgr2=0x557cddb47de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9288006010 tx=0x7f928802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 shutdown_connections 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.264+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd7499f0 0x557cddb4ddc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd78b070 0x557cddb47de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f9275ffb640 0 client.16569 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb3bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 --2- 172.21.15.2:0/3176906984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd7621b0 0x557cddb3bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 >> 172.21.15.2:0/3176906984 conn(0x557cdd77f460 msgr2=0x557cddb334f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 shutdown_connections 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 1 -- 172.21.15.2:0/3176906984 wait complete. 2024-08-31T04:32:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.265+0000 7f929ad97740 20 client.16569 trim_cache size 0 max 16384 2024-08-31T04:32:02.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 Processor -- start 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 -- start start 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb47ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b5940 con 0x557cdd7621b0 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b31e0 con 0x557cdd78b070 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f929ad97740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b1030 con 0x557cdd76a390 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46574/0 (socket says 172.21.15.2:46574) 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928e59c640 1 -- 172.21.15.2:0/2018063434 learned_addr learned my addr 172.21.15.2:0/2018063434 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928ed9d640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb47ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928dd9b640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928e59c640 1 -- 172.21.15.2:0/2018063434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 msgr2=0x557cddb2e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.279+0000 7f928e59c640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb2e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f928e59c640 1 -- 172.21.15.2:0/2018063434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 msgr2=0x557cddb47ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f928e59c640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb47ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f928e59c640 1 -- 172.21.15.2:0/2018063434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cddb3cd70 con 0x557cdd7621b0 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f928dd9b640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb2e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f928e59c640 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f92800e2ca0 tx=0x7f92800eb550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecadb4974dbca0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f9277fff640 1 -- 172.21.15.2:0/2018063434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800b0020 con 0x557cdd7621b0 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f9277fff640 1 -- 172.21.15.2:0/2018063434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92800eb030 con 0x557cdd7621b0 2024-08-31T04:32:02.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.280+0000 7f9277fff640 1 -- 172.21.15.2:0/2018063434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928001c040 con 0x557cdd7621b0 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 -- 172.21.15.2:0/2018063434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 msgr2=0x557cddb3a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f92800e2ca0 tx=0x7f92800eb550 comp rx=0 tx=0).stop 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 -- 172.21.15.2:0/2018063434 shutdown_connections 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb47ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb2e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 --2- 172.21.15.2:0/2018063434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3a9a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 -- 172.21.15.2:0/2018063434 >> 172.21.15.2:0/2018063434 conn(0x557cdd77f460 msgr2=0x557cddb2dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 -- 172.21.15.2:0/2018063434 shutdown_connections 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.281+0000 7f929ad97740 1 -- 172.21.15.2:0/2018063434 wait complete. 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 -- start start 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 Processor -- start 2024-08-31T04:32:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb40250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b16a0 con 0x557cdd7621b0 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b2b10 con 0x557cdd78b070 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f92901b1d70 con 0x557cdd76a390 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f929ad97740 10 client.0 _ll_register_callbacks cb 0x7f9288009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f928e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46576/0 (socket says 172.21.15.2:46576) 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f928e59c640 1 -- 172.21.15.2:0/1554677755 learned_addr learned my addr 172.21.15.2:0/1554677755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.282+0000 7f928dd9b640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb40250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 -- 172.21.15.2:0/1554677755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 msgr2=0x557cddb40250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb40250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 -- 172.21.15.2:0/1554677755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 msgr2=0x557cddb3fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 -- 172.21.15.2:0/1554677755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cddbb7780 con 0x557cdd78b070 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928e59c640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f928ed9d640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb40790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9288030940 tx=0x7f9288003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e8e3f1cbf7131b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f9275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288004450 con 0x557cdd78b070 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9576+0+0 (secure 0 0 0) 0x7f92880045f0 con 0x557cdd78b070 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92800eb030 con 0x557cdd78b070 2024-08-31T04:32:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9288069050 con 0x557cdd78b070 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f929ad97740 10 client.26294 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.283+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557cddbb8970 con 0x557cdd78b070 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92800eb030 con 0x557cdd78b070 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f9288052070 con 0x557cdd78b070 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 10 client.26294 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 10 client.26294 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 20 client.26294 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd71eda0 0x557cddbbb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 4 client.26294 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557cddaa5070 con 0x557cdd71eda0 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f928e59c640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd71eda0 0x557cddbbb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f9275ffb640 10 client.26294 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.284+0000 7f928e59c640 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd71eda0 0x557cddbbb130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=780a6d8e89155a11 server_cookie=c05c34534970eecb in_seq=0 out_seq=0 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f9275ffb640 1 -- 172.21.15.2:0/1554677755 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557cddaa5070 con 0x557cdd71eda0 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f9275ffb640 10 client.26294 handle_command_reply: tid=0 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 client.26294 shutdown 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 msgr2=0x557cddb40790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb40790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9288030940 tx=0x7f9288003d40 comp rx=0 tx=0).stop 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 shutdown_connections 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557cdd78b070 0x557cddb40790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557cdd76a390 0x557cddb40250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557cdd71eda0 0x557cddbbb130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 --2- 172.21.15.2:0/1554677755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557cdd7621b0 0x557cddb3fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f9275ffb640 0 client.26294 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 >> 172.21.15.2:0/1554677755 conn(0x557cdd77f460 msgr2=0x557cddb33410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 shutdown_connections 2024-08-31T04:32:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 1 -- 172.21.15.2:0/1554677755 wait complete. 2024-08-31T04:32:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.285+0000 7f929ad97740 20 client.26294 trim_cache size 0 max 16384 2024-08-31T04:32:02.292 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 msgr2=0x7f92780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 0x7f92780b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9288009960 tx=0x7f92880095c0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 msgr2=0x7f929019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 0x7f929019c400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f928000e9f0 tx=0x7f928000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 shutdown_connections 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f92780b4ca0 0x7f92780b71b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9290108a90 0x7f92901a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9290108140 0x7f929019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 --2- 172.21.15.2:0/4033532572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9290102800 0x7f929019c400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 >> 172.21.15.2:0/4033532572 conn(0x7f92900794d0 msgr2=0x7f929006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 shutdown_connections 2024-08-31T04:32:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:02.286+0000 7f9294822640 1 -- 172.21.15.2:0/4033532572 wait complete. 2024-08-31T04:32:02.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 653733 11.65 MB/sec execute 202 sec latency 40.076 ms 2024-08-31T04:32:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:02 smithi064 ceph-mon[22007]: pgmap v537: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-08-31T04:32:02.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:02 smithi132 ceph-mon[22335]: pgmap v537: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-08-31T04:32:02.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:02 smithi002 ceph-mon[18656]: pgmap v537: 129 pgs: 129 active+clean; 402 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-08-31T04:32:03.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:32:03.362 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:03.677 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:03 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:03.678 INFO:tasks.workunit.client.0.smithi002.stdout: 1 655144 11.62 MB/sec execute 203 sec latency 60.736 ms 2024-08-31T04:32:03.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:03 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:03.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:03 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 -- 172.21.15.2:0/2999231194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20102800 msgr2=0x7fea20102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 --2- 172.21.15.2:0/2999231194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20102800 0x7fea20102c10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea1002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 -- 172.21.15.2:0/2999231194 shutdown_connections 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 --2- 172.21.15.2:0/2999231194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 --2- 172.21.15.2:0/2999231194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20108140 0x7fea20108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 --2- 172.21.15.2:0/2999231194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20102800 0x7fea20102c10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 -- 172.21.15.2:0/2999231194 >> 172.21.15.2:0/2999231194 conn(0x7fea200794d0 msgr2=0x7fea200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 -- 172.21.15.2:0/2999231194 shutdown_connections 2024-08-31T04:32:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.908+0000 7fea24821640 1 -- 172.21.15.2:0/2999231194 wait complete. 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 Processor -- start 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 -- start start 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20102800 0x7fea2019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 0x7fea2019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112710 con 0x7fea20108140 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112590 con 0x7fea20108a90 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea24821640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112890 con 0x7fea20102800 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 0x7fea2019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:47602/0 (socket says 172.21.15.2:47602) 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 0x7fea2019b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46594/0 (socket says 172.21.15.2:46594) 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1ed9d640 1 -- 172.21.15.2:0/3709439022 learned_addr learned my addr 172.21.15.2:0/3709439022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.909+0000 7fea1e59c640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20102800 0x7fea2019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 -- 172.21.15.2:0/3709439022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20102800 msgr2=0x7fea2019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20102800 0x7fea2019b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 -- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 msgr2=0x7fea2019b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 0x7fea2019b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 -- 172.21.15.2:0/3709439022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea20198e30 con 0x7fea20108a90 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e970 tx=0x7fea1800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea0f7fe640 1 -- 172.21.15.2:0/3709439022 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800ccc0 con 0x7fea20108a90 2024-08-31T04:32:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea0f7fe640 1 -- 172.21.15.2:0/3709439022 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1800ce60 con 0x7fea20108a90 2024-08-31T04:32:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea20199120 con 0x7fea20108a90 2024-08-31T04:32:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea0f7fe640 1 -- 172.21.15.2:0/3709439022 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18010430 con 0x7fea20108a90 2024-08-31T04:32:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.910+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea20199610 con 0x7fea20108a90 2024-08-31T04:32:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.913+0000 7fea2ad96740 1 Processor -- start 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.913+0000 7fea0f7fe640 1 -- 172.21.15.2:0/3709439022 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fea180105d0 con 0x7fea20108a90 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.913+0000 7fea2ad96740 1 -- start start 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 0x557659ba7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659ba7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557659b1e680 con 0x557659802070 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557659b0dc10 con 0x5576597e1390 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea2ad96740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557659b11bc0 con 0x5576597d91b0 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 0x557659ba7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:44430/0 (socket says 172.21.15.2:44430) 2024-08-31T04:32:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 -- 172.21.15.2:0/3525540297 learned_addr learned my addr 172.21.15.2:0/3525540297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 0x557659ba7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46602/0 (socket says 172.21.15.2:46602) 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659ba7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 -- 172.21.15.2:0/3525540297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 msgr2=0x557659ba7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659ba7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 -- 172.21.15.2:0/3525540297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 msgr2=0x557659ba7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 0x557659ba7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 -- 172.21.15.2:0/3525540297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55765986d650 con 0x5576597d91b0 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea0f7fe640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 0x7fea080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 0x7fea080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.914+0000 7fea1e59c640 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea10009410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6b73df475c448e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.915+0000 7fea0f7fe640 1 -- 172.21.15.2:0/3709439022 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7fea180e5e90 con 0x7fea20108a90 2024-08-31T04:32:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.915+0000 7fea0cff9640 1 -- 172.21.15.2:0/3525540297 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10031cf0 con 0x5576597d91b0 2024-08-31T04:32:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.915+0000 7fea0cff9640 1 -- 172.21.15.2:0/3525540297 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea10036030 con 0x5576597d91b0 2024-08-31T04:32:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.915+0000 7fea0cff9640 1 -- 172.21.15.2:0/3525540297 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10004240 con 0x5576597d91b0 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 -- 172.21.15.2:0/3525540297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 msgr2=0x557659ba7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 0x7fea080b71e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea14015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea10009410 comp rx=0 tx=0).stop 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 -- 172.21.15.2:0/3525540297 shutdown_connections 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659ba7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659ba7850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 --2- 172.21.15.2:0/3525540297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557659802070 0x557659ba7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 -- 172.21.15.2:0/3525540297 >> 172.21.15.2:0/3525540297 conn(0x5576597f6460 msgr2=0x557659ba5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 -- 172.21.15.2:0/3525540297 shutdown_connections 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.916+0000 7fea2ad96740 1 -- 172.21.15.2:0/3525540297 wait complete. 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 -- start start 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 Processor -- start 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659bb2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 0x557659bbec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557659970700 con 0x5576597d91b0 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557659a94750 con 0x5576597e1390 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.917+0000 7fea2ad96740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557659bb5910 con 0x557659802070 2024-08-31T04:32:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea2ad96740 10 client.0 _ll_register_callbacks cb 0x557659ac3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659bb2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46618/0 (socket says 172.21.15.2:46618) 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1e59c640 1 -- 172.21.15.2:0/2155723220 learned_addr learned my addr 172.21.15.2:0/2155723220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 0x557659bbec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 -- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 msgr2=0x557659bb2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659bb2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 -- 172.21.15.2:0/2155723220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 msgr2=0x557659bb2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 -- 172.21.15.2:0/2155723220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557659acd900 con 0x557659802070 2024-08-31T04:32:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1e59c640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 0x557659bbec30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea180e30b0 tx=0x7fea18005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2826b7976b595b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.918+0000 7fea05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180ac050 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7fea180a8640 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea10036030 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea180b08c0 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea2ad96740 10 client.26128 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557659bc1780 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.919+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea180b5370 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fea180b04a0 con 0x557659802070 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 10 client.26128 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 10 client.26128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 20 client.26128 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5576597c09f0 0x557659bc4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 4 client.26128 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fea10036030 con 0x5576597c09f0 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea1e59c640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5576597c09f0 0x557659bc4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea05ffb640 10 client.26128 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.920+0000 7fea1e59c640 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5576597c09f0 0x557659bc4ba0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1b6033f6273b39 server_cookie=d6653b0c467de385 in_seq=0 out_seq=0 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea05ffb640 1 -- 172.21.15.2:0/2155723220 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fea10036030 con 0x5576597c09f0 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea05ffb640 10 client.26128 handle_command_reply: tid=0 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 client.26128 shutdown 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 msgr2=0x557659bbec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 0x557659bbec30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea180e30b0 tx=0x7fea18005720 comp rx=0 tx=0).stop 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 shutdown_connections 2024-08-31T04:32:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5576597c09f0 0x557659bc4ba0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557659802070 0x557659bbec30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5576597e1390 0x557659bb2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 --2- 172.21.15.2:0/2155723220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 >> 172.21.15.2:0/2155723220 conn(0x5576597f6460 msgr2=0x557659baa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.922+0000 7fea05ffb640 0 client.26128 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.923+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 shutdown_connections 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.923+0000 7fea2ad96740 1 -- 172.21.15.2:0/2155723220 wait complete. 2024-08-31T04:32:03.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.923+0000 7fea2ad96740 20 client.26128 trim_cache size 0 max 16384 2024-08-31T04:32:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 Processor -- start 2024-08-31T04:32:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 -- start start 2024-08-31T04:32:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659bb3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659baa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea201b17f0 con 0x5576597e1390 2024-08-31T04:32:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea201af090 con 0x557659802070 2024-08-31T04:32:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea2ad96740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea201acf00 con 0x5576597d91b0 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46624/0 (socket says 172.21.15.2:46624) 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea1dd9b640 1 -- 172.21.15.2:0/1980360547 learned_addr learned my addr 172.21.15.2:0/1980360547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659baa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.938+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659bb3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 -- 172.21.15.2:0/1980360547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 msgr2=0x557659baa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659baa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 -- 172.21.15.2:0/1980360547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 msgr2=0x557659baa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 -- 172.21.15.2:0/1980360547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557659bb3d70 con 0x5576597d91b0 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659baa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659bb3130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea10003ca0 tx=0x7fea10003da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b20004797812d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea07fff640 1 -- 172.21.15.2:0/1980360547 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1005d070 con 0x5576597d91b0 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea07fff640 1 -- 172.21.15.2:0/1980360547 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea10054070 con 0x5576597d91b0 2024-08-31T04:32:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.939+0000 7fea07fff640 1 -- 172.21.15.2:0/1980360547 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1004a040 con 0x5576597d91b0 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 -- 172.21.15.2:0/1980360547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 msgr2=0x557659bb3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659bb3130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea10003ca0 tx=0x7fea10003da0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 -- 172.21.15.2:0/1980360547 shutdown_connections 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597e1390 0x557659baa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659baa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1980360547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597d91b0 0x557659bb3130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 -- 172.21.15.2:0/1980360547 >> 172.21.15.2:0/1980360547 conn(0x5576597f6460 msgr2=0x557659bb2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 -- 172.21.15.2:0/1980360547 shutdown_connections 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.940+0000 7fea2ad96740 1 -- 172.21.15.2:0/1980360547 wait complete. 2024-08-31T04:32:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 -- start start 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 Processor -- start 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597e1390 0x557659bb7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659bb7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ad550 con 0x5576597d91b0 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ae9c0 con 0x557659802070 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea201adc20 con 0x5576597e1390 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea2ad96740 10 client.0 _ll_register_callbacks cb 0x7fea180a7f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46638/0 (socket says 172.21.15.2:46638) 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea1e59c640 1 -- 172.21.15.2:0/1432493147 learned_addr learned my addr 172.21.15.2:0/1432493147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea1ed9d640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659bb7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.941+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597e1390 0x557659bb7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 -- 172.21.15.2:0/1432493147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597e1390 msgr2=0x557659bb7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597e1390 0x557659bb7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 -- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 msgr2=0x557659bb7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659bb7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 -- 172.21.15.2:0/1432493147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557659c2e510 con 0x5576597d91b0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea1e59c640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea10009bf0 tx=0x7fea10009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764a38b02c78761a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1005d070 con 0x5576597d91b0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7fea100305c0 con 0x5576597d91b0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea10054070 con 0x5576597d91b0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea10004b40 con 0x5576597d91b0 2024-08-31T04:32:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea2ad96740 10 client.16593 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.942+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557659c2f720 con 0x5576597d91b0 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea10054070 con 0x5576597d91b0 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fea10043070 con 0x5576597d91b0 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 10 client.16593 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 20 client.16593 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x557659795da0 0x557659c31bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 4 client.16593 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557659b205d0 con 0x557659795da0 2024-08-31T04:32:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.943+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x557659795da0 0x557659c31bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea05ffb640 10 client.16593 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea1dd9b640 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x557659795da0 0x557659c31bf0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd07c336dd60776 server_cookie=6b00e65e6426a8d2 in_seq=0 out_seq=0 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea05ffb640 1 -- 172.21.15.2:0/1432493147 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557659b205d0 con 0x557659795da0 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea05ffb640 10 client.16593 handle_command_reply: tid=0 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 client.16593 shutdown 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 msgr2=0x557659bb6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea10009bf0 tx=0x7fea10009580 comp rx=0 tx=0).stop 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 shutdown_connections 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x557659795da0 0x557659c31bf0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557659802070 0x557659bb7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5576597e1390 0x557659bb7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 --2- 172.21.15.2:0/1432493147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576597d91b0 0x557659bb6b00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 >> 172.21.15.2:0/1432493147 conn(0x5576597f6460 msgr2=0x557659baa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea05ffb640 0 client.16593 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 shutdown_connections 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.944+0000 7fea2ad96740 1 -- 172.21.15.2:0/1432493147 wait complete. 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea2ad96740 20 client.16593 trim_cache size 0 max 16384 2024-08-31T04:32:03.952 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 msgr2=0x7fea080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 0x7fea080b71e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea14015040 comp rx=0 tx=0).stop 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 msgr2=0x7fea2019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e970 tx=0x7fea1800ed70 comp rx=0 tx=0).stop 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 shutdown_connections 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fea080b4cd0 0x7fea080b71e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea20108140 0x7fea2019b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea20108a90 0x7fea2019bac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 --2- 172.21.15.2:0/3709439022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea20102800 0x7fea2019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.945+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 >> 172.21.15.2:0/3709439022 conn(0x7fea200794d0 msgr2=0x7fea20101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.946+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 shutdown_connections 2024-08-31T04:32:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:03.946+0000 7fea24821640 1 -- 172.21.15.2:0/3709439022 wait complete. 2024-08-31T04:32:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: pgmap v538: 129 pgs: 129 active+clean; 408 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi064 to 176.0M 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: Unable to set osd_memory_target on smithi064 to 184598937: error parsing value: Value '184598937' is below minimum 939524096 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: Unable to set osd_memory_target on smithi002 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:04.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:32:04.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 657356 11.63 MB/sec execute 204 sec latency 100.503 ms 2024-08-31T04:32:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: pgmap v538: 129 pgs: 129 active+clean; 408 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-08-31T04:32:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T04:32:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi064 to 176.0M 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: Unable to set osd_memory_target on smithi064 to 184598937: error parsing value: Value '184598937' is below minimum 939524096 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: Unable to set osd_memory_target on smithi002 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: pgmap v538: 129 pgs: 129 active+clean; 408 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi064 to 176.0M 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: Unable to set osd_memory_target on smithi064 to 184598937: error parsing value: Value '184598937' is below minimum 939524096 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: Unable to set osd_memory_target on smithi002 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:04.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:32:05.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 659482 11.61 MB/sec execute 205 sec latency 31.816 ms 2024-08-31T04:32:05.751 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:32:05.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:32:06.016 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:06.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 661588 11.62 MB/sec execute 206 sec latency 27.224 ms 2024-08-31T04:32:06.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:06 smithi002 ceph-mon[18656]: pgmap v540: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 255 op/s 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/1974616574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108ac0 msgr2=0x7f5dd810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/1974616574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108ac0 0x7f5dd810f2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009ca0 tx=0x7f5dd002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/1974616574 shutdown_connections 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/1974616574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108ac0 0x7f5dd810f2f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/1974616574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8108170 0x7f5dd8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/1974616574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8102880 0x7f5dd8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/1974616574 >> 172.21.15.2:0/1974616574 conn(0x7f5dd8079500 msgr2=0x7f5dd8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.734+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/1974616574 shutdown_connections 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.735+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/1974616574 wait complete. 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 Processor -- start 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 -- start start 2024-08-31T04:32:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8112720 con 0x7f5dd8108170 2024-08-31T04:32:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81125a0 con 0x7f5dd8102880 2024-08-31T04:32:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5ddd0f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81128a0 con 0x7f5dd8108ac0 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41798/0 (socket says 172.21.15.2:41798) 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54662/0 (socket says 172.21.15.2:54662) 2024-08-31T04:32:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/2309169281 learned_addr learned my addr 172.21.15.2:0/2309169281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.736+0000 7f5dd759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46194/0 (socket says 172.21.15.2:46194) 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 -- 172.21.15.2:0/2309169281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 msgr2=0x7f5dd819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 -- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 msgr2=0x7f5dd819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 -- 172.21.15.2:0/2309169281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd81a0110 con 0x7f5dd8108ac0 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd659c640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dd759e640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dd002ade0 tx=0x7f5dd0031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dbffff640 1 -- 172.21.15.2:0/2309169281 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0003b70 con 0x7f5dd8108ac0 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dbffff640 1 -- 172.21.15.2:0/2309169281 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd0031910 con 0x7f5dd8108ac0 2024-08-31T04:32:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd81a03a0 con 0x7f5dd8108ac0 2024-08-31T04:32:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5dbffff640 1 -- 172.21.15.2:0/2309169281 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd002f950 con 0x7f5dd8108ac0 2024-08-31T04:32:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.737+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd81a6b60 con 0x7f5dd8108ac0 2024-08-31T04:32:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5dbffff640 1 -- 172.21.15.2:0/2309169281 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5dd002faf0 con 0x7f5dd8108ac0 2024-08-31T04:32:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 Processor -- start 2024-08-31T04:32:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 -- start start 2024-08-31T04:32:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da47cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da48200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a4d9bd5f0 con 0x562a4d6a1350 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562a4d9acb80 con 0x562a4d680670 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.740+0000 7f5de366c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562a4d9b0b30 con 0x562a4d678490 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54668/0 (socket says 172.21.15.2:54668) 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd659c640 1 -- 172.21.15.2:0/236244858 learned_addr learned my addr 172.21.15.2:0/236244858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da47cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dbffff640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 0x7f5dc00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd659c640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da48200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd759e640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 0x7f5dc00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/236244858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 msgr2=0x562a4da48200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da48200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/236244858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 msgr2=0x562a4da47780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dbffff640 1 -- 172.21.15.2:0/2309169281 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f5dd0106ae0 con 0x7f5dd8108ac0 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/236244858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4d70c930 con 0x562a4d678490 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd659c640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.741+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da47cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80114f0 tx=0x7f5dc80119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f372bcdb15d27428 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5dd759e640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 0x7f5dc00b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00ccc90 tx=0x7f5dd0003f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5dbd7fa640 1 -- 172.21.15.2:0/236244858 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011250 con 0x562a4d678490 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5dbd7fa640 1 -- 172.21.15.2:0/236244858 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dc80035f0 con 0x562a4d678490 2024-08-31T04:32:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5dbd7fa640 1 -- 172.21.15.2:0/236244858 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80044e0 con 0x562a4d678490 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5de366c740 1 -- 172.21.15.2:0/236244858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 msgr2=0x562a4da47cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.742+0000 7f5de366c740 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da47cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80114f0 tx=0x7f5dc80119b0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 -- 172.21.15.2:0/236244858 shutdown_connections 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da48200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da47cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 --2- 172.21.15.2:0/236244858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da47780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 -- 172.21.15.2:0/236244858 >> 172.21.15.2:0/236244858 conn(0x562a4d695740 msgr2=0x562a4da45670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 -- 172.21.15.2:0/236244858 shutdown_connections 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 -- 172.21.15.2:0/236244858 wait complete. 2024-08-31T04:32:06.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 -- start start 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.743+0000 7f5de366c740 1 Processor -- start 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da52ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a4d80f890 con 0x562a4d6a1350 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562a4d933790 con 0x562a4d680670 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562a4da55f60 con 0x562a4d678490 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5de366c740 10 client.0 _ll_register_callbacks cb 0x562a4d6b8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41822/0 (socket says 172.21.15.2:41822) 2024-08-31T04:32:06.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/1100323261 learned_addr learned my addr 172.21.15.2:0/1100323261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54678/0 (socket says 172.21.15.2:54678) 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da52ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 -- 172.21.15.2:0/1100323261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 msgr2=0x562a4da52ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da52ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 -- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 msgr2=0x562a4da53410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 -- 172.21.15.2:0/1100323261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4d96af30 con 0x562a4d6a1350 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dd659c640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc013d80 tx=0x7f5dcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a865951128a783d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.744+0000 7f5dbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc011c40 con 0x562a4d6a1350 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc80035f0 con 0x562a4d6a1350 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f5dcc011de0 con 0x562a4d6a1350 2024-08-31T04:32:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5dcc02c050 con 0x562a4d6a1350 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 10 client.16605 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a4da61d10 con 0x562a4d6a1350 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dc80035f0 con 0x562a4d6a1350 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f5dcc00ec60 con 0x562a4d6a1350 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 10 client.16605 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 20 client.16605 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d65fcd0 0x562a4da65270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 4 client.16605 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.745+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a4d9bf540 con 0x562a4d65fcd0 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.746+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d65fcd0 0x562a4da65270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.746+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d65fcd0 0x562a4da65270 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1992806d5c118409 server_cookie=aebdacc5123f8060 in_seq=0 out_seq=0 2024-08-31T04:32:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.746+0000 7f5dbaff5640 10 client.16605 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5dbaff5640 1 -- 172.21.15.2:0/1100323261 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a4d9bf540 con 0x562a4d65fcd0 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5dbaff5640 10 client.16605 handle_command_reply: tid=0 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 client.16605 shutdown 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 msgr2=0x562a4da5f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc013d80 tx=0x7f5dcc004730 comp rx=0 tx=0).stop 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 shutdown_connections 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d65fcd0 0x562a4da65270 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d6a1350 0x562a4da5f250 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da53410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 --2- 172.21.15.2:0/1100323261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da52ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.747+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 >> 172.21.15.2:0/1100323261 conn(0x562a4d695740 msgr2=0x562a4da4a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.748+0000 7f5dbaff5640 0 client.16605 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.748+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 shutdown_connections 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.748+0000 7f5de366c740 1 -- 172.21.15.2:0/1100323261 wait complete. 2024-08-31T04:32:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.748+0000 7f5de366c740 20 client.16605 trim_cache size 0 max 16384 2024-08-31T04:32:06.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 Processor -- start 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 -- start start 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da54db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 0x562a4da5f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81b39a0 con 0x562a4d680670 2024-08-31T04:32:06.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.766+0000 7f5de366c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81b1240 con 0x562a4d6a1350 2024-08-31T04:32:06.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5de366c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81af0b0 con 0x562a4d678490 2024-08-31T04:32:06.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54690/0 (socket says 172.21.15.2:54690) 2024-08-31T04:32:06.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/3367512334 learned_addr learned my addr 172.21.15.2:0/3367512334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:06.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 0x562a4da5f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/3367512334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 msgr2=0x562a4da54db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da54db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/3367512334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 msgr2=0x562a4da5f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 0x562a4da5f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 -- 172.21.15.2:0/3367512334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4da45bb0 con 0x562a4d680670 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 0x562a4da5f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8003f00 tx=0x7f5dc8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bff6c992c6903c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dbcff9640 1 -- 172.21.15.2:0/3367512334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8004120 con 0x562a4d680670 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dbcff9640 1 -- 172.21.15.2:0/3367512334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dc8005500 con 0x562a4d680670 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.767+0000 7f5dbcff9640 1 -- 172.21.15.2:0/3367512334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800f5c0 con 0x562a4d680670 2024-08-31T04:32:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 -- 172.21.15.2:0/3367512334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 msgr2=0x562a4da48ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8003f00 tx=0x7f5dc8005d50 comp rx=0 tx=0).stop 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 -- 172.21.15.2:0/3367512334 shutdown_connections 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d680670 0x562a4da48ec0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d6a1350 0x562a4da5f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 --2- 172.21.15.2:0/3367512334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d678490 0x562a4da54db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 -- 172.21.15.2:0/3367512334 >> 172.21.15.2:0/3367512334 conn(0x562a4d695740 msgr2=0x562a4da487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 -- 172.21.15.2:0/3367512334 shutdown_connections 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.768+0000 7f5de366c740 1 -- 172.21.15.2:0/3367512334 wait complete. 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 -- start start 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 Processor -- start 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da57df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d6a1350 0x562a4dacec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81af700 con 0x562a4d678490 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81b0b70 con 0x562a4d680670 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81afdd0 con 0x562a4d6a1350 2024-08-31T04:32:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5de366c740 10 client.0 _ll_register_callbacks cb 0x7f5dcc013a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5dd659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54692/0 (socket says 172.21.15.2:54692) 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5dd659c640 1 -- 172.21.15.2:0/3996472188 learned_addr learned my addr 172.21.15.2:0/3996472188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.769+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da57df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d6a1350 0x562a4dacec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 -- 172.21.15.2:0/3996472188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d6a1350 msgr2=0x562a4dacec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d6a1350 0x562a4dacec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 -- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 msgr2=0x562a4da57df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da57df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 -- 172.21.15.2:0/3996472188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4dacf1b0 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dd659c640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc013d80 tx=0x7f5dcc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c480eaecc588cb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc013720 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f5dcc011040 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc8005500 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5dcc03f050 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5de366c740 10 client.16611 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.770+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a4dad0450 con 0x562a4d678490 2024-08-31T04:32:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dc8005500 con 0x562a4d678490 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f5dcc00ebd0 con 0x562a4d678490 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 10 client.16611 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 20 client.16611 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d635080 0x562a4dad2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 4 client.16611 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562a4d9bafe0 con 0x562a4d635080 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d635080 0x562a4dad2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5dd6d9d640 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d635080 0x562a4dad2bb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324ec8b75b7ca272 server_cookie=769683194c99b3c2 in_seq=0 out_seq=0 2024-08-31T04:32:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.771+0000 7f5dbaff5640 10 client.16611 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5dbaff5640 1 -- 172.21.15.2:0/3996472188 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562a4d9bafe0 con 0x562a4d635080 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5dbaff5640 10 client.16611 handle_command_reply: tid=0 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5de366c740 1 client.16611 shutdown 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 msgr2=0x562a4da578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc013d80 tx=0x7f5dcc009f10 comp rx=0 tx=0).stop 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.773+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 shutdown_connections 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562a4d635080 0x562a4dad2bb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562a4d6a1350 0x562a4dacec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5dbaff5640 0 client.16611 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a4d680670 0x562a4da57df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 --2- 172.21.15.2:0/3996472188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a4d678490 0x562a4da578b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 >> 172.21.15.2:0/3996472188 conn(0x562a4d695740 msgr2=0x562a4da54b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 shutdown_connections 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 1 -- 172.21.15.2:0/3996472188 wait complete. 2024-08-31T04:32:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5de366c740 20 client.16611 trim_cache size 0 max 16384 2024-08-31T04:32:06.789 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:32:06.789 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:32:06.789 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "d72f184e-1910-4c91-8ce9-7ba478537461", 2024-08-31T04:32:06.789 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:32:06.789 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:32:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 msgr2=0x7f5dc00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 0x7f5dc00b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00ccc90 tx=0x7f5dd0003f10 comp rx=0 tx=0).stop 2024-08-31T04:32:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 msgr2=0x7f5dd819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.774+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dd002ade0 tx=0x7f5dd0031660 comp rx=0 tx=0).stop 2024-08-31T04:32:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 shutdown_connections 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5dc00b4ca0 0x7f5dc00b71b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd8108170 0x7f5dd819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8108ac0 0x7f5dd819f9e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 --2- 172.21.15.2:0/2309169281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd8102880 0x7f5dd819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 >> 172.21.15.2:0/2309169281 conn(0x7f5dd8079500 msgr2=0x7f5dd8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 shutdown_connections 2024-08-31T04:32:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:06.775+0000 7f5ddd0f7640 1 -- 172.21.15.2:0/2309169281 wait complete. 2024-08-31T04:32:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:06 smithi064 ceph-mon[22007]: pgmap v540: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 255 op/s 2024-08-31T04:32:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:06 smithi132 ceph-mon[22335]: pgmap v540: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 255 op/s 2024-08-31T04:32:07.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 663918 11.63 MB/sec execute 207 sec latency 98.995 ms 2024-08-31T04:32:07.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:32:08.019 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:08.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 -- 172.21.15.2:0/466897520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088102880 msgr2=0x7f8088102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 --2- 172.21.15.2:0/466897520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088102880 0x7f8088102c90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8078009900 tx=0x7f807802a410 comp rx=0 tx=0).stop 2024-08-31T04:32:08.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 -- 172.21.15.2:0/466897520 shutdown_connections 2024-08-31T04:32:08.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 --2- 172.21.15.2:0/466897520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088108ac0 0x7f808810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 --2- 172.21.15.2:0/466897520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f8088108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 --2- 172.21.15.2:0/466897520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088102880 0x7f8088102c90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 -- 172.21.15.2:0/466897520 >> 172.21.15.2:0/466897520 conn(0x7f8088079530 msgr2=0x7f8088079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 -- 172.21.15.2:0/466897520 shutdown_connections 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.532+0000 7f808de24640 1 -- 172.21.15.2:0/466897520 wait complete. 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 Processor -- start 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 -- start start 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f808819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088108ac0 0x7f808819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80881138a0 con 0x7f8088108ac0 2024-08-31T04:32:08.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8088113720 con 0x7f8088102880 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f808de24640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8088113a20 con 0x7f8088108170 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.533+0000 7f80877fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f807effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f808819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:41858/0 (socket says 172.21.15.2:41858) 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 -- 172.21.15.2:0/2740310799 learned_addr learned my addr 172.21.15.2:0/2740310799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f8087fff640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088108ac0 0x7f808819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 -- 172.21.15.2:0/2740310799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 msgr2=0x7f808819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f808819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 -- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088108ac0 msgr2=0x7f808819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088108ac0 0x7f808819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 -- 172.21.15.2:0/2740310799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80881a01a0 con 0x7f8088102880 2024-08-31T04:32:08.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f807effd640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f808819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80877fe640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8078005940 tx=0x7f80780040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80857fa640 1 -- 172.21.15.2:0/2740310799 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807803f030 con 0x7f8088102880 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881a0430 con 0x7f8088102880 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80857fa640 1 -- 172.21.15.2:0/2740310799 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80780044c0 con 0x7f8088102880 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f80857fa640 1 -- 172.21.15.2:0/2740310799 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078035070 con 0x7f8088102880 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.534+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80881a6bf0 con 0x7f8088102880 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 Processor -- start 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 -- start start 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb61070 0x56419ff062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff06800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419fe7d630 con 0x56419fb40390 2024-08-31T04:32:08.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56419fe6cbc0 con 0x56419fb61070 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8094399740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56419fe70b70 con 0x56419fb381b0 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f80857fa640 1 -- 172.21.15.2:0/2740310799 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8078042030 con 0x7f8088102880 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f807effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f807effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54722/0 (socket says 172.21.15.2:54722) 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f807effd640 1 -- 172.21.15.2:0/238777230 learned_addr learned my addr 172.21.15.2:0/238777230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.537+0000 7f8087fff640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb61070 0x56419ff062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f80877fe640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff06800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 -- 172.21.15.2:0/238777230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 msgr2=0x56419ff06800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff06800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 -- 172.21.15.2:0/238777230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb61070 msgr2=0x56419ff062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb61070 0x56419ff062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 -- 172.21.15.2:0/238777230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419fbcc650 con 0x56419fb40390 2024-08-31T04:32:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f80877fe640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff06800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807effd640 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80700114a0 tx=0x7f8070011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7371b8b810674bd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807dffb640 1 -- 172.21.15.2:0/238777230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807001e070 con 0x56419fb40390 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807dffb640 1 -- 172.21.15.2:0/238777230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80700035f0 con 0x56419fb40390 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f807dffb640 1 -- 172.21.15.2:0/238777230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807000f880 con 0x56419fb40390 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.538+0000 7f80857fa640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 0x7f80740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8087fff640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 0x7f80740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f80857fa640 1 -- 172.21.15.2:0/2740310799 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f8078105a90 con 0x7f8088102880 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8087fff640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 0x7f80740b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 -- 172.21.15.2:0/238777230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 msgr2=0x56419ff06d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80700114a0 tx=0x7f8070011960 comp rx=0 tx=0).stop 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 -- 172.21.15.2:0/238777230 shutdown_connections 2024-08-31T04:32:08.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb40390 0x56419ff06d40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff06800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 --2- 172.21.15.2:0/238777230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb61070 0x56419ff062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 -- 172.21.15.2:0/238777230 >> 172.21.15.2:0/238777230 conn(0x56419fb55460 msgr2=0x56419ff041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 -- 172.21.15.2:0/238777230 shutdown_connections 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.539+0000 7f8094399740 1 -- 172.21.15.2:0/238777230 wait complete. 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 -- start start 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 Processor -- start 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff15ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419fccf700 con 0x56419fb61070 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56419fdf3700 con 0x56419fb40390 2024-08-31T04:32:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56419ff18dd0 con 0x56419fb381b0 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8094399740 10 client.0 _ll_register_callbacks cb 0x56419fe22dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8087fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f807effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8087fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54738/0 (socket says 172.21.15.2:54738) 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f8087fff640 1 -- 172.21.15.2:0/2782659734 learned_addr learned my addr 172.21.15.2:0/2782659734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.540+0000 7f80877fe640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff15ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 -- 172.21.15.2:0/2782659734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 msgr2=0x56419ff15ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff15ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 -- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 msgr2=0x56419ff163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff163e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 -- 172.21.15.2:0/2782659734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419fe2c8b0 con 0x56419fb61070 2024-08-31T04:32:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f807effd640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f80877fe640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff15ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8087fff640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f80800040b0 tx=0x7f8080004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c6cd06e8649d98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8066ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808000f910 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f808000fab0 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80700035f0 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f808000fcf0 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8094399740 10 client.16623 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56419ff24cf0 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.541+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80700035f0 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f8080027070 con 0x56419fb61070 2024-08-31T04:32:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 10 client.16623 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 20 client.16623 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419fb1f9f0 0x56419ff282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 4 client.16623 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56419fe7f580 con 0x56419fb1f9f0 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f80877fe640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419fb1f9f0 0x56419ff282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f80877fe640 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419fb1f9f0 0x56419ff282e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5dfe3bf04465024 server_cookie=f84b005ca6e182b5 in_seq=0 out_seq=0 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.542+0000 7f8066ffd640 10 client.16623 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.543+0000 7f8066ffd640 1 -- 172.21.15.2:0/2782659734 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56419fe7f580 con 0x56419fb1f9f0 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.543+0000 7f8066ffd640 10 client.16623 handle_command_reply: tid=0 2024-08-31T04:32:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.543+0000 7f8094399740 1 client.16623 shutdown 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.543+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 msgr2=0x56419ff22100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.543+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f80800040b0 tx=0x7f8080004ab0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 shutdown_connections 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419fb1f9f0 0x56419ff282e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff22100 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 --2- 172.21.15.2:0/2782659734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff15ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 >> 172.21.15.2:0/2782659734 conn(0x56419fb55460 msgr2=0x56419ff09450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8066ffd640 0 client.16623 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 shutdown_connections 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 1 -- 172.21.15.2:0/2782659734 wait complete. 2024-08-31T04:32:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.544+0000 7f8094399740 20 client.16623 trim_cache size 0 max 16384 2024-08-31T04:32:08.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 Processor -- start 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 -- start start 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff15e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb61070 0x56419ff22000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b1720 con 0x56419fb381b0 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80881aefc0 con 0x56419fb40390 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8094399740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f80881ace30 con 0x56419fb61070 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f807effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff15e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54750/0 (socket says 172.21.15.2:54750) 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 -- 172.21.15.2:0/2750544393 learned_addr learned my addr 172.21.15.2:0/2750544393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f8087fff640 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb61070 0x56419ff22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 -- 172.21.15.2:0/2750544393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb61070 msgr2=0x56419ff22000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb61070 0x56419ff22000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 -- 172.21.15.2:0/2750544393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 msgr2=0x56419ff15e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff15e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f80877fe640 1 -- 172.21.15.2:0/2750544393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419ff14e00 con 0x56419fb381b0 2024-08-31T04:32:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.563+0000 7f807effd640 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff15e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.564+0000 7f80877fe640 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8078032af0 tx=0x7f8078003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf8fbe648e0e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.564+0000 7f807d7fa640 1 -- 172.21.15.2:0/2750544393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078049040 con 0x56419fb381b0 2024-08-31T04:32:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.564+0000 7f807d7fa640 1 -- 172.21.15.2:0/2750544393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f807810c030 con 0x56419fb381b0 2024-08-31T04:32:08.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.564+0000 7f807d7fa640 1 -- 172.21.15.2:0/2750544393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780d4f70 con 0x56419fb381b0 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- 172.21.15.2:0/2750544393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 msgr2=0x56419ff09b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8078032af0 tx=0x7f8078003f90 comp rx=0 tx=0).stop 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- 172.21.15.2:0/2750544393 shutdown_connections 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb61070 0x56419ff22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff15e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 --2- 172.21.15.2:0/2750544393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb381b0 0x56419ff09b60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- 172.21.15.2:0/2750544393 >> 172.21.15.2:0/2750544393 conn(0x56419fb55460 msgr2=0x56419ff09450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- 172.21.15.2:0/2750544393 shutdown_connections 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- 172.21.15.2:0/2750544393 wait complete. 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 -- start start 2024-08-31T04:32:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.565+0000 7f8094399740 1 Processor -- start 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff1a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80881ad480 con 0x56419fb61070 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80881ae8f0 con 0x56419fb40390 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f80881adb50 con 0x56419fb381b0 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8094399740 10 client.0 _ll_register_callbacks cb 0x7f8080009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8087fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8087fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54762/0 (socket says 172.21.15.2:54762) 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:46280/0 (socket says 172.21.15.2:46280) 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8087fff640 1 -- 172.21.15.2:0/4284809357 learned_addr learned my addr 172.21.15.2:0/4284809357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f807effd640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff1a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 -- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 msgr2=0x56419ff1a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff1a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 -- 172.21.15.2:0/4284809357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 msgr2=0x56419ff1aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f80877fe640 1 -- 172.21.15.2:0/4284809357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419ff91ca0 con 0x56419fb381b0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.566+0000 7f8087fff640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f80877fe640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80780cbbe0 tx=0x7f8078107f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6858abdf09967ebd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078049030 con 0x56419fb381b0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9752+0+0 (secure 0 0 0) 0x7f8078102f30 con 0x56419fb381b0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f807810c030 con 0x56419fb381b0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8078103130 con 0x56419fb381b0 2024-08-31T04:32:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 10 client.26170 fetch_fsmap learned FSMap version 29 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56419ff92e60 con 0x56419fb381b0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f807810c030 con 0x56419fb381b0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f807804c060 con 0x56419fb381b0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 10 client.26170 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 10 client.26170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 20 client.26170 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419faf4da0 0x56419ff95480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 4 client.26170 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.567+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56419fe7b020 con 0x56419faf4da0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.568+0000 7f807effd640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419faf4da0 0x56419ff95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.568+0000 7f8066ffd640 10 client.26170 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.568+0000 7f807effd640 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419faf4da0 0x56419ff95480 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3969e0f3ca8382 server_cookie=4ddb8c4b5a4286c9 in_seq=0 out_seq=0 2024-08-31T04:32:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8066ffd640 1 -- 172.21.15.2:0/4284809357 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x56419fe7b020 con 0x56419faf4da0 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8066ffd640 10 client.26170 handle_command_reply: tid=0 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 client.26170 shutdown 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 msgr2=0x56419ff19fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80780cbbe0 tx=0x7f8078107f50 comp rx=0 tx=0).stop 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 shutdown_connections 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56419faf4da0 0x56419ff95480 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8066ffd640 0 client.26170 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419fb61070 0x56419ff1aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56419fb40390 0x56419ff1a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 --2- 172.21.15.2:0/4284809357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56419fb381b0 0x56419ff19fc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.569+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 >> 172.21.15.2:0/4284809357 conn(0x56419fb55460 msgr2=0x56419ff03ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.570+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 shutdown_connections 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.570+0000 7f8094399740 1 -- 172.21.15.2:0/4284809357 wait complete. 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.570+0000 7f8094399740 20 client.26170 trim_cache size 0 max 16384 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "d72f184e-1910-4c91-8ce9-7ba478537461", 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:32:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:32:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:08.587 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 msgr2=0x7f80740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 0x7f80740b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080009500 comp rx=0 tx=0).stop 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 msgr2=0x7f808819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8078005940 tx=0x7f80780040c0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 shutdown_connections 2024-08-31T04:32:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f80740b4ca0 0x7f80740b71b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8088108ac0 0x7f808819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088108170 0x7f808819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 --2- 172.21.15.2:0/2740310799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8088102880 0x7f808819a230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 >> 172.21.15.2:0/2740310799 conn(0x7f8088079530 msgr2=0x7f8088106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 shutdown_connections 2024-08-31T04:32:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:08.571+0000 7f808de24640 1 -- 172.21.15.2:0/2740310799 wait complete. 2024-08-31T04:32:08.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 665521 11.62 MB/sec execute 208 sec latency 107.320 ms 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:08 smithi064 ceph-mon[22007]: pgmap v541: 129 pgs: 129 active+clean; 418 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 256 op/s 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:08 smithi132 ceph-mon[22335]: pgmap v541: 129 pgs: 129 active+clean; 418 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 256 op/s 2024-08-31T04:32:08.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:32:08.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:32:08.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:32:08.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:08.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:08 smithi002 ceph-mon[18656]: pgmap v541: 129 pgs: 129 active+clean; 418 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 256 op/s 2024-08-31T04:32:09.365 INFO:tasks.cephfs.filesystem:scrub status for tag:d72f184e-1910-4c91-8ce9-7ba478537461 - {'path': '/', 'tag': 'd72f184e-1910-4c91-8ce9-7ba478537461', 'options': 'recursive,force'} 2024-08-31T04:32:09.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 667618 11.62 MB/sec execute 209 sec latency 106.196 ms 2024-08-31T04:32:10.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 669205 11.60 MB/sec execute 210 sec latency 27.252 ms 2024-08-31T04:32:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:10 smithi064 ceph-mon[22007]: pgmap v542: 129 pgs: 129 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:32:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:10 smithi132 ceph-mon[22335]: pgmap v542: 129 pgs: 129 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:32:10.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:10 smithi002 ceph-mon[18656]: pgmap v542: 129 pgs: 129 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:32:11.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 671475 11.61 MB/sec execute 211 sec latency 18.096 ms 2024-08-31T04:32:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:12 smithi064 ceph-mon[22007]: pgmap v543: 129 pgs: 129 active+clean; 422 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:32:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:12 smithi064 ceph-mon[22007]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T04:32:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:12 smithi132 ceph-mon[22335]: pgmap v543: 129 pgs: 129 active+clean; 422 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:32:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:12 smithi132 ceph-mon[22335]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T04:32:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:12 smithi002 ceph-mon[18656]: pgmap v543: 129 pgs: 129 active+clean; 422 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T04:32:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:12 smithi002 ceph-mon[18656]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T04:32:12.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 673059 11.58 MB/sec execute 212 sec latency 46.692 ms 2024-08-31T04:32:13.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:13 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:32:13.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:13 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:32:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:13 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:32:13.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:13 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:32:13.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:13 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:32:13.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:13 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:32:13.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 675369 11.59 MB/sec execute 213 sec latency 13.746 ms 2024-08-31T04:32:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:14 smithi064 ceph-mon[22007]: pgmap v545: 129 pgs: 129 active+clean; 426 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2024-08-31T04:32:14.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:14 smithi132 ceph-mon[22335]: pgmap v545: 129 pgs: 129 active+clean; 426 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2024-08-31T04:32:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:14 smithi002 ceph-mon[18656]: pgmap v545: 129 pgs: 129 active+clean; 426 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2024-08-31T04:32:14.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 677144 11.57 MB/sec execute 214 sec latency 84.149 ms 2024-08-31T04:32:15.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 679061 11.57 MB/sec execute 215 sec latency 26.231 ms 2024-08-31T04:32:16.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:16 smithi064 ceph-mon[22007]: pgmap v546: 129 pgs: 129 active+clean; 430 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-31T04:32:16.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:16 smithi132 ceph-mon[22335]: pgmap v546: 129 pgs: 129 active+clean; 430 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-31T04:32:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:16 smithi002 ceph-mon[18656]: pgmap v546: 129 pgs: 129 active+clean; 430 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-31T04:32:16.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 681330 11.58 MB/sec execute 216 sec latency 23.370 ms 2024-08-31T04:32:17.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 683115 11.56 MB/sec execute 217 sec latency 40.393 ms 2024-08-31T04:32:18.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:18 smithi064 ceph-mon[22007]: pgmap v547: 129 pgs: 129 active+clean; 439 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T04:32:18.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:18 smithi132 ceph-mon[22335]: pgmap v547: 129 pgs: 129 active+clean; 439 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T04:32:18.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:18 smithi002 ceph-mon[18656]: pgmap v547: 129 pgs: 129 active+clean; 439 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T04:32:18.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 685559 11.58 MB/sec execute 218 sec latency 18.446 ms 2024-08-31T04:32:19.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 686930 11.56 MB/sec execute 219 sec latency 43.502 ms 2024-08-31T04:32:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:20 smithi064 ceph-mon[22007]: pgmap v548: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 260 op/s 2024-08-31T04:32:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:20 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:32:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:20 smithi132 ceph-mon[22335]: pgmap v548: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 260 op/s 2024-08-31T04:32:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:20 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:32:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:20 smithi002 ceph-mon[18656]: pgmap v548: 129 pgs: 129 active+clean; 438 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 260 op/s 2024-08-31T04:32:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:20 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:32:20.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 689336 11.57 MB/sec execute 220 sec latency 16.461 ms 2024-08-31T04:32:21.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 691338 11.55 MB/sec execute 221 sec latency 33.938 ms 2024-08-31T04:32:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:22 smithi064 ceph-mon[22007]: pgmap v549: 129 pgs: 129 active+clean; 441 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 236 op/s 2024-08-31T04:32:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:22 smithi132 ceph-mon[22335]: pgmap v549: 129 pgs: 129 active+clean; 441 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 236 op/s 2024-08-31T04:32:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:22 smithi002 ceph-mon[18656]: pgmap v549: 129 pgs: 129 active+clean; 441 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 236 op/s 2024-08-31T04:32:22.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 693301 11.55 MB/sec execute 222 sec latency 41.474 ms 2024-08-31T04:32:23.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 695848 11.56 MB/sec execute 223 sec latency 41.023 ms 2024-08-31T04:32:24.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:24 smithi002 ceph-mon[18656]: pgmap v550: 129 pgs: 129 active+clean; 445 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:32:24.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:24 smithi064 ceph-mon[22007]: pgmap v550: 129 pgs: 129 active+clean; 445 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:32:24.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:24 smithi132 ceph-mon[22335]: pgmap v550: 129 pgs: 129 active+clean; 445 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:32:24.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 697144 11.54 MB/sec execute 224 sec latency 45.429 ms 2024-08-31T04:32:25.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 699667 11.56 MB/sec execute 225 sec latency 19.009 ms 2024-08-31T04:32:26.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:26 smithi064 ceph-mon[22007]: pgmap v551: 129 pgs: 129 active+clean; 452 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T04:32:26.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:26 smithi132 ceph-mon[22335]: pgmap v551: 129 pgs: 129 active+clean; 452 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T04:32:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:26 smithi002 ceph-mon[18656]: pgmap v551: 129 pgs: 129 active+clean; 452 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T04:32:26.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 701242 11.54 MB/sec execute 226 sec latency 38.811 ms 2024-08-31T04:32:27.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 703538 11.55 MB/sec execute 227 sec latency 15.805 ms 2024-08-31T04:32:28.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:28 smithi064 ceph-mon[22007]: pgmap v552: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-08-31T04:32:28.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:28 smithi132 ceph-mon[22335]: pgmap v552: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-08-31T04:32:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:28 smithi002 ceph-mon[18656]: pgmap v552: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-08-31T04:32:28.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 705531 11.53 MB/sec execute 228 sec latency 41.712 ms 2024-08-31T04:32:29.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 707206 11.53 MB/sec execute 229 sec latency 79.631 ms 2024-08-31T04:32:30.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:30 smithi064 ceph-mon[22007]: pgmap v553: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T04:32:30.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:30 smithi132 ceph-mon[22335]: pgmap v553: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T04:32:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:30 smithi002 ceph-mon[18656]: pgmap v553: 129 pgs: 129 active+clean; 453 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T04:32:30.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 709592 11.54 MB/sec execute 230 sec latency 28.450 ms 2024-08-31T04:32:31.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 711642 11.54 MB/sec execute 231 sec latency 28.530 ms 2024-08-31T04:32:32.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:32 smithi064 ceph-mon[22007]: pgmap v554: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-31T04:32:32.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:32 smithi132 ceph-mon[22335]: pgmap v554: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-31T04:32:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:32 smithi002 ceph-mon[18656]: pgmap v554: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-31T04:32:32.679 INFO:tasks.workunit.client.0.smithi002.stdout: 1 714024 11.55 MB/sec execute 232 sec latency 15.993 ms 2024-08-31T04:32:33.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 715457 11.52 MB/sec execute 233 sec latency 60.874 ms 2024-08-31T04:32:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:34 smithi002 ceph-mon[18656]: pgmap v555: 129 pgs: 129 active+clean; 463 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-31T04:32:34.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 717662 11.53 MB/sec execute 234 sec latency 34.564 ms 2024-08-31T04:32:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:34 smithi064 ceph-mon[22007]: pgmap v555: 129 pgs: 129 active+clean; 463 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-31T04:32:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:34 smithi132 ceph-mon[22335]: pgmap v555: 129 pgs: 129 active+clean; 463 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-31T04:32:35.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 719708 11.51 MB/sec execute 235 sec latency 43.191 ms 2024-08-31T04:32:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:36 smithi002 ceph-mon[18656]: pgmap v556: 129 pgs: 129 active+clean; 467 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T04:32:36.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 721764 11.52 MB/sec execute 236 sec latency 27.553 ms 2024-08-31T04:32:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:36 smithi064 ceph-mon[22007]: pgmap v556: 129 pgs: 129 active+clean; 467 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T04:32:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:36 smithi132 ceph-mon[22335]: pgmap v556: 129 pgs: 129 active+clean; 467 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T04:32:37.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 724214 11.53 MB/sec execute 237 sec latency 19.976 ms 2024-08-31T04:32:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:38 smithi002 ceph-mon[18656]: pgmap v557: 129 pgs: 129 active+clean; 476 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.3 MiB/s wr, 257 op/s 2024-08-31T04:32:38.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 725839 11.52 MB/sec execute 238 sec latency 39.901 ms 2024-08-31T04:32:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:38 smithi132 ceph-mon[22335]: pgmap v557: 129 pgs: 129 active+clean; 476 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.3 MiB/s wr, 257 op/s 2024-08-31T04:32:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:38 smithi064 ceph-mon[22007]: pgmap v557: 129 pgs: 129 active+clean; 476 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.3 MiB/s wr, 257 op/s 2024-08-31T04:32:39.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:32:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:39.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 728065 11.52 MB/sec execute 239 sec latency 56.845 ms 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 -- 172.21.15.2:0/3788392313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 msgr2=0x7f53b8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/3788392313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8108580 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009900 tx=0x7f53a802a410 comp rx=0 tx=0).stop 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 -- 172.21.15.2:0/3788392313 shutdown_connections 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/3788392313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8108580 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/3788392313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8108ac0 0x7f53b810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/3788392313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8102880 0x7f53b8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 -- 172.21.15.2:0/3788392313 >> 172.21.15.2:0/3788392313 conn(0x7f53b8079530 msgr2=0x7f53b8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 -- 172.21.15.2:0/3788392313 shutdown_connections 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.186+0000 7f53bfa3f640 1 -- 172.21.15.2:0/3788392313 wait complete. 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 Processor -- start 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 -- start start 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 0x7f53b810fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8108ac0 0x7f53b8110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81138a0 con 0x7f53b8108170 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8113720 con 0x7f53b8108ac0 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.187+0000 7f53bfa3f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8113a20 con 0x7f53b8102880 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bcfda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bcfda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56876/0 (socket says 172.21.15.2:56876) 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 0x7f53b810fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8108ac0 0x7f53b8110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bcfda640 1 -- 172.21.15.2:0/2669603242 learned_addr learned my addr 172.21.15.2:0/2669603242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 -- 172.21.15.2:0/2669603242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8108ac0 msgr2=0x7f53b8110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8108ac0 0x7f53b8110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 -- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 msgr2=0x7f53b8110310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8110310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 -- 172.21.15.2:0/2669603242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b81a84f0 con 0x7f53b8102880 2024-08-31T04:32:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53bd7db640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 0x7f53b810fdd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e9f0 tx=0x7f53b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.188+0000 7f53ae7fc640 1 -- 172.21.15.2:0/2669603242 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b400ccc0 con 0x7f53b8102880 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.189+0000 7f53ae7fc640 1 -- 172.21.15.2:0/2669603242 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53b40108e0 con 0x7f53b8102880 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.189+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b81a87e0 con 0x7f53b8102880 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.189+0000 7f53ae7fc640 1 -- 172.21.15.2:0/2669603242 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4018880 con 0x7f53b8102880 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.189+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b81a8d20 con 0x7f53b8102880 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 Processor -- start 2024-08-31T04:32:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 -- start start 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c0541b0 0x55cd4c422800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c422d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c399630 con 0x55cd4c0541b0 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c388bc0 con 0x55cd4c05c390 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c38cb70 con 0x55cd4c07d070 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43756/0 (socket says 172.21.15.2:43756) 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53bcfda640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c422d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3573498801 learned_addr learned my addr 172.21.15.2:0/3573498801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.192+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3573498801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 msgr2=0x55cd4c422d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c422d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3573498801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c0541b0 msgr2=0x55cd4c422800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c0541b0 0x55cd4c422800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3573498801 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4c0e8650 con 0x55cd4c07d070 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53ae7fc640 1 -- 172.21.15.2:0/2669603242 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f53b4010430 con 0x7f53b8102880 2024-08-31T04:32:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009fd0 tx=0x7f53b00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350766611d87f4bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53a37fe640 1 -- 172.21.15.2:0/3573498801 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0004d20 con 0x55cd4c07d070 2024-08-31T04:32:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53a37fe640 1 -- 172.21.15.2:0/3573498801 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53b0004050 con 0x55cd4c07d070 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.193+0000 7f53a37fe640 1 -- 172.21.15.2:0/3573498801 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0005280 con 0x55cd4c07d070 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 0x7f53a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53bd7db640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 0x7f53a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53ae7fc640 1 -- 172.21.15.2:0/2669603242 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f53b40e5d00 con 0x7f53b8102880 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3573498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 msgr2=0x55cd4c4222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009fd0 tx=0x7f53b00118d0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3573498801 shutdown_connections 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c0541b0 0x55cd4c422800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c422d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3573498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c4222c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.194+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3573498801 >> 172.21.15.2:0/3573498801 conn(0x55cd4c071460 msgr2=0x55cd4c4201b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.195+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3573498801 shutdown_connections 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.195+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3573498801 wait complete. 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.195+0000 7f53bd7db640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 0x7f53a40b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55cd4c420f40 tx=0x7f53b4093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.195+0000 7f53c5fb4740 1 -- start start 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.195+0000 7f53c5fb4740 1 Processor -- start 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c05c390 0x55cd4c42dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c439d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c1eb700 con 0x55cd4c07d070 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c30f700 con 0x55cd4c0541b0 2024-08-31T04:32:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cd4c430aa0 con 0x55cd4c05c390 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:56588/0 (socket says 172.21.15.2:56588) 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.196+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3444419196 learned_addr learned my addr 172.21.15.2:0/3444419196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bcfda640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c05c390 0x55cd4c42dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53c5fb4740 10 client.0 _ll_register_callbacks cb 0x55cd4c33edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c439d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3444419196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c05c390 msgr2=0x55cd4c42dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c05c390 0x55cd4c42dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3444419196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 msgr2=0x55cd4c439d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c439d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 -- 172.21.15.2:0/3444419196 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4c3488b0 con 0x55cd4c0541b0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53b0003fd0 tx=0x7f53b0005a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c59ae360e1237693 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.197+0000 7f53a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b002b020 con 0x55cd4c0541b0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53b0004050 con 0x55cd4c0541b0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f53b000f6f0 con 0x55cd4c0541b0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53b0036050 con 0x55cd4c0541b0 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53c5fb4740 10 client.26360 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cd4c43c880 con 0x55cd4c0541b0 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.198+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53b0004050 con 0x55cd4c0541b0 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f53b0027740 con 0x55cd4c0541b0 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 10 client.26360 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 10 client.26360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 20 client.26360 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c03b9f0 0x55cd4c43fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 4 client.26360 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.199+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd4c39b580 con 0x55cd4c03b9f0 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.200+0000 7f53bcfda640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c03b9f0 0x55cd4c43fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.200+0000 7f53bcfda640 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c03b9f0 0x55cd4c43fca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c7aabd6016699e9 server_cookie=8b3e8a69c0ea595e in_seq=0 out_seq=0 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.200+0000 7f53a0ff9640 10 client.26360 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3444419196 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd4c39b580 con 0x55cd4c03b9f0 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53a0ff9640 10 client.26360 handle_command_reply: tid=0 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 client.26360 shutdown 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 msgr2=0x55cd4c42da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53b0003fd0 tx=0x7f53b0005a50 comp rx=0 tx=0).stop 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 shutdown_connections 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c03b9f0 0x55cd4c43fca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c439d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c05c390 0x55cd4c42dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53a0ff9640 0 client.26360 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/3444419196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c42da60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 >> 172.21.15.2:0/3444419196 conn(0x55cd4c071460 msgr2=0x55cd4c425450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 shutdown_connections 2024-08-31T04:32:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 1 -- 172.21.15.2:0/3444419196 wait complete. 2024-08-31T04:32:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.201+0000 7f53c5fb4740 20 client.26360 trim_cache size 0 max 16384 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.227+0000 7f53c5fb4740 1 Processor -- start 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.227+0000 7f53c5fb4740 1 -- start start 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c439c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b5ba0 con 0x55cd4c05c390 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b3470 con 0x55cd4c0541b0 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b12c0 con 0x55cd4c07d070 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:56594/0 (socket says 172.21.15.2:56594) 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56898/0 (socket says 172.21.15.2:56898) 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bdfdc640 1 -- 172.21.15.2:0/2745884594 learned_addr learned my addr 172.21.15.2:0/2745884594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c439c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 -- 172.21.15.2:0/2745884594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 msgr2=0x55cd4c439c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c439c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 -- 172.21.15.2:0/2745884594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 msgr2=0x55cd4c420200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 -- 172.21.15.2:0/2745884594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4c42c9c0 con 0x55cd4c05c390 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.228+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f53a8031440 tx=0x7f53a8005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a989afb3f6b8a120 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.229+0000 7f53a2ffd640 1 -- 172.21.15.2:0/2745884594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a804a070 con 0x55cd4c05c390 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.229+0000 7f53a2ffd640 1 -- 172.21.15.2:0/2745884594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a8031950 con 0x55cd4c05c390 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.229+0000 7f53a2ffd640 1 -- 172.21.15.2:0/2745884594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8035040 con 0x55cd4c05c390 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2745884594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 msgr2=0x55cd4c42dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f53a8031440 tx=0x7f53a8005890 comp rx=0 tx=0).stop 2024-08-31T04:32:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2745884594 shutdown_connections 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c05c390 0x55cd4c42dc00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c07d070 0x55cd4c439c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2745884594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c0541b0 0x55cd4c420200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2745884594 >> 172.21.15.2:0/2745884594 conn(0x55cd4c071460 msgr2=0x55cd4c41faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2745884594 shutdown_connections 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2745884594 wait complete. 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 -- start start 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.230+0000 7f53c5fb4740 1 Processor -- start 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c0541b0 0x55cd4c4323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c432930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b1930 con 0x55cd4c07d070 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b2da0 con 0x55cd4c05c390 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81b2000 con 0x55cd4c0541b0 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53c5fb4740 10 client.0 _ll_register_callbacks cb 0x7f53b00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56912/0 (socket says 172.21.15.2:56912) 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 -- 172.21.15.2:0/2202605634 learned_addr learned my addr 172.21.15.2:0/2202605634 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c432930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c0541b0 0x55cd4c4323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 -- 172.21.15.2:0/2202605634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c0541b0 msgr2=0x55cd4c4323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c0541b0 0x55cd4c4323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 -- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 msgr2=0x55cd4c432930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c432930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 -- 172.21.15.2:0/2202605634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4c4a9a90 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53bdfdc640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f53b0027b90 tx=0x7f53b0032040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664342117a41beb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.231+0000 7f53a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b002b040 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd4c397020 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f53b0027470 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53b0046050 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 10 client.16644 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cd4c4aad00 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cd4c397020 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f53b000f6f0 con 0x55cd4c07d070 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 10 client.16644 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 20 client.16644 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.232+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c010da0 0x55cd4c4ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53c5fb4740 4 client.16644 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd4c394760 con 0x55cd4c010da0 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c010da0 0x55cd4c4ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53bcfda640 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c010da0 0x55cd4c4ad3a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a32a6789df9e7a server_cookie=8a2649a506c311f2 in_seq=0 out_seq=0 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53a0ff9640 10 client.16644 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53a0ff9640 1 -- 172.21.15.2:0/2202605634 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55cd4c394760 con 0x55cd4c010da0 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53a0ff9640 10 client.16644 handle_command_reply: tid=0 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53c5fb4740 1 client.16644 shutdown 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 msgr2=0x55cd4c4a9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.233+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f53b0027b90 tx=0x7f53b0032040 comp rx=0 tx=0).stop 2024-08-31T04:32:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 shutdown_connections 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cd4c010da0 0x55cd4c4ad3a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd4c07d070 0x55cd4c4a9550 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cd4c05c390 0x55cd4c432930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 --2- 172.21.15.2:0/2202605634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cd4c0541b0 0x55cd4c4323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 >> 172.21.15.2:0/2202605634 conn(0x55cd4c071460 msgr2=0x55cd4c4253c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53a0ff9640 0 client.16644 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 shutdown_connections 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 1 -- 172.21.15.2:0/2202605634 wait complete. 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.234+0000 7f53c5fb4740 20 client.16644 trim_cache size 0 max 16384 2024-08-31T04:32:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:32:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:32:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 msgr2=0x7f53a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 0x7f53a40b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55cd4c420f40 tx=0x7f53b4093040 comp rx=0 tx=0).stop 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 msgr2=0x7f53b810fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 0x7f53b810fdd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e9f0 tx=0x7f53b400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 shutdown_connections 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f53a40b4ca0 0x7f53a40b71b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b8108170 0x7f53b8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53b8108ac0 0x7f53b8110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 --2- 172.21.15.2:0/2669603242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53b8102880 0x7f53b810fdd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 >> 172.21.15.2:0/2669603242 conn(0x7f53b8079530 msgr2=0x7f53b8106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 shutdown_connections 2024-08-31T04:32:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:40.235+0000 7f53bfa3f640 1 -- 172.21.15.2:0/2669603242 wait complete. 2024-08-31T04:32:40.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:40 smithi002 ceph-mon[18656]: pgmap v558: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 244 op/s 2024-08-31T04:32:40.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 729595 11.50 MB/sec execute 240 sec latency 39.439 ms 2024-08-31T04:32:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:40 smithi064 ceph-mon[22007]: pgmap v558: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 244 op/s 2024-08-31T04:32:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:40 smithi132 ceph-mon[22335]: pgmap v558: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 244 op/s 2024-08-31T04:32:41.033 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:32:41.033 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:32:41.312 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:41.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 731997 11.51 MB/sec execute 241 sec latency 15.885 ms 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 -- 172.21.15.2:0/198090146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c102880 msgr2=0x7f5c3c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 --2- 172.21.15.2:0/198090146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c102880 0x7f5c3c102c90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009900 tx=0x7f5c3802a410 comp rx=0 tx=0).stop 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 -- 172.21.15.2:0/198090146 shutdown_connections 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 --2- 172.21.15.2:0/198090146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 --2- 172.21.15.2:0/198090146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 --2- 172.21.15.2:0/198090146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c102880 0x7f5c3c102c90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 -- 172.21.15.2:0/198090146 >> 172.21.15.2:0/198090146 conn(0x7f5c3c079510 msgr2=0x7f5c3c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 -- 172.21.15.2:0/198090146 shutdown_connections 2024-08-31T04:32:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.941+0000 7f5c4470d640 1 -- 172.21.15.2:0/198090146 wait complete. 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 Processor -- start 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 -- start start 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c102880 0x7f5c3c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1127c0 con 0x7f5c3c1081c0 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c112640 con 0x7f5c3c102880 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c4470d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c112940 con 0x7f5c3c108b10 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c424a9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c102880 0x7f5c3c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56934/0 (socket says 172.21.15.2:56934) 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 -- 172.21.15.2:0/1651676884 learned_addr learned my addr 172.21.15.2:0/1651676884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c42caa640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 -- 172.21.15.2:0/1651676884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 msgr2=0x7f5c3c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 -- 172.21.15.2:0/1651676884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c102880 msgr2=0x7f5c3c199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c102880 0x7f5c3c199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c41ca8640 1 -- 172.21.15.2:0/1651676884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c19f180 con 0x7f5c3c1081c0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.942+0000 7f5c42caa640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c41ca8640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9f0 tx=0x7f5c2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00ccc0 con 0x7f5c3c1081c0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c2c0108e0 con 0x7f5c3c1081c0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c19f470 con 0x7f5c3c1081c0 2024-08-31T04:32:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c018860 con 0x7f5c3c1081c0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.943+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c06b900 con 0x7f5c3c1081c0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.944+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c103b00 con 0x7f5c3c1081c0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.945+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5c2c010430 con 0x7f5c3c1081c0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.946+0000 7f5c337fe640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 0x7f5c280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.946+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f5c2c0e61e0 con 0x7f5c3c1081c0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.946+0000 7f5c424a9640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 0x7f5c280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.947+0000 7f5c424a9640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 0x7f5c280b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c38031440 tx=0x7f5c38009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:41.949+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5c2c0acb60 con 0x7f5c3c1081c0 2024-08-31T04:32:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.179+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c3c102c90 con 0x7f5c3c1081c0 2024-08-31T04:32:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.180+0000 7f5c337fe640 1 -- 172.21.15.2:0/1651676884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11897 (secure 0 0 0) 0x7f5c2c0b50a0 con 0x7f5c3c1081c0 2024-08-31T04:32:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:32:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"btime":"2024-08-31T04:32:19:298680+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:32:18.727298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:32:42.183 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-08-31T04:32:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 msgr2=0x7f5c280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 0x7f5c280b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c38031440 tx=0x7f5c38009560 comp rx=0 tx=0).stop 2024-08-31T04:32:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 msgr2=0x7f5c3c1997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9f0 tx=0x7f5c2c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 shutdown_connections 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5c280b4ca0 0x7f5c280b71b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c3c1081c0 0x7f5c3c1997b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c3c108b10 0x7f5c3c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.182+0000 7f5c4470d640 1 --2- 172.21.15.2:0/1651676884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c3c102880 0x7f5c3c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.183+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 >> 172.21.15.2:0/1651676884 conn(0x7f5c3c079510 msgr2=0x7f5c3c106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.183+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 shutdown_connections 2024-08-31T04:32:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:42.183+0000 7f5c4470d640 1 -- 172.21.15.2:0/1651676884 wait complete. 2024-08-31T04:32:42.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:42 smithi002 ceph-mon[18656]: pgmap v559: 129 pgs: 129 active+clean; 464 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.9 MiB/s wr, 247 op/s 2024-08-31T04:32:42.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1651676884' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:32:42.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 734261 11.51 MB/sec execute 242 sec latency 33.110 ms 2024-08-31T04:32:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:42 smithi064 ceph-mon[22007]: pgmap v559: 129 pgs: 129 active+clean; 464 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.9 MiB/s wr, 247 op/s 2024-08-31T04:32:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1651676884' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:32:42.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:42 smithi132 ceph-mon[22335]: pgmap v559: 129 pgs: 129 active+clean; 464 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.9 MiB/s wr, 247 op/s 2024-08-31T04:32:42.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1651676884' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:32:42.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:32:43.138 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:43.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 735777 11.50 MB/sec execute 243 sec latency 80.459 ms 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- 172.21.15.2:0/4155805321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8109bf0 msgr2=0x7f69a8110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/4155805321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8109bf0 0x7f69a8110420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009ca0 tx=0x7f69a002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- 172.21.15.2:0/4155805321 shutdown_connections 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/4155805321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8109bf0 0x7f69a8110420 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/4155805321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a81092a0 0x7f69a81096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/4155805321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a8101d60 0x7f69a8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- 172.21.15.2:0/4155805321 >> 172.21.15.2:0/4155805321 conn(0x7f69a8079d30 msgr2=0x7f69a807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- 172.21.15.2:0/4155805321 shutdown_connections 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- 172.21.15.2:0/4155805321 wait complete. 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 Processor -- start 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.880+0000 7f69ae4f6640 1 -- start start 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a81092a0 0x7f69a819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a8109bf0 0x7f69a819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81138b0 con 0x7f69a8101d60 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8113730 con 0x7f69a8109bf0 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69ae4f6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8113a30 con 0x7f69a81092a0 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56964/0 (socket says 172.21.15.2:56964) 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69aca93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a8109bf0 0x7f69a819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 -- 172.21.15.2:0/1093489891 learned_addr learned my addr 172.21.15.2:0/1093489891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a77fe640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a81092a0 0x7f69a819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 -- 172.21.15.2:0/1093489891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a81092a0 msgr2=0x7f69a819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a81092a0 0x7f69a819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 -- 172.21.15.2:0/1093489891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a8109bf0 msgr2=0x7f69a819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a8109bf0 0x7f69a819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.881+0000 7f69a7fff640 1 -- 172.21.15.2:0/1093489891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a81a01b0 con 0x7f69a8101d60 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f699800e9f0 tx=0x7f699800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69a57fa640 1 -- 172.21.15.2:0/1093489891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800cd80 con 0x7f69a8101d60 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a81a04a0 con 0x7f69a8101d60 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69a57fa640 1 -- 172.21.15.2:0/1093489891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69980054d0 con 0x7f69a8101d60 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69a57fa640 1 -- 172.21.15.2:0/1093489891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998010690 con 0x7f69a8101d60 2024-08-31T04:32:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.882+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a81a6c00 con 0x7f69a8101d60 2024-08-31T04:32:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 Processor -- start 2024-08-31T04:32:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 -- start start 2024-08-31T04:32:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69a57fa640 1 -- 172.21.15.2:0/1093489891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6998004e90 con 0x7f69a8101d60 2024-08-31T04:32:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424d41b0 0x5641428a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424dc390 0x5641428a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564142819680 con 0x5641424fd070 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564142808c10 con 0x5641424dc390 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56414280cbc0 con 0x5641424d41b0 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69aca93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69aca93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56966/0 (socket says 172.21.15.2:56966) 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69aca93640 1 -- 172.21.15.2:0/1331135965 learned_addr learned my addr 172.21.15.2:0/1331135965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69a77fe640 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424dc390 0x5641428a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.885+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424d41b0 0x5641428a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 -- 172.21.15.2:0/1331135965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424d41b0 msgr2=0x5641428a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424d41b0 0x5641428a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 -- 172.21.15.2:0/1331135965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424dc390 msgr2=0x5641428a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424dc390 0x5641428a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 -- 172.21.15.2:0/1331135965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564142568650 con 0x5641424fd070 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69aca93640 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f69a002f440 tx=0x7f69a002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55336d9ff2336cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69a57fa640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 0x7f69900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f698e7fc640 1 -- 172.21.15.2:0/1331135965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0031cf0 con 0x5641424fd070 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 0x7f69900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f698e7fc640 1 -- 172.21.15.2:0/1331135965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a0036070 con 0x5641424fd070 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f698e7fc640 1 -- 172.21.15.2:0/1331135965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a00042a0 con 0x5641424fd070 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.886+0000 7f69a57fa640 1 -- 172.21.15.2:0/1093489891 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f69980e5e00 con 0x7f69a8101d60 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 -- 172.21.15.2:0/1331135965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 msgr2=0x5641428a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69a7fff640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 0x7f69900b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69980ac010 tx=0x7f6998004a90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f69a002f440 tx=0x7f69a002f470 comp rx=0 tx=0).stop 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 -- 172.21.15.2:0/1331135965 shutdown_connections 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424dc390 0x5641428a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424d41b0 0x5641428a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/1331135965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428a2310 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 -- 172.21.15.2:0/1331135965 >> 172.21.15.2:0/1331135965 conn(0x5641424f1460 msgr2=0x5641428a0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 -- 172.21.15.2:0/1331135965 shutdown_connections 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.887+0000 7f69b4a6b740 1 -- 172.21.15.2:0/1331135965 wait complete. 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 -- start start 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 Processor -- start 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56414266b700 con 0x5641424fd070 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56414278f750 con 0x5641424d41b0 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5641428b4c40 con 0x5641424dc390 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69b4a6b740 10 client.0 _ll_register_callbacks cb 0x5641427bee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69aca93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69aca93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:56660/0 (socket says 172.21.15.2:56660) 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69aca93640 1 -- 172.21.15.2:0/4168684234 learned_addr learned my addr 172.21.15.2:0/4168684234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.888+0000 7f69a77fe640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69aca93640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 -- 172.21.15.2:0/4168684234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 msgr2=0x5641428b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 -- 172.21.15.2:0/4168684234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 msgr2=0x5641428bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 -- 172.21.15.2:0/4168684234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641427c8900 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69a77fe640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b23f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69a806a2d0 tx=0x7f699c012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4e21d6e1e6f263d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69877fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c00f890 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a0036070 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f699c00fa30 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f699c00fc30 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69b4a6b740 10 client.26206 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.889+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5641428c0b70 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a0036070 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f699c01c420 con 0x5641424dc390 2024-08-31T04:32:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 10 client.26206 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 10 client.26206 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 20 client.26206 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5641424bb9f0 0x5641428c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 4 client.26206 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56414281b5d0 con 0x5641424bb9f0 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.890+0000 7f69aca93640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5641424bb9f0 0x5641428c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.891+0000 7f69877fe640 10 client.26206 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.891+0000 7f69aca93640 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5641424bb9f0 0x5641428c4150 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cda6e4665921dc91 server_cookie=2db01cf353b9ab0d in_seq=0 out_seq=0 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.891+0000 7f69877fe640 1 -- 172.21.15.2:0/4168684234 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56414281b5d0 con 0x5641424bb9f0 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.891+0000 7f69877fe640 10 client.26206 handle_command_reply: tid=0 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.891+0000 7f69b4a6b740 1 client.26206 shutdown 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 msgr2=0x5641428b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b23f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69a806a2d0 tx=0x7f699c012b60 comp rx=0 tx=0).stop 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 shutdown_connections 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5641424bb9f0 0x5641428c4150 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b23f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69877fe640 0 client.26206 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/4168684234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 >> 172.21.15.2:0/4168684234 conn(0x5641424f1460 msgr2=0x5641428a54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 shutdown_connections 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 1 -- 172.21.15.2:0/4168684234 wait complete. 2024-08-31T04:32:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.892+0000 7f69b4a6b740 20 client.26206 trim_cache size 0 max 16384 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 Processor -- start 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 -- start start 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428bded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424fd070 0x5641428be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81b1570 con 0x5641424d41b0 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81aee40 con 0x5641424fd070 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81acc90 con 0x5641424dc390 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56984/0 (socket says 172.21.15.2:56984) 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 -- 172.21.15.2:0/3637110213 learned_addr learned my addr 172.21.15.2:0/3637110213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69a77fe640 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424fd070 0x5641428be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 -- 172.21.15.2:0/3637110213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 msgr2=0x5641428bded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428bded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 -- 172.21.15.2:0/3637110213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424fd070 msgr2=0x5641428be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424fd070 0x5641428be410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.906+0000 7f69aca93640 1 -- 172.21.15.2:0/3637110213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641428bede0 con 0x5641424d41b0 2024-08-31T04:32:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f69aca93640 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f69a0003c40 tx=0x7f69a002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15adcdac34aab6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f698dffb640 1 -- 172.21.15.2:0/3637110213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0031450 con 0x5641424d41b0 2024-08-31T04:32:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f698dffb640 1 -- 172.21.15.2:0/3637110213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a0036040 con 0x5641424d41b0 2024-08-31T04:32:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f698dffb640 1 -- 172.21.15.2:0/3637110213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a002f660 con 0x5641424d41b0 2024-08-31T04:32:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f69b4a6b740 1 -- 172.21.15.2:0/3637110213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 msgr2=0x5641428a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.907+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f69a0003c40 tx=0x7f69a002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 -- 172.21.15.2:0/3637110213 shutdown_connections 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424fd070 0x5641428be410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428bded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/3637110213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424d41b0 0x5641428a0230 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 -- 172.21.15.2:0/3637110213 >> 172.21.15.2:0/3637110213 conn(0x5641424f1460 msgr2=0x56414289fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 -- 172.21.15.2:0/3637110213 shutdown_connections 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 -- 172.21.15.2:0/3637110213 wait complete. 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 -- start start 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.908+0000 7f69b4a6b740 1 Processor -- start 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81ad300 con 0x5641424fd070 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81ae770 con 0x5641424d41b0 2024-08-31T04:32:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81ad9d0 con 0x5641424dc390 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69b4a6b740 10 client.0 _ll_register_callbacks cb 0x7f699c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:56682/0 (socket says 172.21.15.2:56682) 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 -- 172.21.15.2:0/2808625907 learned_addr learned my addr 172.21.15.2:0/2808625907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69a77fe640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 -- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 msgr2=0x5641428b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 -- 172.21.15.2:0/2808625907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 msgr2=0x5641428b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 -- 172.21.15.2:0/2808625907 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414292dcc0 con 0x5641424d41b0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69a77fe640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69aca93640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69a00317e0 tx=0x7f69a0004a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f45a3fecd0e9f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.909+0000 7f69877fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0004240 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f69a00043e0 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a0036040 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69a00045e0 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 10 client.26390 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56414292ef40 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a0036040 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f69a0043020 con 0x5641424d41b0 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 10 client.26390 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 10 client.26390 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 20 client.26390 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x564142490da0 0x564142931450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 4 client.26390 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.910+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564142817070 con 0x564142490da0 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69a77fe640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x564142490da0 0x564142931450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69a77fe640 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x564142490da0 0x564142931450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e21152063607fec server_cookie=d309f66d19fe6b78 in_seq=0 out_seq=0 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69877fe640 10 client.26390 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69877fe640 1 -- 172.21.15.2:0/2808625907 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564142817070 con 0x564142490da0 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69877fe640 10 client.26390 handle_command_reply: tid=0 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 client.26390 shutdown 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 msgr2=0x5641428b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69a00317e0 tx=0x7f69a0004a80 comp rx=0 tx=0).stop 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 shutdown_connections 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x564142490da0 0x564142931450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641424fd070 0x5641428b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5641424dc390 0x5641428b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 --2- 172.21.15.2:0/2808625907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5641424d41b0 0x5641428b60b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69877fe640 0 client.26390 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.911+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 >> 172.21.15.2:0/2808625907 conn(0x5641424f1460 msgr2=0x5641428a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 shutdown_connections 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69b4a6b740 1 -- 172.21.15.2:0/2808625907 wait complete. 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69b4a6b740 20 client.26390 trim_cache size 0 max 16384 2024-08-31T04:32:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 msgr2=0x7f69900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 0x7f69900b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69980ac010 tx=0x7f6998004a90 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 msgr2=0x7f69a819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f699800e9f0 tx=0x7f699800edf0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 shutdown_connections 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69a8109bf0 0x7f69a819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a81092a0 0x7f69a819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f69900b4ca0 0x7f69900b71b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 --2- 172.21.15.2:0/1093489891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69a8101d60 0x7f69a819a240 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 >> 172.21.15.2:0/1093489891 conn(0x7f69a8079d30 msgr2=0x7f69a8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 shutdown_connections 2024-08-31T04:32:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:43.912+0000 7f69ae4f6640 1 -- 172.21.15.2:0/1093489891 wait complete. 2024-08-31T04:32:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:44 smithi002 ceph-mon[18656]: pgmap v560: 129 pgs: 129 active+clean; 448 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 258 op/s 2024-08-31T04:32:44.680 INFO:tasks.workunit.client.0.smithi002.stdout: 1 737804 11.50 MB/sec execute 244 sec latency 111.992 ms 2024-08-31T04:32:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:44 smithi064 ceph-mon[22007]: pgmap v560: 129 pgs: 129 active+clean; 448 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 258 op/s 2024-08-31T04:32:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:44 smithi132 ceph-mon[22335]: pgmap v560: 129 pgs: 129 active+clean; 448 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 258 op/s 2024-08-31T04:32:44.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:32:45.217 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:45.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 739377 11.48 MB/sec execute 245 sec latency 99.730 ms 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 -- 172.21.15.2:0/572600845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109bb0 msgr2=0x7f74281103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 --2- 172.21.15.2:0/572600845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109bb0 0x7f74281103e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7420009ca0 tx=0x7f742002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 -- 172.21.15.2:0/572600845 shutdown_connections 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 --2- 172.21.15.2:0/572600845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109bb0 0x7f74281103e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 --2- 172.21.15.2:0/572600845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109260 0x7f7428109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 --2- 172.21.15.2:0/572600845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f7428103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 -- 172.21.15.2:0/572600845 >> 172.21.15.2:0/572600845 conn(0x7f74280ff350 msgr2=0x7f74281017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 -- 172.21.15.2:0/572600845 shutdown_connections 2024-08-31T04:32:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.783+0000 7f742f270640 1 -- 172.21.15.2:0/572600845 wait complete. 2024-08-31T04:32:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 Processor -- start 2024-08-31T04:32:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 -- start start 2024-08-31T04:32:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 0x7f742819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109bb0 0x7f742819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7428113870 con 0x7f7428109260 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74281136f0 con 0x7f7428103920 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.784+0000 7f742f270640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74281139f0 con 0x7f7428109bb0 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37062/0 (socket says 172.21.15.2:37062) 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 0x7f742819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 -- 172.21.15.2:0/3144265324 learned_addr learned my addr 172.21.15.2:0/3144265324 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d80d640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109bb0 0x7f742819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 -- 172.21.15.2:0/3144265324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109bb0 msgr2=0x7f742819fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109bb0 0x7f742819fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 -- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 msgr2=0x7f742819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 0x7f742819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 -- 172.21.15.2:0/3144265324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74281a0150 con 0x7f7428103920 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742c80b640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 0x7f742819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742d00c640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f742400ea60 tx=0x7f742400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f741e7fc640 1 -- 172.21.15.2:0/3144265324 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742400cde0 con 0x7f7428103920 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f741e7fc640 1 -- 172.21.15.2:0/3144265324 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74240035f0 con 0x7f7428103920 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74281a0440 con 0x7f7428103920 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.785+0000 7f741e7fc640 1 -- 172.21.15.2:0/3144265324 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424010690 con 0x7f7428103920 2024-08-31T04:32:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.786+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7428075390 con 0x7f7428103920 2024-08-31T04:32:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 Processor -- start 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 -- start start 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f741e7fc640 1 -- 172.21.15.2:0/3144265324 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7424010830 con 0x7f7428103920 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292d9070 0x557a2967e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 0x557a2967e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a295f5680 con 0x557a292b8390 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557a295e4c10 con 0x557a292b01b0 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.788+0000 7f74357e5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557a295e8bc0 con 0x557a292d9070 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36960/0 (socket says 172.21.15.2:36960) 2024-08-31T04:32:45.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742c80b640 1 -- 172.21.15.2:0/459735727 learned_addr learned my addr 172.21.15.2:0/459735727 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 0x557a2967e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d80d640 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292d9070 0x557a2967e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 -- 172.21.15.2:0/459735727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292d9070 msgr2=0x557a2967e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292d9070 0x557a2967e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 -- 172.21.15.2:0/459735727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 msgr2=0x557a2967ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 -- 172.21.15.2:0/459735727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a29344650 con 0x557a292b01b0 2024-08-31T04:32:45.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742c80b640 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.789+0000 7f742d00c640 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 0x557a2967e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74240e2f80 tx=0x7f74240ee7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7a56dacbd1f9cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f741e7fc640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 0x7f74140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f74137fe640 1 -- 172.21.15.2:0/459735727 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240a8570 con 0x557a292b01b0 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f74137fe640 1 -- 172.21.15.2:0/459735727 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74240f3070 con 0x557a292b01b0 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f74137fe640 1 -- 172.21.15.2:0/459735727 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240ab870 con 0x557a292b01b0 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f741e7fc640 1 -- 172.21.15.2:0/3144265324 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f74240e5ca0 con 0x7f7428103920 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.790+0000 7f742d80d640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 0x7f74140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 -- 172.21.15.2:0/459735727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 msgr2=0x557a2967e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 0x557a2967e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74240e2f80 tx=0x7f74240ee7a0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f742d80d640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 0x7f74140b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f742002f500 tx=0x7f742002f310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 -- 172.21.15.2:0/459735727 shutdown_connections 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a2967ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b01b0 0x557a2967e850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 --2- 172.21.15.2:0/459735727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292d9070 0x557a2967e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 -- 172.21.15.2:0/459735727 >> 172.21.15.2:0/459735727 conn(0x557a292cd460 msgr2=0x557a2967c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 -- 172.21.15.2:0/459735727 shutdown_connections 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.791+0000 7f74357e5740 1 -- 172.21.15.2:0/459735727 wait complete. 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.792+0000 7f74357e5740 1 -- start start 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.792+0000 7f74357e5740 1 Processor -- start 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.792+0000 7f74357e5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 0x557a29692b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.792+0000 7f74357e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.792+0000 7f74357e5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292d9070 0x557a29698180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f74357e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a29447700 con 0x557a292b8390 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f74357e5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557a2956b750 con 0x557a292d9070 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f74357e5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557a2968caf0 con 0x557a292b01b0 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f74357e5740 10 client.0 _ll_register_callbacks cb 0x557a2959ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742d80d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292d9070 0x557a29698180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36976/0 (socket says 172.21.15.2:36976) 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 -- 172.21.15.2:0/3416154508 learned_addr learned my addr 172.21.15.2:0/3416154508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742d00c640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 0x557a29692b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 -- 172.21.15.2:0/3416154508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 msgr2=0x557a29692b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 0x557a29692b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 -- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292d9070 msgr2=0x557a29698180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292d9070 0x557a29698180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 -- 172.21.15.2:0/3416154508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a295a4900 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742d00c640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 0x557a29692b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f742c80b640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f741800d3e0 tx=0x7f741800d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdbb04ec0bd2c02 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f7410ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418010540 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f741800f420 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.793+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74240f3070 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7418027050 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 10 client.16680 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a296a1130 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74240f3070 con 0x557a292b8390 2024-08-31T04:32:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7418022030 con 0x557a292b8390 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 10 client.16680 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 10 client.16680 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 20 client.16680 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292979f0 0x557a296a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 4 client.16680 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a295f75d0 con 0x557a292979f0 2024-08-31T04:32:45.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.794+0000 7f742d00c640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292979f0 0x557a296a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.795+0000 7f7410ff9640 10 client.16680 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:45.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.795+0000 7f742d00c640 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292979f0 0x557a296a46e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4233e3c7b0ba88b server_cookie=7d94ad6c61ba6fec in_seq=0 out_seq=0 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.795+0000 7f7410ff9640 1 -- 172.21.15.2:0/3416154508 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a295f75d0 con 0x557a292979f0 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.795+0000 7f7410ff9640 10 client.16680 handle_command_reply: tid=0 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.795+0000 7f74357e5740 1 client.16680 shutdown 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 msgr2=0x557a29693160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f741800d3e0 tx=0x7f741800d8a0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 shutdown_connections 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292979f0 0x557a296a46e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b8390 0x557a29693160 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292d9070 0x557a29698180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f7410ff9640 0 client.16680 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 --2- 172.21.15.2:0/3416154508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b01b0 0x557a29692b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 >> 172.21.15.2:0/3416154508 conn(0x557a292cd460 msgr2=0x557a296814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 shutdown_connections 2024-08-31T04:32:45.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 1 -- 172.21.15.2:0/3416154508 wait complete. 2024-08-31T04:32:45.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.796+0000 7f74357e5740 20 client.16680 trim_cache size 0 max 16384 2024-08-31T04:32:45.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.811+0000 7f74357e5740 1 Processor -- start 2024-08-31T04:32:45.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.811+0000 7f74357e5740 1 -- start start 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292979f0 0x557a29698180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 0x557a2967a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f74281b1610 con 0x557a292b01b0 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74281aeee0 con 0x557a292b8390 2024-08-31T04:32:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f74357e5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74281acd30 con 0x557a292979f0 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742c80b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36982/0 (socket says 172.21.15.2:36982) 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742c80b640 1 -- 172.21.15.2:0/2998140488 learned_addr learned my addr 172.21.15.2:0/2998140488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 0x557a2967a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d00c640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292979f0 0x557a29698180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 -- 172.21.15.2:0/2998140488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292979f0 msgr2=0x557a29698180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292979f0 0x557a29698180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 -- 172.21.15.2:0/2998140488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 msgr2=0x557a296986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742d80d640 1 -- 172.21.15.2:0/2998140488 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a29690e80 con 0x557a292b8390 2024-08-31T04:32:45.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.812+0000 7f742c80b640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:45.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.813+0000 7f742d80d640 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 0x557a2967a7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7420006010 tx=0x7f7420044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e949992e1cce7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.813+0000 7f7412ffd640 1 -- 172.21.15.2:0/2998140488 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003970 con 0x557a292b8390 2024-08-31T04:32:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.813+0000 7f7412ffd640 1 -- 172.21.15.2:0/2998140488 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7420036050 con 0x557a292b8390 2024-08-31T04:32:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.813+0000 7f7412ffd640 1 -- 172.21.15.2:0/2998140488 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742002f8c0 con 0x557a292b8390 2024-08-31T04:32:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 -- 172.21.15.2:0/2998140488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 msgr2=0x557a2967a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 0x557a2967a7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7420006010 tx=0x7f7420044000 comp rx=0 tx=0).stop 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 -- 172.21.15.2:0/2998140488 shutdown_connections 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292b8390 0x557a2967a7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 --2- 172.21.15.2:0/2998140488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292979f0 0x557a29698180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 -- 172.21.15.2:0/2998140488 >> 172.21.15.2:0/2998140488 conn(0x557a292cd460 msgr2=0x557a29692b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 -- 172.21.15.2:0/2998140488 shutdown_connections 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.814+0000 7f74357e5740 1 -- 172.21.15.2:0/2998140488 wait complete. 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.815+0000 7f74357e5740 1 -- start start 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.815+0000 7f74357e5740 1 Processor -- start 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.815+0000 7f74357e5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.815+0000 7f74357e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 0x557a296a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f74281ad3a0 con 0x557a292b01b0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74281ae810 con 0x557a292979f0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74281ada70 con 0x557a292b8390 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37108/0 (socket says 172.21.15.2:37108) 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 -- 172.21.15.2:0/4101701308 learned_addr learned my addr 172.21.15.2:0/4101701308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742c80b640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 10 client.0 _ll_register_callbacks cb 0x7f7418009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d80d640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 0x557a296a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 -- 172.21.15.2:0/4101701308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 msgr2=0x557a296a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 0x557a296a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 -- 172.21.15.2:0/4101701308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 msgr2=0x557a296aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 -- 172.21.15.2:0/4101701308 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a296a97c0 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d80d640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 0x557a296a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f742d00c640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74240abeb0 tx=0x7f7424003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5ff0f2e8082ecff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f7410ff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240aba60 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f74240a8510 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.816+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7420036050 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f74240abcf0 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 10 client.26408 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a2969dd50 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7420036050 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f74240a81b0 con 0x557a292979f0 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 10 client.26408 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 10 client.26408 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 20 client.26408 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292d9070 0x557a2969e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 4 client.26408 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a295f3070 con 0x557a292d9070 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.817+0000 7f742c80b640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292d9070 0x557a2969e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f7410ff9640 10 client.26408 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f742c80b640 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292d9070 0x557a2969e110 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c499ddbb90f4234 server_cookie=90ca4d4ae00a18be in_seq=0 out_seq=0 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f7410ff9640 1 -- 172.21.15.2:0/4101701308 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a295f3070 con 0x557a292d9070 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f7410ff9640 10 client.26408 handle_command_reply: tid=0 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 client.26408 shutdown 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 msgr2=0x557a296aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74240abeb0 tx=0x7f7424003e90 comp rx=0 tx=0).stop 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 shutdown_connections 2024-08-31T04:32:45.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x557a292d9070 0x557a2969e110 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a292b01b0 0x557a296aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557a292b8390 0x557a296a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f7410ff9640 0 client.26408 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 --2- 172.21.15.2:0/4101701308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a292979f0 0x557a296aa2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 >> 172.21.15.2:0/4101701308 conn(0x557a292cd460 msgr2=0x557a2967b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 shutdown_connections 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 1 -- 172.21.15.2:0/4101701308 wait complete. 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.818+0000 7f74357e5740 20 client.26408 trim_cache size 0 max 16384 2024-08-31T04:32:45.825 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 msgr2=0x7f74140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 0x7f74140b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f742002f500 tx=0x7f742002f310 comp rx=0 tx=0).stop 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 msgr2=0x7f742819a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f742400ea60 tx=0x7f742400ef20 comp rx=0 tx=0).stop 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 shutdown_connections 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f74140b4ca0 0x7f74140b71b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7428109260 0x7f742819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7428109bb0 0x7f742819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 --2- 172.21.15.2:0/3144265324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7428103920 0x7f742819a1e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 >> 172.21.15.2:0/3144265324 conn(0x7f74280ff350 msgr2=0x7f7428108850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 shutdown_connections 2024-08-31T04:32:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:45.819+0000 7f742f270640 1 -- 172.21.15.2:0/3144265324 wait complete. 2024-08-31T04:32:46.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:46 smithi002 ceph-mon[18656]: pgmap v561: 129 pgs: 129 active+clean; 451 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 232 op/s 2024-08-31T04:32:46.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:32:46.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 741853 11.49 MB/sec execute 246 sec latency 16.624 ms 2024-08-31T04:32:46.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:46 smithi064 ceph-mon[22007]: pgmap v561: 129 pgs: 129 active+clean; 451 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 232 op/s 2024-08-31T04:32:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:46 smithi132 ceph-mon[22335]: pgmap v561: 129 pgs: 129 active+clean; 451 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 232 op/s 2024-08-31T04:32:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 -- 172.21.15.2:0/1925926145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a41081c0 msgr2=0x7f78a41085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 --2- 172.21.15.2:0/1925926145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a41081c0 0x7f78a41085d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7898009900 tx=0x7f789802a410 comp rx=0 tx=0).stop 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 -- 172.21.15.2:0/1925926145 shutdown_connections 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 --2- 172.21.15.2:0/1925926145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a41081c0 0x7f78a41085d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 --2- 172.21.15.2:0/1925926145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4108b10 0x7f78a410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 --2- 172.21.15.2:0/1925926145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a4102880 0x7f78a4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 -- 172.21.15.2:0/1925926145 >> 172.21.15.2:0/1925926145 conn(0x7f78a4079510 msgr2=0x7f78a4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 -- 172.21.15.2:0/1925926145 shutdown_connections 2024-08-31T04:32:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 -- 172.21.15.2:0/1925926145 wait complete. 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.475+0000 7f78a95b4640 1 Processor -- start 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 -- start start 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4102880 0x7f78a419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 0x7f78a419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41138f0 con 0x7f78a4108b10 2024-08-31T04:32:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4113770 con 0x7f78a41081c0 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a95b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4113a70 con 0x7f78a4102880 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37122/0 (socket says 172.21.15.2:37122) 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 -- 172.21.15.2:0/3780666570 learned_addr learned my addr 172.21.15.2:0/3780666570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a37fe640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 0x7f78a419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4102880 0x7f78a419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 -- 172.21.15.2:0/3780666570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4102880 msgr2=0x7f78a419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4102880 0x7f78a419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 -- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 msgr2=0x7f78a419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 0x7f78a419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a27fc640 1 -- 172.21.15.2:0/3780666570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a41a0230 con 0x7f78a41081c0 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.476+0000 7f78a37fe640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 0x7f78a419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f78a27fc640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f789802a930 tx=0x7f7898031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f788bfff640 1 -- 172.21.15.2:0/3780666570 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789803f030 con 0x7f78a41081c0 2024-08-31T04:32:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a41a04c0 con 0x7f78a41081c0 2024-08-31T04:32:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f788bfff640 1 -- 172.21.15.2:0/3780666570 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7898004490 con 0x7f78a41081c0 2024-08-31T04:32:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f788bfff640 1 -- 172.21.15.2:0/3780666570 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898035070 con 0x7f78a41081c0 2024-08-31T04:32:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.477+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a41a6c80 con 0x7f78a41081c0 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 Processor -- start 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 -- start start 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb881b0 0x55844ff56890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55844fecd680 con 0x55844fb90390 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55844febcc10 con 0x55844fbb1070 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78afb29740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55844fec0bc0 con 0x55844fb881b0 2024-08-31T04:32:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37128/0 (socket says 172.21.15.2:37128) 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78a37fe640 1 -- 172.21.15.2:0/2695280494 learned_addr learned my addr 172.21.15.2:0/2695280494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.480+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb881b0 0x55844ff56890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 -- 172.21.15.2:0/2695280494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb881b0 msgr2=0x55844ff56890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb881b0 0x55844ff56890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 -- 172.21.15.2:0/2695280494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 msgr2=0x55844ff56dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff56dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 -- 172.21.15.2:0/2695280494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844fc1c650 con 0x55844fbb1070 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f788bfff640 1 -- 172.21.15.2:0/3780666570 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7898042030 con 0x7f78a41081c0 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78a37fe640 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f789c0117e0 tx=0x7f789c011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f5e38b6087e8e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78897fa640 1 -- 172.21.15.2:0/2695280494 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c011310 con 0x55844fbb1070 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78897fa640 1 -- 172.21.15.2:0/2695280494 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f789c003e20 con 0x55844fbb1070 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.481+0000 7f78897fa640 1 -- 172.21.15.2:0/2695280494 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c004470 con 0x55844fbb1070 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f788bfff640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 0x7f788c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f788bfff640 1 -- 172.21.15.2:0/3780666570 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f7898105b70 con 0x7f78a41081c0 2024-08-31T04:32:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 0x7f788c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 -- 172.21.15.2:0/2695280494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 msgr2=0x55844ff56350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f789c0117e0 tx=0x7f789c011ca0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 -- 172.21.15.2:0/2695280494 shutdown_connections 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff56dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb881b0 0x55844ff56890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 --2- 172.21.15.2:0/2695280494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff56350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 -- 172.21.15.2:0/2695280494 >> 172.21.15.2:0/2695280494 conn(0x55844fba5460 msgr2=0x55844ff54240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.482+0000 7f78afb29740 1 -- 172.21.15.2:0/2695280494 shutdown_connections 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 -- 172.21.15.2:0/2695280494 wait complete. 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 0x7f788c0b71b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55844ff54fd0 tx=0x7f7894005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 -- start start 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 Processor -- start 2024-08-31T04:32:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 0x55844ff6de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55844fd1f700 con 0x55844fb90390 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55844fe43750 con 0x55844fb881b0 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55844ff64b30 con 0x55844fbb1070 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.483+0000 7f78afb29740 10 client.0 _ll_register_callbacks cb 0x55844fe72e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 0x55844ff6de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37136/0 (socket says 172.21.15.2:37136) 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 -- 172.21.15.2:0/1590809699 learned_addr learned my addr 172.21.15.2:0/1590809699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 -- 172.21.15.2:0/1590809699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 msgr2=0x55844ff6de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 0x55844ff6de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 -- 172.21.15.2:0/1590809699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 msgr2=0x55844ff62120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff62120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 -- 172.21.15.2:0/1590809699 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844fe7c900 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a37fe640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 0x55844ff6de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7894005f60 tx=0x7f7894004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf48f91242b7183 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.484+0000 7f7886ff5640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789402e060 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f789c003e20 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f7894018030 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7894035050 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f78afb29740 10 client.26420 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55844ff70a70 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f789c003e20 con 0x55844fb881b0 2024-08-31T04:32:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.485+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f789400f3c0 con 0x55844fb881b0 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 10 client.26420 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 10 client.26420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 20 client.26420 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb6f9f0 0x55844ff73f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 4 client.26420 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55844fecf5d0 con 0x55844fb6f9f0 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78a27fc640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb6f9f0 0x55844ff73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f7886ff5640 10 client.26420 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.486+0000 7f78a27fc640 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb6f9f0 0x55844ff73f00 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22f3fc18f4b25fc server_cookie=d3c81a581d560f29 in_seq=0 out_seq=0 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f7886ff5640 1 -- 172.21.15.2:0/1590809699 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55844fecf5d0 con 0x55844fb6f9f0 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f7886ff5640 10 client.26420 handle_command_reply: tid=0 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 client.26420 shutdown 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 msgr2=0x55844ff61b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7894005f60 tx=0x7f7894004730 comp rx=0 tx=0).stop 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 shutdown_connections 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb6f9f0 0x55844ff73f00 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb90390 0x55844ff62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fbb1070 0x55844ff6de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 --2- 172.21.15.2:0/1590809699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff61b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 >> 172.21.15.2:0/1590809699 conn(0x55844fba5460 msgr2=0x55844ff59530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f7886ff5640 0 client.26420 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 shutdown_connections 2024-08-31T04:32:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.487+0000 7f78afb29740 1 -- 172.21.15.2:0/1590809699 wait complete. 2024-08-31T04:32:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.488+0000 7f78afb29740 20 client.26420 trim_cache size 0 max 16384 2024-08-31T04:32:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 Processor -- start 2024-08-31T04:32:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 -- start start 2024-08-31T04:32:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff4f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 0x55844ff5ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41b16b0 con 0x55844fbb1070 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41aef80 con 0x55844fb881b0 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.501+0000 7f78afb29740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41acdd0 con 0x55844fb90390 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 0x55844ff5ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff4f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:51232/0 (socket says 172.21.15.2:51232) 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a27fc640 1 -- 172.21.15.2:0/1305295562 learned_addr learned my addr 172.21.15.2:0/1305295562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff4f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37144/0 (socket says 172.21.15.2:37144) 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 -- 172.21.15.2:0/1305295562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 msgr2=0x55844ff54160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 -- 172.21.15.2:0/1305295562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 msgr2=0x55844ff4f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff4f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 -- 172.21.15.2:0/1305295562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844ff62c20 con 0x55844fbb1070 2024-08-31T04:32:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a27fc640 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f78a37fe640 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 0x55844ff5ed70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a010 tx=0x7f789c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28fd97e99e45499 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f7888ff9640 1 -- 172.21.15.2:0/1305295562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c003df0 con 0x55844fbb1070 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f7888ff9640 1 -- 172.21.15.2:0/1305295562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f789c00f9a0 con 0x55844fbb1070 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.502+0000 7f7888ff9640 1 -- 172.21.15.2:0/1305295562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0055e0 con 0x55844fbb1070 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 -- 172.21.15.2:0/1305295562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 msgr2=0x55844ff5ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 0x55844ff5ed70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a010 tx=0x7f789c004170 comp rx=0 tx=0).stop 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 -- 172.21.15.2:0/1305295562 shutdown_connections 2024-08-31T04:32:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fbb1070 0x55844ff5ed70 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff54160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 --2- 172.21.15.2:0/1305295562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fb881b0 0x55844ff4f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 -- 172.21.15.2:0/1305295562 >> 172.21.15.2:0/1305295562 conn(0x55844fba5460 msgr2=0x55844ff53a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 -- 172.21.15.2:0/1305295562 shutdown_connections 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.503+0000 7f78afb29740 1 -- 172.21.15.2:0/1305295562 wait complete. 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 -- start start 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 Processor -- start 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff6a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff64d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41ad440 con 0x55844fb881b0 2024-08-31T04:32:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41ae8b0 con 0x55844fbb1070 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41adb10 con 0x55844fb90390 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78afb29740 10 client.0 _ll_register_callbacks cb 0x7f78940093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78a27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff6a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37042/0 (socket says 172.21.15.2:37042) 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78a2ffd640 1 -- 172.21.15.2:0/2393077449 learned_addr learned my addr 172.21.15.2:0/2393077449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.504+0000 7f78a37fe640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff64d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 -- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 msgr2=0x55844ff64d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff64d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 -- 172.21.15.2:0/2393077449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 msgr2=0x55844ff69d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 -- 172.21.15.2:0/2393077449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844ff6a940 con 0x55844fb90390 2024-08-31T04:32:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78a27fc640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff6a2d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78980cbba0 tx=0x7f789803b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb75397d0c8b8f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f7886ff5640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980b7020 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f789c00f9a0 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f78980b71c0 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78980d5110 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78afb29740 10 client.26242 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.505+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55844ffded70 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f789c00f9a0 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f789803ba30 con 0x55844fb90390 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 10 client.26242 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 10 client.26242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 20 client.26242 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb44da0 0x55844ffe1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 4 client.26242 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:32:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55844fecb070 con 0x55844fb44da0 2024-08-31T04:32:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb44da0 0x55844ffe1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb44da0 0x55844ffe1560 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f849d7958eada288 server_cookie=ced5cea7329095ec in_seq=0 out_seq=0 2024-08-31T04:32:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.506+0000 7f7886ff5640 10 client.26242 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f7886ff5640 1 -- 172.21.15.2:0/2393077449 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55844fecb070 con 0x55844fb44da0 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f7886ff5640 10 client.26242 handle_command_reply: tid=0 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 client.26242 shutdown 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 msgr2=0x55844ff6a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff6a2d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78980cbba0 tx=0x7f789803b460 comp rx=0 tx=0).stop 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 shutdown_connections 2024-08-31T04:32:47.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55844fb44da0 0x55844ffe1560 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844fbb1070 0x55844ff64d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55844fb90390 0x55844ff6a2d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f7886ff5640 0 client.26242 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 --2- 172.21.15.2:0/2393077449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55844fb881b0 0x55844ff69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.508+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 >> 172.21.15.2:0/2393077449 conn(0x55844fba5460 msgr2=0x55844ff54180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 shutdown_connections 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78afb29740 1 -- 172.21.15.2:0/2393077449 wait complete. 2024-08-31T04:32:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78afb29740 20 client.26242 trim_cache size 0 max 16384 2024-08-31T04:32:47.517 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:32:47.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 msgr2=0x7f788c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 0x7f788c0b71b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55844ff54fd0 tx=0x7f7894005f90 comp rx=0 tx=0).stop 2024-08-31T04:32:47.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 msgr2=0x7f78a419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:47.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.509+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f789802a930 tx=0x7f7898031a20 comp rx=0 tx=0).stop 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 shutdown_connections 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f788c0b4ca0 0x7f788c0b71b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4108b10 0x7f78a419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78a41081c0 0x7f78a419a860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 --2- 172.21.15.2:0/3780666570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a4102880 0x7f78a419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 >> 172.21.15.2:0/3780666570 conn(0x7f78a4079510 msgr2=0x7f78a41062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 shutdown_connections 2024-08-31T04:32:47.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:47.510+0000 7f78a95b4640 1 -- 172.21.15.2:0/3780666570 wait complete. 2024-08-31T04:32:47.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 743581 11.49 MB/sec execute 247 sec latency 32.445 ms 2024-08-31T04:32:48.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:48 smithi132 ceph-mon[22335]: pgmap v562: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.0 MiB/s wr, 247 op/s 2024-08-31T04:32:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:48 smithi002 ceph-mon[18656]: pgmap v562: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.0 MiB/s wr, 247 op/s 2024-08-31T04:32:48.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 745909 11.50 MB/sec execute 248 sec latency 18.179 ms 2024-08-31T04:32:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:48 smithi064 ceph-mon[22007]: pgmap v562: 129 pgs: 129 active+clean; 455 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.0 MiB/s wr, 247 op/s 2024-08-31T04:32:49.327 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:32:49.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:32:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:49.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 747592 11.47 MB/sec execute 249 sec latency 42.689 ms 2024-08-31T04:32:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 -- 172.21.15.2:0/4128217804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108a90 msgr2=0x7fbd6410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 --2- 172.21.15.2:0/4128217804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108a90 0x7fbd6410f2c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009ca0 tx=0x7fbd5c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 -- 172.21.15.2:0/4128217804 shutdown_connections 2024-08-31T04:32:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 --2- 172.21.15.2:0/4128217804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108a90 0x7fbd6410f2c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 --2- 172.21.15.2:0/4128217804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64108140 0x7fbd64108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 --2- 172.21.15.2:0/4128217804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64102800 0x7fbd64102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 -- 172.21.15.2:0/4128217804 >> 172.21.15.2:0/4128217804 conn(0x7fbd640794d0 msgr2=0x7fbd640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.075+0000 7fbd6a851640 1 -- 172.21.15.2:0/4128217804 shutdown_connections 2024-08-31T04:32:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.076+0000 7fbd6a851640 1 -- 172.21.15.2:0/4128217804 wait complete. 2024-08-31T04:32:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.076+0000 7fbd6a851640 1 Processor -- start 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.076+0000 7fbd6a851640 1 -- start start 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64102800 0x7fbd6419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64108a90 0x7fbd6419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64112710 con 0x7fbd64108140 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64112590 con 0x7fbd64108a90 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd6a851640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64112890 con 0x7fbd64102800 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37064/0 (socket says 172.21.15.2:37064) 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd637fe640 1 -- 172.21.15.2:0/3421919149 learned_addr learned my addr 172.21.15.2:0/3421919149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd63fff640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64102800 0x7fbd6419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.077+0000 7fbd68dee640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64108a90 0x7fbd6419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 -- 172.21.15.2:0/3421919149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64102800 msgr2=0x7fbd6419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64102800 0x7fbd6419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 -- 172.21.15.2:0/3421919149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64108a90 msgr2=0x7fbd6419bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64108a90 0x7fbd6419bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 -- 172.21.15.2:0/3421919149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd641a6310 con 0x7fbd64108140 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd637fe640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800d740 tx=0x7fbd5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd617fa640 1 -- 172.21.15.2:0/3421919149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58017070 con 0x7fbd64108140 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd617fa640 1 -- 172.21.15.2:0/3421919149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5800de50 con 0x7fbd64108140 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd641a6600 con 0x7fbd64108140 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd617fa640 1 -- 172.21.15.2:0/3421919149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58004ce0 con 0x7fbd64108140 2024-08-31T04:32:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.078+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd641a6af0 con 0x7fbd64108140 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 Processor -- start 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 -- start start 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd617fa640 1 -- 172.21.15.2:0/3421919149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbd58004e80 con 0x7fbd64108140 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45ee9a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 0x55a45ee9acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 0x55a45ee9b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a45ee105f0 con 0x55a45eacb490 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a45edffb80 con 0x55a45ead3670 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a45ee03b30 con 0x55a45eaf4350 2024-08-31T04:32:50.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 0x55a45ee9acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45ee9a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 0x55a45ee9acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37070/0 (socket says 172.21.15.2:37070) 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd63fff640 1 -- 172.21.15.2:0/4191469083 learned_addr learned my addr 172.21.15.2:0/4191469083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.081+0000 7fbd637fe640 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 0x55a45ee9b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 -- 172.21.15.2:0/4191469083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 msgr2=0x55a45ee9b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 0x55a45ee9b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 -- 172.21.15.2:0/4191469083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 msgr2=0x55a45ee9acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 0x55a45ee9acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 -- 172.21.15.2:0/4191469083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a45eb5f930 con 0x55a45eaf4350 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd637fe640 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 0x55a45ee9b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd617fa640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 0x7fbd4c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45ee9a780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005e30 tx=0x7fbd5c02f4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe92147a56efd64 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd63fff640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 0x7fbd4c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd617fa640 1 -- 172.21.15.2:0/3421919149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7fbd580e5230 con 0x7fbd64108140 2024-08-31T04:32:50.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.082+0000 7fbd4a7fc640 1 -- 172.21.15.2:0/4191469083 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c031cf0 con 0x55a45eaf4350 2024-08-31T04:32:50.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd4a7fc640 1 -- 172.21.15.2:0/4191469083 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c036030 con 0x55a45eaf4350 2024-08-31T04:32:50.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd4a7fc640 1 -- 172.21.15.2:0/4191469083 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c003e60 con 0x55a45eaf4350 2024-08-31T04:32:50.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4191469083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 msgr2=0x55a45ee9a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd63fff640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 0x7fbd4c0b71e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55a45ee99400 tx=0x7fbd54005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45ee9a780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005e30 tx=0x7fbd5c02f4c0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4191469083 shutdown_connections 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45eacb490 0x55a45ee9acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45ead3670 0x55a45ee9b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.083+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4191469083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45ee9a780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.084+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4191469083 >> 172.21.15.2:0/4191469083 conn(0x55a45eae8740 msgr2=0x55a45ee98670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.084+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4191469083 shutdown_connections 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.084+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4191469083 wait complete. 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.084+0000 7fbd70dc6740 1 -- start start 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.084+0000 7fbd70dc6740 1 Processor -- start 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeaa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a45ec62890 con 0x55a45ead3670 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a45ed86790 con 0x55a45eacb490 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a45eead0e0 con 0x55a45eaf4350 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd70dc6740 10 client.0 _ll_register_callbacks cb 0x55a45eb0bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeaa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd63fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:51278/0 (socket says 172.21.15.2:51278) 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 -- 172.21.15.2:0/4001774806 learned_addr learned my addr 172.21.15.2:0/4001774806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 -- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 msgr2=0x55a45eeaa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 -- 172.21.15.2:0/4001774806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 msgr2=0x55a45eeaa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeaa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 -- 172.21.15.2:0/4001774806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a45edbdf30 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd637fe640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeaa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd68dee640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009dc0 tx=0x7fbd5c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cd36e6c06a09508 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.085+0000 7fbd437fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c04a040 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7fbd5c031650 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd5c036030 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbd5c05e050 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 10 client.26254 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a45eeb8fc0 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c036030 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fbd5c04d030 con 0x55a45eaf4350 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 10 client.26254 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:50.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 10 client.26254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 20 client.26254 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eab2cd0 0x55a45eebc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 4 client.26254 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.086+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a45ee12540 con 0x55a45eab2cd0 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.087+0000 7fbd63fff640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eab2cd0 0x55a45eebc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.087+0000 7fbd63fff640 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eab2cd0 0x55a45eebc320 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db0fbb4c5f6d1d7 server_cookie=1354e7c909273095 in_seq=0 out_seq=0 2024-08-31T04:32:50.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.087+0000 7fbd437fe640 10 client.26254 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.088+0000 7fbd437fe640 1 -- 172.21.15.2:0/4001774806 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a45ee12540 con 0x55a45eab2cd0 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd437fe640 10 client.26254 handle_command_reply: tid=0 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 client.26254 shutdown 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 msgr2=0x55a45eeb6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009dc0 tx=0x7fbd5c0099e0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 shutdown_connections 2024-08-31T04:32:50.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eab2cd0 0x55a45eebc320 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeaa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eaf4350 0x55a45eeb6410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd437fe640 0 client.26254 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/4001774806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 >> 172.21.15.2:0/4001774806 conn(0x55a45eae8740 msgr2=0x55a45ee96c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 shutdown_connections 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 1 -- 172.21.15.2:0/4001774806 wait complete. 2024-08-31T04:32:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.089+0000 7fbd70dc6740 20 client.26254 trim_cache size 0 max 16384 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.108+0000 7fbd70dc6740 1 Processor -- start 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.108+0000 7fbd70dc6740 1 -- start start 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 0x55a45ee986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eacb490 0x55a45eeb6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641b1560 con 0x55a45ead3670 2024-08-31T04:32:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641aee30 con 0x55a45eab2cd0 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641acc80 con 0x55a45eacb490 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd63fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 0x55a45ee986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37084/0 (socket says 172.21.15.2:37084) 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 -- 172.21.15.2:0/656092243 learned_addr learned my addr 172.21.15.2:0/656092243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eacb490 0x55a45eeb6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 -- 172.21.15.2:0/656092243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eacb490 msgr2=0x55a45eeb6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eacb490 0x55a45eeb6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 -- 172.21.15.2:0/656092243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 msgr2=0x55a45ee986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 0x55a45ee986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 -- 172.21.15.2:0/656092243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a45ee9b570 con 0x55a45ead3670 2024-08-31T04:32:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd63fff640 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 0x55a45ee986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.109+0000 7fbd68dee640 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c02ade0 tx=0x7fbd5c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441f2aa823d79909 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd49ffb640 1 -- 172.21.15.2:0/656092243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c009b20 con 0x55a45ead3670 2024-08-31T04:32:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd49ffb640 1 -- 172.21.15.2:0/656092243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c036070 con 0x55a45ead3670 2024-08-31T04:32:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd49ffb640 1 -- 172.21.15.2:0/656092243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c02f660 con 0x55a45ead3670 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 -- 172.21.15.2:0/656092243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 msgr2=0x55a45eeb6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c02ade0 tx=0x7fbd5c0094a0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 -- 172.21.15.2:0/656092243 shutdown_connections 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45eeb6850 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eacb490 0x55a45eeb6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/656092243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eab2cd0 0x55a45ee986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.110+0000 7fbd70dc6740 1 -- 172.21.15.2:0/656092243 >> 172.21.15.2:0/656092243 conn(0x55a45eae8740 msgr2=0x55a45ee97f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.111+0000 7fbd70dc6740 1 -- 172.21.15.2:0/656092243 shutdown_connections 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.111+0000 7fbd70dc6740 1 -- 172.21.15.2:0/656092243 wait complete. 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.111+0000 7fbd70dc6740 1 -- start start 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.111+0000 7fbd70dc6740 1 Processor -- start 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eab2cd0 0x55a45eeaeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641ad2f0 con 0x55a45ead3670 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641ae760 con 0x55a45eacb490 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641ad9c0 con 0x55a45eab2cd0 2024-08-31T04:32:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd70dc6740 10 client.0 _ll_register_callbacks cb 0x7fbd540097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37100/0 (socket says 172.21.15.2:37100) 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 -- 172.21.15.2:0/650237033 learned_addr learned my addr 172.21.15.2:0/650237033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd637fe640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd63fff640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eab2cd0 0x55a45eeaeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 -- 172.21.15.2:0/650237033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eab2cd0 msgr2=0x55a45eeaeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eab2cd0 0x55a45eeaeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 -- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 msgr2=0x55a45eeaf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 -- 172.21.15.2:0/650237033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a45ef26080 con 0x55a45ead3670 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd68dee640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c004af0 tx=0x7fbd5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699490078aa72d36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd437fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.112+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c030ca0 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7fbd5c030e40 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd5c036070 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbd5c073050 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 10 client.16719 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a45ef27340 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c036070 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fbd5c04d040 con 0x55a45ead3670 2024-08-31T04:32:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 10 client.16719 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 20 client.16719 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eaf4350 0x55a45ef29960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 4 client.16719 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.113+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a45ee0dfe0 con 0x55a45eaf4350 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.114+0000 7fbd63fff640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eaf4350 0x55a45ef29960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.114+0000 7fbd63fff640 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eaf4350 0x55a45ef29960 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272809024e2f4c0a server_cookie=3e59c72176da7770 in_seq=0 out_seq=0 2024-08-31T04:32:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.114+0000 7fbd437fe640 10 client.16719 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.116+0000 7fbd437fe640 1 -- 172.21.15.2:0/650237033 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a45ee0dfe0 con 0x55a45eaf4350 2024-08-31T04:32:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.116+0000 7fbd437fe640 10 client.16719 handle_command_reply: tid=0 2024-08-31T04:32:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.116+0000 7fbd70dc6740 1 client.16719 shutdown 2024-08-31T04:32:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.116+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 msgr2=0x55a45ef25af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.116+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c004af0 tx=0x7fbd5c009b20 comp rx=0 tx=0).stop 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 shutdown_connections 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55a45eaf4350 0x55a45ef29960 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd437fe640 0 client.16719 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a45ead3670 0x55a45ef25af0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a45eacb490 0x55a45eeaf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 --2- 172.21.15.2:0/650237033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a45eab2cd0 0x55a45eeaeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 >> 172.21.15.2:0/650237033 conn(0x55a45eae8740 msgr2=0x55a45ee9b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 shutdown_connections 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 1 -- 172.21.15.2:0/650237033 wait complete. 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.117+0000 7fbd70dc6740 20 client.16719 trim_cache size 0 max 16384 2024-08-31T04:32:50.122 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4539a698-1514-4b64-8024-440ec6b51908", 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 msgr2=0x7fbd4c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 0x7fbd4c0b71e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55a45ee99400 tx=0x7fbd54005f90 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 msgr2=0x7fbd6419b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800d740 tx=0x7fbd5800dc00 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 shutdown_connections 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbd4c0b4cd0 0x7fbd4c0b71e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd64108140 0x7fbd6419b5c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd64108a90 0x7fbd6419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 --2- 172.21.15.2:0/3421919149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd64102800 0x7fbd6419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 >> 172.21.15.2:0/3421919149 conn(0x7fbd640794d0 msgr2=0x7fbd64105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 shutdown_connections 2024-08-31T04:32:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:50.118+0000 7fbd6a851640 1 -- 172.21.15.2:0/3421919149 wait complete. 2024-08-31T04:32:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:50 smithi002 ceph-mon[18656]: pgmap v563: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 207 op/s 2024-08-31T04:32:50.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 749436 11.48 MB/sec execute 250 sec latency 72.353 ms 2024-08-31T04:32:50.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:32:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:50 smithi064 ceph-mon[22007]: pgmap v563: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 207 op/s 2024-08-31T04:32:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:50 smithi132 ceph-mon[22335]: pgmap v563: 129 pgs: 129 active+clean; 459 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 207 op/s 2024-08-31T04:32:51.053 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:32:51.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:32:51.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:32:51.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:32:51.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:51 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 -- 172.21.15.2:0/944534193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450106990 msgr2=0x7f0450110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 --2- 172.21.15.2:0/944534193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450106990 0x7f0450110400 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0448009ca0 tx=0x7f044802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 -- 172.21.15.2:0/944534193 shutdown_connections 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 --2- 172.21.15.2:0/944534193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450106990 0x7f0450110400 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 --2- 172.21.15.2:0/944534193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106040 0x7f0450106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 --2- 172.21.15.2:0/944534193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450101df0 0x7f0450102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 -- 172.21.15.2:0/944534193 >> 172.21.15.2:0/944534193 conn(0x7f0450077a00 msgr2=0x7f0450077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 -- 172.21.15.2:0/944534193 shutdown_connections 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.563+0000 7f045560f640 1 -- 172.21.15.2:0/944534193 wait complete. 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 Processor -- start 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 -- start start 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450106040 0x7f045019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106990 0x7f045019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0450113860 con 0x7f0450101df0 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04501136e0 con 0x7f0450106990 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.564+0000 7f045560f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04501139e0 con 0x7f0450106040 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37116/0 (socket says 172.21.15.2:37116) 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 -- 172.21.15.2:0/3634312779 learned_addr learned my addr 172.21.15.2:0/3634312779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106990 0x7f045019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f04467fc640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450106040 0x7f045019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 -- 172.21.15.2:0/3634312779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450106040 msgr2=0x7f045019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450106040 0x7f045019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 -- 172.21.15.2:0/3634312779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106990 msgr2=0x7f045019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106990 0x7f045019fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 -- 172.21.15.2:0/3634312779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04501a0180 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044effd640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f044000e9c0 tx=0x7f044000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044cff9640 1 -- 172.21.15.2:0/3634312779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000cd80 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04501a0470 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044cff9640 1 -- 172.21.15.2:0/3634312779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04400035f0 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f044cff9640 1 -- 172.21.15.2:0/3634312779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440010690 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.565+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04501a6bd0 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 Processor -- start 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 -- start start 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f044cff9640 1 -- 172.21.15.2:0/3634312779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0440010830 con 0x7f0450101df0 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f14783d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f146fa630 con 0x560f143b51b0 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560f146e9bc0 con 0x560f143de070 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f045bb84740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560f146edb70 con 0x560f143bd390 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f044effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.568+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37128/0 (socket says 172.21.15.2:37128) 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044effd640 1 -- 172.21.15.2:0/3185143638 learned_addr learned my addr 172.21.15.2:0/3185143638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37220/0 (socket says 172.21.15.2:37220) 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f04467fc640 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f14783d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 -- 172.21.15.2:0/3185143638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 msgr2=0x560f14783d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f14783d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 -- 172.21.15.2:0/3185143638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 msgr2=0x560f14783800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 -- 172.21.15.2:0/3185143638 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f14449650 con 0x560f143de070 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044effd640 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0448005e30 tx=0x7f044802f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bffcb611d052410 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044cff9640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 0x7f043c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f044effd640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 0x7f043c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.569+0000 7f04457fa640 1 -- 172.21.15.2:0/3185143638 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448031ce0 con 0x560f143de070 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f04457fa640 1 -- 172.21.15.2:0/3185143638 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0448036030 con 0x560f143de070 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f04457fa640 1 -- 172.21.15.2:0/3185143638 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480042a0 con 0x560f143de070 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f044cff9640 1 -- 172.21.15.2:0/3634312779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f04400e5f00 con 0x7f0450101df0 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f045bb84740 1 -- 172.21.15.2:0/3185143638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 msgr2=0x560f147832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f044effd640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 0x7f043c0b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04400ac110 tx=0x7f04400e99f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.570+0000 7f045bb84740 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0448005e30 tx=0x7f044802f410 comp rx=0 tx=0).stop 2024-08-31T04:32:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- 172.21.15.2:0/3185143638 shutdown_connections 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14783800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f14783d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- 172.21.15.2:0/3185143638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147832c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- 172.21.15.2:0/3185143638 >> 172.21.15.2:0/3185143638 conn(0x560f143d2460 msgr2=0x560f147811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- 172.21.15.2:0/3185143638 shutdown_connections 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- 172.21.15.2:0/3185143638 wait complete. 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- start start 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 Processor -- start 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14792df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f1454c700 con 0x560f143de070 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560f14670700 con 0x560f143bd390 2024-08-31T04:32:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.571+0000 7f045bb84740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560f14795bc0 con 0x560f143b51b0 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f045bb84740 10 client.0 _ll_register_callbacks cb 0x560f1469fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37138/0 (socket says 172.21.15.2:37138) 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:37236/0 (socket says 172.21.15.2:37236) 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f044f7fe640 1 -- 172.21.15.2:0/1061652454 learned_addr learned my addr 172.21.15.2:0/1061652454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f044f7fe640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14792df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 -- 172.21.15.2:0/1061652454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 msgr2=0x560f14792df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14792df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 -- 172.21.15.2:0/1061652454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 msgr2=0x560f1479ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 -- 172.21.15.2:0/1061652454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f146a98b0 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f044f7fe640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04467fc640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04500755c0 tx=0x7f0438012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861a3cbc30ac1771 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04367fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043800f890 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.572+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0448036030 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f043800fa30 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f043800fc30 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 10 client.26456 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f147a1a50 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0448036030 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f043801c420 con 0x560f143bd390 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 10 client.26456 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 10 client.26456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 20 client.26456 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f1439c9f0 0x560f147a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 4 client.26456 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f146fc580 con 0x560f1439c9f0 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.573+0000 7f044f7fe640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f1439c9f0 0x560f147a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.574+0000 7f04367fc640 10 client.26456 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.574+0000 7f044f7fe640 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f1439c9f0 0x560f147a4f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190bae5837ac0c server_cookie=e4ab481ebf6e3102 in_seq=0 out_seq=0 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f04367fc640 1 -- 172.21.15.2:0/1061652454 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f146fc580 con 0x560f1439c9f0 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f04367fc640 10 client.26456 handle_command_reply: tid=0 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 client.26456 shutdown 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 msgr2=0x560f14793330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04500755c0 tx=0x7f0438012b60 comp rx=0 tx=0).stop 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 shutdown_connections 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f1439c9f0 0x560f147a4f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143de070 0x560f1479ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143bd390 0x560f14793330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 --2- 172.21.15.2:0/1061652454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14792df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f04367fc640 0 client.26456 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 >> 172.21.15.2:0/1061652454 conn(0x560f143d2460 msgr2=0x560f1477f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 shutdown_connections 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 1 -- 172.21.15.2:0/1061652454 wait complete. 2024-08-31T04:32:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.575+0000 7f045bb84740 20 client.26456 trim_cache size 0 max 16384 2024-08-31T04:32:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 Processor -- start 2024-08-31T04:32:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 -- start start 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14788ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f1478ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04501b1640 con 0x560f143bd390 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04501aef10 con 0x560f143de070 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f045bb84740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04501acd60 con 0x560f143b51b0 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f04467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f04467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37152/0 (socket says 172.21.15.2:37152) 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.594+0000 7f04467fc640 1 -- 172.21.15.2:0/64823425 learned_addr learned my addr 172.21.15.2:0/64823425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f044f7fe640 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f1478ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f044f7fe640 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14788ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 -- 172.21.15.2:0/64823425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 msgr2=0x560f14788ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14788ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 -- 172.21.15.2:0/64823425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 msgr2=0x560f1478ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f1478ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 -- 172.21.15.2:0/64823425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f147893f0 con 0x560f143bd390 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f04467fc640 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0438000c00 tx=0x7f04380096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981474526d723ee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f0444ff9640 1 -- 172.21.15.2:0/64823425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043800fe50 con 0x560f143bd390 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f0444ff9640 1 -- 172.21.15.2:0/64823425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043801c420 con 0x560f143bd390 2024-08-31T04:32:51.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.595+0000 7f0444ff9640 1 -- 172.21.15.2:0/64823425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380055c0 con 0x560f143bd390 2024-08-31T04:32:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 -- 172.21.15.2:0/64823425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 msgr2=0x560f1479ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0438000c00 tx=0x7f04380096c0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 -- 172.21.15.2:0/64823425 shutdown_connections 2024-08-31T04:32:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143bd390 0x560f1479ee50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f1478ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 --2- 172.21.15.2:0/64823425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143b51b0 0x560f14788ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 -- 172.21.15.2:0/64823425 >> 172.21.15.2:0/64823425 conn(0x560f143d2460 msgr2=0x560f147883a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 -- 172.21.15.2:0/64823425 shutdown_connections 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.596+0000 7f045bb84740 1 -- 172.21.15.2:0/64823425 wait complete. 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 -- start start 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 Processor -- start 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f147974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04501ad3d0 con 0x560f143b51b0 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04501ae840 con 0x560f143de070 2024-08-31T04:32:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04501adaa0 con 0x560f143bd390 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f045bb84740 10 client.0 _ll_register_callbacks cb 0x7f0438009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37160/0 (socket says 172.21.15.2:37160) 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f044f7fe640 1 -- 172.21.15.2:0/3272931970 learned_addr learned my addr 172.21.15.2:0/3272931970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f04467fc640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f147974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.597+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 -- 172.21.15.2:0/3272931970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 msgr2=0x560f147974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f147974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 -- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 msgr2=0x560f147979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 -- 172.21.15.2:0/3272931970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f1480ea20 con 0x560f143b51b0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f044f7fe640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f044802ade0 tx=0x7f0438009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca0c942ed78cb91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f04367fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448031450 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9664+0+0 (secure 0 0 0) 0x7f044804a040 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043801c420 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f04480315f0 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f045bb84740 10 client.16737 fetch_fsmap learned FSMap version 30 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f1480fcb0 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.598+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043801c420 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0448050040 con 0x560f143b51b0 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 10 client.16737 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 20 client.16737 populate_metadata read hostname 'smithi002' 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f14371da0 0x560f14812110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 4 client.16737 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:32:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560f146f8020 con 0x560f14371da0 2024-08-31T04:32:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f04467fc640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f14371da0 0x560f14812110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f04467fc640 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f14371da0 0x560f14812110 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5cbd877bcbe2ef server_cookie=a8442dfd8740bd91 in_seq=0 out_seq=0 2024-08-31T04:32:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.599+0000 7f04367fc640 10 client.16737 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f04367fc640 1 -- 172.21.15.2:0/3272931970 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x560f146f8020 con 0x560f14371da0 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f04367fc640 10 client.16737 handle_command_reply: tid=0 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 client.16737 shutdown 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 msgr2=0x560f14796f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f044802ade0 tx=0x7f0438009e30 comp rx=0 tx=0).stop 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 shutdown_connections 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560f14371da0 0x560f14812110 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f04367fc640 0 client.16737 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f143de070 0x560f147979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f143bd390 0x560f147974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 --2- 172.21.15.2:0/3272931970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f143b51b0 0x560f14796f60 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.600+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 >> 172.21.15.2:0/3272931970 conn(0x560f143d2460 msgr2=0x560f14781180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 shutdown_connections 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045bb84740 1 -- 172.21.15.2:0/3272931970 wait complete. 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045bb84740 20 client.16737 trim_cache size 0 max 16384 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:32:51.607 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "4539a698-1514-4b64-8024-440ec6b51908", 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.609 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.610 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.611 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:51.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:32:51.617 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:32:51.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 msgr2=0x7f043c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 0x7f043c0b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04400ac110 tx=0x7f04400e99f0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 msgr2=0x7f045019a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:51.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f044000e9c0 tx=0x7f044000ee80 comp rx=0 tx=0).stop 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 shutdown_connections 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0450106990 0x7f045019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0450106040 0x7f045019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f043c0b4ca0 0x7f043c0b71b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 --2- 172.21.15.2:0/3634312779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0450101df0 0x7f045019a210 secure :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f044000e9c0 tx=0x7f044000ee80 comp rx=0 tx=0).stop 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.601+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 >> 172.21.15.2:0/3634312779 conn(0x7f0450077a00 msgr2=0x7f0450105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.602+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 shutdown_connections 2024-08-31T04:32:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:32:51.602+0000 7f045560f640 1 -- 172.21.15.2:0/3634312779 wait complete. 2024-08-31T04:32:51.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 750924 11.46 MB/sec execute 251 sec latency 40.147 ms 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:51 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:51.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:51 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:32:52.405 INFO:tasks.cephfs.filesystem:scrub status for tag:4539a698-1514-4b64-8024-440ec6b51908 - {'path': '/', 'tag': '4539a698-1514-4b64-8024-440ec6b51908', 'options': 'recursive,force'} 2024-08-31T04:32:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:52 smithi002 ceph-mon[18656]: pgmap v564: 129 pgs: 129 active+clean; 461 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:32:52.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 753198 11.47 MB/sec execute 252 sec latency 13.320 ms 2024-08-31T04:32:52.718 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:52 smithi064 ceph-mon[22007]: pgmap v564: 129 pgs: 129 active+clean; 461 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:32:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:52 smithi132 ceph-mon[22335]: pgmap v564: 129 pgs: 129 active+clean; 461 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 201 op/s 2024-08-31T04:32:53.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 755212 11.45 MB/sec execute 253 sec latency 50.395 ms 2024-08-31T04:32:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:54 smithi002 ceph-mon[18656]: pgmap v565: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 248 op/s 2024-08-31T04:32:54.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 757052 11.45 MB/sec execute 254 sec latency 51.149 ms 2024-08-31T04:32:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:54 smithi064 ceph-mon[22007]: pgmap v565: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 248 op/s 2024-08-31T04:32:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:54 smithi132 ceph-mon[22335]: pgmap v565: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 248 op/s 2024-08-31T04:32:55.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 758877 11.44 MB/sec execute 255 sec latency 62.631 ms 2024-08-31T04:32:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:56 smithi002 ceph-mon[18656]: pgmap v566: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 212 op/s 2024-08-31T04:32:56.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 760810 11.44 MB/sec execute 256 sec latency 38.843 ms 2024-08-31T04:32:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:56 smithi064 ceph-mon[22007]: pgmap v566: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 212 op/s 2024-08-31T04:32:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:56 smithi132 ceph-mon[22335]: pgmap v566: 129 pgs: 129 active+clean; 466 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 212 op/s 2024-08-31T04:32:57.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 763253 11.45 MB/sec execute 257 sec latency 19.500 ms 2024-08-31T04:32:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:58 smithi002 ceph-mon[18656]: pgmap v567: 129 pgs: 129 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-08-31T04:32:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:58 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:32:58.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:32:58 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:32:58.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 764978 11.44 MB/sec execute 258 sec latency 26.216 ms 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:58 smithi064 ceph-mon[22007]: pgmap v567: 129 pgs: 129 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:58 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:32:58 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:58 smithi132 ceph-mon[22335]: pgmap v567: 129 pgs: 129 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:58 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:32:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:32:58 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:32:59.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 767232 11.45 MB/sec execute 259 sec latency 16.532 ms 2024-08-31T04:33:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:00 smithi002 ceph-mon[18656]: pgmap v568: 129 pgs: 129 active+clean; 477 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:00.681 INFO:tasks.workunit.client.0.smithi002.stdout: 1 767973 11.41 MB/sec execute 260 sec latency 145.396 ms 2024-08-31T04:33:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:00 smithi064 ceph-mon[22007]: pgmap v568: 129 pgs: 129 active+clean; 477 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:00 smithi132 ceph-mon[22335]: pgmap v568: 129 pgs: 129 active+clean; 477 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:01.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 768662 11.38 MB/sec execute 261 sec latency 95.778 ms 2024-08-31T04:33:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:02 smithi002 ceph-mon[18656]: pgmap v569: 129 pgs: 129 active+clean; 478 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-08-31T04:33:02.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 770953 11.39 MB/sec execute 262 sec latency 15.279 ms 2024-08-31T04:33:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:02 smithi064 ceph-mon[22007]: pgmap v569: 129 pgs: 129 active+clean; 478 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-08-31T04:33:02.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:02 smithi132 ceph-mon[22335]: pgmap v569: 129 pgs: 129 active+clean; 478 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-08-31T04:33:03.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 772924 11.38 MB/sec execute 263 sec latency 36.002 ms 2024-08-31T04:33:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: pgmap v570: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T04:33:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:33:04.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 774793 11.38 MB/sec execute 264 sec latency 30.049 ms 2024-08-31T04:33:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: pgmap v570: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T04:33:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T04:33:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: pgmap v570: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:33:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:04.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:33:05.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:05 smithi002 ceph-mon[18656]: Adjusting osd_memory_target on smithi132 to 176.0M 2024-08-31T04:33:05.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:05 smithi002 ceph-mon[18656]: Unable to set osd_memory_target on smithi132 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-31T04:33:05.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 776527 11.37 MB/sec execute 265 sec latency 110.183 ms 2024-08-31T04:33:05.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:05 smithi064 ceph-mon[22007]: Adjusting osd_memory_target on smithi132 to 176.0M 2024-08-31T04:33:05.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:05 smithi064 ceph-mon[22007]: Unable to set osd_memory_target on smithi132 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-31T04:33:05.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:05 smithi132 ceph-mon[22335]: Adjusting osd_memory_target on smithi132 to 176.0M 2024-08-31T04:33:05.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:05 smithi132 ceph-mon[22335]: Unable to set osd_memory_target on smithi132 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-31T04:33:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:06 smithi002 ceph-mon[18656]: pgmap v572: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:33:06.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 778464 11.37 MB/sec execute 266 sec latency 32.568 ms 2024-08-31T04:33:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:06 smithi064 ceph-mon[22007]: pgmap v572: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:33:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:06 smithi132 ceph-mon[22335]: pgmap v572: 129 pgs: 129 active+clean; 481 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-08-31T04:33:07.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 780939 11.38 MB/sec execute 267 sec latency 16.508 ms 2024-08-31T04:33:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:08 smithi002 ceph-mon[18656]: pgmap v573: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2024-08-31T04:33:08.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 782574 11.37 MB/sec execute 268 sec latency 42.588 ms 2024-08-31T04:33:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:08 smithi064 ceph-mon[22007]: pgmap v573: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2024-08-31T04:33:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:08 smithi132 ceph-mon[22335]: pgmap v573: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2024-08-31T04:33:09.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 784972 11.38 MB/sec execute 269 sec latency 15.199 ms 2024-08-31T04:33:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:10 smithi002 ceph-mon[18656]: pgmap v574: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T04:33:10.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 786243 11.36 MB/sec execute 270 sec latency 77.811 ms 2024-08-31T04:33:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:10 smithi064 ceph-mon[22007]: pgmap v574: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T04:33:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:10 smithi132 ceph-mon[22335]: pgmap v574: 129 pgs: 129 active+clean; 488 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T04:33:11.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 788605 11.37 MB/sec execute 271 sec latency 21.140 ms 2024-08-31T04:33:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:12 smithi064 ceph-mon[22007]: pgmap v575: 129 pgs: 129 active+clean; 490 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 246 op/s 2024-08-31T04:33:12.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:12 smithi064 ceph-mon[22007]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T04:33:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:12 smithi132 ceph-mon[22335]: pgmap v575: 129 pgs: 129 active+clean; 490 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 246 op/s 2024-08-31T04:33:12.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:12 smithi132 ceph-mon[22335]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T04:33:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:12 smithi002 ceph-mon[18656]: pgmap v575: 129 pgs: 129 active+clean; 490 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 246 op/s 2024-08-31T04:33:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:12 smithi002 ceph-mon[18656]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T04:33:12.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 790665 11.35 MB/sec execute 272 sec latency 27.632 ms 2024-08-31T04:33:13.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 792685 11.36 MB/sec execute 273 sec latency 39.064 ms 2024-08-31T04:33:14.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:14 smithi064 ceph-mon[22007]: pgmap v577: 129 pgs: 129 active+clean; 496 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 244 op/s 2024-08-31T04:33:14.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:14 smithi132 ceph-mon[22335]: pgmap v577: 129 pgs: 129 active+clean; 496 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 244 op/s 2024-08-31T04:33:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:14 smithi002 ceph-mon[18656]: pgmap v577: 129 pgs: 129 active+clean; 496 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 244 op/s 2024-08-31T04:33:14.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 795415 11.38 MB/sec execute 274 sec latency 14.742 ms 2024-08-31T04:33:15.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 796774 11.36 MB/sec execute 275 sec latency 72.175 ms 2024-08-31T04:33:16.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:16 smithi064 ceph-mon[22007]: pgmap v578: 129 pgs: 129 active+clean; 499 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 249 op/s 2024-08-31T04:33:16.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:16 smithi132 ceph-mon[22335]: pgmap v578: 129 pgs: 129 active+clean; 499 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 249 op/s 2024-08-31T04:33:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:16 smithi002 ceph-mon[18656]: pgmap v578: 129 pgs: 129 active+clean; 499 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 249 op/s 2024-08-31T04:33:16.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 799238 11.37 MB/sec execute 276 sec latency 14.180 ms 2024-08-31T04:33:17.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 801122 11.35 MB/sec execute 277 sec latency 41.888 ms 2024-08-31T04:33:18.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:18 smithi064 ceph-mon[22007]: pgmap v579: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:18.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:18 smithi132 ceph-mon[22335]: pgmap v579: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:18.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:18 smithi002 ceph-mon[18656]: pgmap v579: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T04:33:18.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 803156 11.36 MB/sec execute 278 sec latency 29.564 ms 2024-08-31T04:33:19.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 805766 11.37 MB/sec execute 279 sec latency 16.440 ms 2024-08-31T04:33:20.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:20 smithi064 ceph-mon[22007]: pgmap v580: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 234 op/s 2024-08-31T04:33:20.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:20 smithi132 ceph-mon[22335]: pgmap v580: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 234 op/s 2024-08-31T04:33:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:20 smithi002 ceph-mon[18656]: pgmap v580: 129 pgs: 129 active+clean; 506 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 234 op/s 2024-08-31T04:33:20.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 807364 11.36 MB/sec execute 280 sec latency 68.466 ms 2024-08-31T04:33:21.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 809649 11.37 MB/sec execute 281 sec latency 18.230 ms 2024-08-31T04:33:22.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:33:22.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:22 smithi064 ceph-mon[22007]: pgmap v581: 129 pgs: 129 active+clean; 505 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T04:33:22.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:22 smithi132 ceph-mon[22335]: pgmap v581: 129 pgs: 129 active+clean; 505 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T04:33:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:22 smithi002 ceph-mon[18656]: pgmap v581: 129 pgs: 129 active+clean; 505 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T04:33:22.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 811206 11.35 MB/sec execute 282 sec latency 27.598 ms 2024-08-31T04:33:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 -- 172.21.15.2:0/739932735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc102840 msgr2=0x7f77dc102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 --2- 172.21.15.2:0/739932735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc102840 0x7f77dc102c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009900 tx=0x7f77d802a410 comp rx=0 tx=0).stop 2024-08-31T04:33:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 -- 172.21.15.2:0/739932735 shutdown_connections 2024-08-31T04:33:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 --2- 172.21.15.2:0/739932735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc108ad0 0x7f77dc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 --2- 172.21.15.2:0/739932735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108180 0x7f77dc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 --2- 172.21.15.2:0/739932735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc102840 0x7f77dc102c50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 -- 172.21.15.2:0/739932735 >> 172.21.15.2:0/739932735 conn(0x7f77dc0794f0 msgr2=0x7f77dc079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.183+0000 7f77e30b0640 1 -- 172.21.15.2:0/739932735 shutdown_connections 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.184+0000 7f77e30b0640 1 -- 172.21.15.2:0/739932735 wait complete. 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.184+0000 7f77e30b0640 1 Processor -- start 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.184+0000 7f77e30b0640 1 -- start start 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc102840 0x7f77dc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108ad0 0x7f77dc19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1127a0 con 0x7f77dc108180 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc112620 con 0x7f77dc102840 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc112920 con 0x7f77dc108ad0 2024-08-31T04:33:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc102840 0x7f77dc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58060/0 (socket says 172.21.15.2:58060) 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 -- 172.21.15.2:0/2884263573 learned_addr learned my addr 172.21.15.2:0/2884263573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e164d640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108ad0 0x7f77dc19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 -- 172.21.15.2:0/2884263573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108ad0 msgr2=0x7f77dc19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108ad0 0x7f77dc19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 -- 172.21.15.2:0/2884263573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc102840 msgr2=0x7f77dc19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc102840 0x7f77dc19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 -- 172.21.15.2:0/2884263573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1a01f0 con 0x7f77dc108180 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d3fff640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00e9c0 tx=0x7f77cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d1ffb640 1 -- 172.21.15.2:0/2884263573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00ccc0 con 0x7f77dc108180 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77d1ffb640 1 -- 172.21.15.2:0/2884263573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77cc0054d0 con 0x7f77dc108180 2024-08-31T04:33:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.185+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc1a04e0 con 0x7f77dc108180 2024-08-31T04:33:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.186+0000 7f77d1ffb640 1 -- 172.21.15.2:0/2884263573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc010430 con 0x7f77dc108180 2024-08-31T04:33:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.186+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc1a6c40 con 0x7f77dc108180 2024-08-31T04:33:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.188+0000 7f77e9625740 1 Processor -- start 2024-08-31T04:33:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.188+0000 7f77e9625740 1 -- start start 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.188+0000 7f77e9625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.188+0000 7f77e9625740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x562206651800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e9625740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x562206651d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e9625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622065c8630 con 0x5622062ac070 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e9625740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5622065b7bc0 con 0x56220628b390 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e9625740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5622065bbb70 con 0x5622062831b0 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77d1ffb640 1 -- 172.21.15.2:0/2884263573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f77cc005020 con 0x7f77dc108180 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58070/0 (socket says 172.21.15.2:58070) 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 -- 172.21.15.2:0/3754827899 learned_addr learned my addr 172.21.15.2:0/3754827899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x562206651800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77d3fff640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x562206651d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 -- 172.21.15.2:0/3754827899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 msgr2=0x562206651800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x562206651800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 -- 172.21.15.2:0/3754827899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 msgr2=0x562206651d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x562206651d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 -- 172.21.15.2:0/3754827899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562206317650 con 0x5622062ac070 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x562206651800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.189+0000 7f77e164d640 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009fd0 tx=0x7f77d40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e232d1a36410052 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77d1ffb640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 0x7f77c40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 0x7f77c40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77c2ffd640 1 -- 172.21.15.2:0/3754827899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4004d20 con 0x5622062ac070 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77c2ffd640 1 -- 172.21.15.2:0/3754827899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d4004050 con 0x5622062ac070 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77c2ffd640 1 -- 172.21.15.2:0/3754827899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4005280 con 0x5622062ac070 2024-08-31T04:33:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.190+0000 7f77d1ffb640 1 -- 172.21.15.2:0/2884263573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f77cc0e5c60 con 0x7f77dc108180 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- 172.21.15.2:0/3754827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 msgr2=0x5622066512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009fd0 tx=0x7f77d40118d0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 0x7f77c40b7230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f77d8031440 tx=0x7f77d8009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- 172.21.15.2:0/3754827899 shutdown_connections 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x562206651d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x562206651800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 --2- 172.21.15.2:0/3754827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x5622066512c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- 172.21.15.2:0/3754827899 >> 172.21.15.2:0/3754827899 conn(0x5622062a0460 msgr2=0x56220664f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- 172.21.15.2:0/3754827899 shutdown_connections 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- 172.21.15.2:0/3754827899 wait complete. 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 -- start start 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.191+0000 7f77e9625740 1 Processor -- start 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x56220665cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x562206668dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56220641a700 con 0x5622062ac070 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56220653e700 con 0x56220628b390 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56220665faa0 con 0x5622062831b0 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e9625740 10 client.0 _ll_register_callbacks cb 0x56220656ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:39280/0 (socket says 172.21.15.2:39280) 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e0e4c640 1 -- 172.21.15.2:0/261042596 learned_addr learned my addr 172.21.15.2:0/261042596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77e164d640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x562206668dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.192+0000 7f77d3fff640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x56220665cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 -- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 msgr2=0x56220665cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x56220665cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 -- 172.21.15.2:0/261042596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 msgr2=0x562206668dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x562206668dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 -- 172.21.15.2:0/261042596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622065778b0 con 0x5622062831b0 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77d3fff640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x56220665cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e164d640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x562206668dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77d80057c0 tx=0x7f77d8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4918a2febf470e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:33:23.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d804d070 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f77d8004450 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.193+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d4004050 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77d8059050 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 10 client.26290 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56220666b880 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d4004050 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f77d8004cc0 con 0x5622062831b0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 10 client.26290 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 10 client.26290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 20 client.26290 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220626a9f0 0x56220666edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 4 client.26290 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.194+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622065ca580 con 0x56220626a9f0 2024-08-31T04:33:23.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.195+0000 7f77d3fff640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220626a9f0 0x56220666edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.195+0000 7f77bbfff640 10 client.26290 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.195+0000 7f77d3fff640 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220626a9f0 0x56220666edd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375d2cac2ecbeb74 server_cookie=c1fda6d75fb5969f in_seq=0 out_seq=0 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77bbfff640 1 -- 172.21.15.2:0/261042596 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622065ca580 con 0x56220626a9f0 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77bbfff640 10 client.26290 handle_command_reply: tid=0 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 client.26290 shutdown 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 msgr2=0x56220665ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77d80057c0 tx=0x7f77d8009260 comp rx=0 tx=0).stop 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 shutdown_connections 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220626a9f0 0x56220666edd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062ac070 0x562206668dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56220628b390 0x56220665cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77bbfff640 0 client.26290 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 --2- 172.21.15.2:0/261042596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5622062831b0 0x56220665ca70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 >> 172.21.15.2:0/261042596 conn(0x5622062a0460 msgr2=0x5622066544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 shutdown_connections 2024-08-31T04:33:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 1 -- 172.21.15.2:0/261042596 wait complete. 2024-08-31T04:33:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.196+0000 7f77e9625740 20 client.26290 trim_cache size 0 max 16384 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.216+0000 7f77e9625740 1 Processor -- start 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.216+0000 7f77e9625740 1 -- start start 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.216+0000 7f77e9625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.216+0000 7f77e9625740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e9625740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x562206654900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e9625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1b15c0 con 0x5622062831b0 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e9625740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1aee90 con 0x5622062ac070 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e9625740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1acce0 con 0x56220628b390 2024-08-31T04:33:23.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58092/0 (socket says 172.21.15.2:58092) 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 -- 172.21.15.2:0/73741805 learned_addr learned my addr 172.21.15.2:0/73741805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77d3fff640 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e164d640 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x562206654900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 -- 172.21.15.2:0/73741805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 msgr2=0x5622066543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 -- 172.21.15.2:0/73741805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 msgr2=0x562206654900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x562206654900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 -- 172.21.15.2:0/73741805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622066537e0 con 0x5622062831b0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f77d8003800 tx=0x7f77d8031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf4bd7265b3cec2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77c27fc640 1 -- 172.21.15.2:0/73741805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d804d070 con 0x5622062831b0 2024-08-31T04:33:23.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77c27fc640 1 -- 172.21.15.2:0/73741805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d8062070 con 0x5622062831b0 2024-08-31T04:33:23.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.217+0000 7f77c27fc640 1 -- 172.21.15.2:0/73741805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8035040 con 0x5622062831b0 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.218+0000 7f77e9625740 1 -- 172.21.15.2:0/73741805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 msgr2=0x562206668cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.218+0000 7f77e9625740 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f77d8003800 tx=0x7f77d8031810 comp rx=0 tx=0).stop 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 -- 172.21.15.2:0/73741805 shutdown_connections 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x562206654900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 --2- 172.21.15.2:0/73741805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206668cc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 -- 172.21.15.2:0/73741805 >> 172.21.15.2:0/73741805 conn(0x5622062a0460 msgr2=0x56220665b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 -- 172.21.15.2:0/73741805 shutdown_connections 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 -- 172.21.15.2:0/73741805 wait complete. 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 -- start start 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 Processor -- start 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.219+0000 7f77e9625740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x5622066d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1ad350 con 0x5622062831b0 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1ae7c0 con 0x5622062ac070 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1ada20 con 0x56220628b390 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 10 client.0 _ll_register_callbacks cb 0x7f77d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58106/0 (socket says 172.21.15.2:58106) 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 -- 172.21.15.2:0/3372973092 learned_addr learned my addr 172.21.15.2:0/3372973092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e164d640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x5622066d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77d3fff640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 -- 172.21.15.2:0/3372973092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 msgr2=0x5622066614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 -- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 msgr2=0x5622066d8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x5622066d8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 -- 172.21.15.2:0/3372973092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562206661cd0 con 0x5622062831b0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e0e4c640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f77d8033000 tx=0x7f77d8005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f234a294f4b15c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d804d040 con 0x5622062831b0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f77d8003b60 con 0x5622062831b0 2024-08-31T04:33:23.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.220+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d8062070 con 0x5622062831b0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77d8073050 con 0x5622062831b0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 10 client.16755 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5622066d9ca0 con 0x5622062831b0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d8062070 con 0x5622062831b0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f77d803d450 con 0x5622062831b0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 10 client.16755 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 20 client.16755 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220623fda0 0x5622066dc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 4 client.16755 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5622065c6020 con 0x56220623fda0 2024-08-31T04:33:23.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.221+0000 7f77d3fff640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220623fda0 0x5622066dc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77bbfff640 10 client.16755 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77d3fff640 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220623fda0 0x5622066dc340 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537dfc201a709d7d server_cookie=f5f6dc34ec0e94c1 in_seq=0 out_seq=0 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77bbfff640 1 -- 172.21.15.2:0/3372973092 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5622065c6020 con 0x56220623fda0 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77bbfff640 10 client.16755 handle_command_reply: tid=0 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 client.16755 shutdown 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 msgr2=0x562206660f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f77d8033000 tx=0x7f77d8005ed0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 shutdown_connections 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56220623fda0 0x5622066dc340 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5622062ac070 0x5622066d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77bbfff640 0 client.16755 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56220628b390 0x5622066614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 --2- 172.21.15.2:0/3372973092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622062831b0 0x562206660f80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.222+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 >> 172.21.15.2:0/3372973092 conn(0x5622062a0460 msgr2=0x5622066543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 shutdown_connections 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e9625740 1 -- 172.21.15.2:0/3372973092 wait complete. 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e9625740 20 client.16755 trim_cache size 0 max 16384 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:33:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:33:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:33:23.233 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.234 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.235 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:33:23.236 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:33:23.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 msgr2=0x7f77c40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 0x7f77c40b7230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f77d8031440 tx=0x7f77d8009560 comp rx=0 tx=0).stop 2024-08-31T04:33:23.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 msgr2=0x7f77dc19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:23.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00e9c0 tx=0x7f77cc00ee80 comp rx=0 tx=0).stop 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 shutdown_connections 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77c40b4d20 0x7f77c40b7230 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77dc108180 0x7f77dc19a820 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc108ad0 0x7f77dc19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 --2- 172.21.15.2:0/2884263573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77dc102840 0x7f77dc19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.223+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 >> 172.21.15.2:0/2884263573 conn(0x7f77dc0794f0 msgr2=0x7f77dc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.224+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 shutdown_connections 2024-08-31T04:33:23.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:23.224+0000 7f77e30b0640 1 -- 172.21.15.2:0/2884263573 wait complete. 2024-08-31T04:33:23.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 813522 11.36 MB/sec execute 283 sec latency 14.861 ms 2024-08-31T04:33:24.058 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:33:24.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:33:24.326 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:24 smithi002 ceph-mon[18656]: pgmap v582: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T04:33:24.682 INFO:tasks.workunit.client.0.smithi002.stdout: 1 815485 11.34 MB/sec execute 284 sec latency 55.687 ms 2024-08-31T04:33:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:24 smithi064 ceph-mon[22007]: pgmap v582: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T04:33:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:24 smithi132 ceph-mon[22335]: pgmap v582: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T04:33:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 -- 172.21.15.2:0/4073136397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c102840 msgr2=0x7f337c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 --2- 172.21.15.2:0/4073136397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c102840 0x7f337c102c50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3378009900 tx=0x7f337802a410 comp rx=0 tx=0).stop 2024-08-31T04:33:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 -- 172.21.15.2:0/4073136397 shutdown_connections 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 --2- 172.21.15.2:0/4073136397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108ad0 0x7f337c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 --2- 172.21.15.2:0/4073136397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c108180 0x7f337c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 --2- 172.21.15.2:0/4073136397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c102840 0x7f337c102c50 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 -- 172.21.15.2:0/4073136397 >> 172.21.15.2:0/4073136397 conn(0x7f337c079580 msgr2=0x7f337c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 -- 172.21.15.2:0/4073136397 shutdown_connections 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.963+0000 7f3384090640 1 -- 172.21.15.2:0/4073136397 wait complete. 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 Processor -- start 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 -- start start 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108180 0x7f337c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c108ad0 0x7f337c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f337c113860 con 0x7f337c108ad0 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f337c1136e0 con 0x7f337c102840 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3384090640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f337c1139e0 con 0x7f337c108180 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3381e2c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f338262d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c108ad0 0x7f337c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3381e2c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:36928/0 (socket says 172.21.15.2:36928) 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.964+0000 7f3381e2c640 1 -- 172.21.15.2:0/1239270908 learned_addr learned my addr 172.21.15.2:0/1239270908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f338162b640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108180 0x7f337c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f3381e2c640 1 -- 172.21.15.2:0/1239270908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108180 msgr2=0x7f337c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f3381e2c640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108180 0x7f337c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f3381e2c640 1 -- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c108ad0 msgr2=0x7f337c19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f3381e2c640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c108ad0 0x7f337c19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.965+0000 7f3381e2c640 1 -- 172.21.15.2:0/1239270908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c1a01e0 con 0x7f337c102840 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3381e2c640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3378005940 tx=0x7f33780040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337803f030 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c1a0470 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33780044c0 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378035070 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.966+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c1a6c30 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.967+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c102c50 con 0x7f337c102840 2024-08-31T04:33:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.970+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3378042030 con 0x7f337c102840 2024-08-31T04:33:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.970+0000 7f3372ffd640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 0x7f33680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.970+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f3378105f90 con 0x7f337c102840 2024-08-31T04:33:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.971+0000 7f338162b640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 0x7f33680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.971+0000 7f338162b640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 0x7f33680b71b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f336c0095f0 tx=0x7f336c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:24.972+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f33780cc2c0 con 0x7f337c102840 2024-08-31T04:33:25.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.220+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f337c19b3a0 con 0x7f337c102840 2024-08-31T04:33:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.221+0000 7f3372ffd640 1 -- 172.21.15.2:0/1239270908 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11897 (secure 0 0 0) 0x7f33780d0a80 con 0x7f337c102840 2024-08-31T04:33:25.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:33:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"btime":"2024-08-31T04:32:19:298680+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:32:18.727298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:33:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-08-31T04:33:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 msgr2=0x7f33680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 0x7f33680b71b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f336c0095f0 tx=0x7f336c005f90 comp rx=0 tx=0).stop 2024-08-31T04:33:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 msgr2=0x7f337c19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3378005940 tx=0x7f33780040c0 comp rx=0 tx=0).stop 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 shutdown_connections 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f33680b4ca0 0x7f33680b71b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c108ad0 0x7f337c19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337c108180 0x7f337c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 --2- 172.21.15.2:0/1239270908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f337c102840 0x7f337c19a270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 >> 172.21.15.2:0/1239270908 conn(0x7f337c079580 msgr2=0x7f337c101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 shutdown_connections 2024-08-31T04:33:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:25.224+0000 7f3384090640 1 -- 172.21.15.2:0/1239270908 wait complete. 2024-08-31T04:33:25.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:25 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1239270908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:33:25.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 817270 11.35 MB/sec execute 285 sec latency 115.370 ms 2024-08-31T04:33:25.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:25 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1239270908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:33:25.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:25 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1239270908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:33:26.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:33:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:26.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:26 smithi002 ceph-mon[18656]: pgmap v583: 129 pgs: 129 active+clean; 483 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 233 op/s 2024-08-31T04:33:26.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 819377 11.34 MB/sec execute 286 sec latency 27.589 ms 2024-08-31T04:33:26.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.811+0000 7f36085db640 1 -- 172.21.15.2:0/4116415107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3600104780 msgr2=0x7f3600104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.811+0000 7f36085db640 1 --2- 172.21.15.2:0/4116415107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3600104780 0x7f3600104b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009900 tx=0x7f35fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 -- 172.21.15.2:0/4116415107 shutdown_connections 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 --2- 172.21.15.2:0/4116415107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f360010dbe0 0x7f36001100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 --2- 172.21.15.2:0/4116415107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36001050d0 0x7f360010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 --2- 172.21.15.2:0/4116415107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3600104780 0x7f3600104b90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 -- 172.21.15.2:0/4116415107 >> 172.21.15.2:0/4116415107 conn(0x7f36000794d0 msgr2=0x7f36000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 -- 172.21.15.2:0/4116415107 shutdown_connections 2024-08-31T04:33:26.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.812+0000 7f36085db640 1 -- 172.21.15.2:0/4116415107 wait complete. 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 Processor -- start 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 -- start start 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36001050d0 0x7f360019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113840 con 0x7f360010dbe0 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f36001136c0 con 0x7f3600104780 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f36085db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f36001139c0 con 0x7f36001050d0 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3606377640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3606b78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3605b76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36001050d0 0x7f360019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3606b78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41606/0 (socket says 172.21.15.2:41606) 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3606377640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51656/0 (socket says 172.21.15.2:51656) 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.813+0000 7f3606b78640 1 -- 172.21.15.2:0/409774000 learned_addr learned my addr 172.21.15.2:0/409774000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 -- 172.21.15.2:0/409774000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36001050d0 msgr2=0x7f360019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36001050d0 0x7f360019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 -- 172.21.15.2:0/409774000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 msgr2=0x7f360019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 -- 172.21.15.2:0/409774000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001a01e0 con 0x7f360010dbe0 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606377640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f3606b78640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f35f800efd0 tx=0x7f35f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f35f77fe640 1 -- 172.21.15.2:0/409774000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8003b70 con 0x7f360010dbe0 2024-08-31T04:33:26.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f35f77fe640 1 -- 172.21.15.2:0/409774000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f8003d10 con 0x7f360010dbe0 2024-08-31T04:33:26.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001a04d0 con 0x7f360010dbe0 2024-08-31T04:33:26.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f35f77fe640 1 -- 172.21.15.2:0/409774000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f80108a0 con 0x7f360010dbe0 2024-08-31T04:33:26.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.814+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001a6c30 con 0x7f360010dbe0 2024-08-31T04:33:26.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:26 smithi132 ceph-mon[22335]: pgmap v583: 129 pgs: 129 active+clean; 483 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 233 op/s 2024-08-31T04:33:26.821 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:26 smithi064 ceph-mon[22007]: pgmap v583: 129 pgs: 129 active+clean; 483 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 233 op/s 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.817+0000 7f360eb50740 1 Processor -- start 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.817+0000 7f35f77fe640 1 -- 172.21.15.2:0/409774000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f35f8004020 con 0x7f360010dbe0 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 -- start start 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f91752310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f91752d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f916c9680 con 0x560f913841b0 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560f916b8c10 con 0x560f913ad070 2024-08-31T04:33:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f360eb50740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560f916bcbc0 con 0x560f9138c390 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f3605b76640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f91752310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41614/0 (socket says 172.21.15.2:41614) 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f3606377640 1 -- 172.21.15.2:0/3682063682 learned_addr learned my addr 172.21.15.2:0/3682063682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f3605b76640 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f91752d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.818+0000 7f35f77fe640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 0x7f35ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 -- 172.21.15.2:0/3682063682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 msgr2=0x560f91752d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f91752d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 -- 172.21.15.2:0/3682063682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 msgr2=0x560f91752850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 -- 172.21.15.2:0/3682063682 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f91418650 con 0x560f913ad070 2024-08-31T04:33:26.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3606377640 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3606b78640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 0x7f35ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f35f77fe640 1 -- 172.21.15.2:0/409774000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f35f80e5e20 con 0x7f360010dbe0 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f3605b76640 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f91752310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f360010f8e0 tx=0x7f35f00096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83dc351dccd7c5d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f35f4ff9640 1 -- 172.21.15.2:0/3682063682 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0004050 con 0x560f913ad070 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f35f4ff9640 1 -- 172.21.15.2:0/3682063682 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f00054d0 con 0x560f913ad070 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.819+0000 7f35f4ff9640 1 -- 172.21.15.2:0/3682063682 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0004d20 con 0x560f913ad070 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 -- 172.21.15.2:0/3682063682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 msgr2=0x560f91752310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f3606b78640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 0x7f35ec0b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35f80abd60 tx=0x7f35f8079500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f91752310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f360010f8e0 tx=0x7f35f00096c0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 -- 172.21.15.2:0/3682063682 shutdown_connections 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f91752850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f91752d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 --2- 172.21.15.2:0/3682063682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f91752310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 -- 172.21.15.2:0/3682063682 >> 172.21.15.2:0/3682063682 conn(0x560f913a1460 msgr2=0x560f91750200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 -- 172.21.15.2:0/3682063682 shutdown_connections 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.820+0000 7f360eb50740 1 -- 172.21.15.2:0/3682063682 wait complete. 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 -- start start 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 Processor -- start 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 0x560f91761e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f9176e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f9151b700 con 0x560f9138c390 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560f9163f750 con 0x560f913ad070 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560f91764e20 con 0x560f913841b0 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f360eb50740 10 client.0 _ll_register_callbacks cb 0x560f9166ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41622/0 (socket says 172.21.15.2:41622) 2024-08-31T04:33:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f3606377640 1 -- 172.21.15.2:0/3774887732 learned_addr learned my addr 172.21.15.2:0/3774887732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f3605b76640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f9176e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.821+0000 7f3605b76640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 0x560f91761e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 -- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 msgr2=0x560f91761e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 0x560f91761e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 -- 172.21.15.2:0/3774887732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 msgr2=0x560f9176e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f9176e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 -- 172.21.15.2:0/3774887732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f91678900 con 0x560f9138c390 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3605b76640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 0x560f91761e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f3606377640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f35fc000c00 tx=0x7f35fc031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d86f4405835323 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f35e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc035040 con 0x560f9138c390 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f00054d0 con 0x560f9138c390 2024-08-31T04:33:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f35fc004240 con 0x560f9138c390 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35fc04f050 con 0x560f9138c390 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f360eb50740 10 client.16773 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.822+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f91770c50 con 0x560f9138c390 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f00054d0 con 0x560f9138c390 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f35fc0049a0 con 0x560f9138c390 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 10 client.16773 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 10 client.16773 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 20 client.16773 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f9136b9f0 0x560f91774170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 4 client.16773 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f916cb5d0 con 0x560f9136b9f0 2024-08-31T04:33:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.823+0000 7f3605b76640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f9136b9f0 0x560f91774170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.824+0000 7f3605b76640 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f9136b9f0 0x560f91774170 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40ecd718f688ffc6 server_cookie=dffaccab153e6250 in_seq=0 out_seq=0 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.824+0000 7f35e9ffb640 10 client.16773 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.824+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3774887732 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f916cb5d0 con 0x560f9136b9f0 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.824+0000 7f35e9ffb640 10 client.16773 handle_command_reply: tid=0 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.824+0000 7f360eb50740 1 client.16773 shutdown 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 msgr2=0x560f91762390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f35fc000c00 tx=0x7f35fc031740 comp rx=0 tx=0).stop 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 shutdown_connections 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f9136b9f0 0x560f91774170 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f9138c390 0x560f91762390 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f913ad070 0x560f9176e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 --2- 172.21.15.2:0/3774887732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f913841b0 0x560f91761e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f35e9ffb640 0 client.16773 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:33:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 >> 172.21.15.2:0/3774887732 conn(0x560f913a1460 msgr2=0x560f9174e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 shutdown_connections 2024-08-31T04:33:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 1 -- 172.21.15.2:0/3774887732 wait complete. 2024-08-31T04:33:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.825+0000 7f360eb50740 20 client.16773 trim_cache size 0 max 16384 2024-08-31T04:33:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 Processor -- start 2024-08-31T04:33:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 -- start start 2024-08-31T04:33:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9136b9f0 0x560f9176e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 0x560f91760c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36001b16f0 con 0x560f913841b0 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f36001aefc0 con 0x560f9138c390 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f360eb50740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ace10 con 0x560f9136b9f0 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41628/0 (socket says 172.21.15.2:41628) 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3606377640 1 -- 172.21.15.2:0/2025282517 learned_addr learned my addr 172.21.15.2:0/2025282517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3605b76640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9136b9f0 0x560f9176e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3605b76640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 0x560f91760c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3606377640 1 -- 172.21.15.2:0/2025282517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9136b9f0 msgr2=0x560f9176e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.840+0000 7f3606377640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9136b9f0 0x560f9176e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f3606377640 1 -- 172.21.15.2:0/2025282517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 msgr2=0x560f91760c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f3606377640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 0x560f91760c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f3606377640 1 -- 172.21.15.2:0/2025282517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f91760350 con 0x560f913841b0 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f3605b76640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 0x560f91760c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f3606377640 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f35fc04d040 tx=0x7f35fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73532716e30bd030 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f35ebfff640 1 -- 172.21.15.2:0/2025282517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc058070 con 0x560f913841b0 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f35ebfff640 1 -- 172.21.15.2:0/2025282517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc004f60 con 0x560f913841b0 2024-08-31T04:33:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.841+0000 7f35ebfff640 1 -- 172.21.15.2:0/2025282517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc035070 con 0x560f913841b0 2024-08-31T04:33:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- 172.21.15.2:0/2025282517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 msgr2=0x560f917606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f35fc04d040 tx=0x7f35fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:33:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- 172.21.15.2:0/2025282517 shutdown_connections 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f917606d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9138c390 0x560f91760c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 --2- 172.21.15.2:0/2025282517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9136b9f0 0x560f9176e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- 172.21.15.2:0/2025282517 >> 172.21.15.2:0/2025282517 conn(0x560f913a1460 msgr2=0x560f9175cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- 172.21.15.2:0/2025282517 shutdown_connections 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- 172.21.15.2:0/2025282517 wait complete. 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 -- start start 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.842+0000 7f360eb50740 1 Processor -- start 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9136b9f0 0x560f9176aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f9175f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ad480 con 0x560f913841b0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ae8f0 con 0x560f9136b9f0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f36001adb50 con 0x560f9138c390 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f360eb50740 10 client.0 _ll_register_callbacks cb 0x7f35fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3605b76640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9136b9f0 0x560f9176aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41638/0 (socket says 172.21.15.2:41638) 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 -- 172.21.15.2:0/3279072018 learned_addr learned my addr 172.21.15.2:0/3279072018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3605b76640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f9175f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 -- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 msgr2=0x560f9175f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f9175f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 -- 172.21.15.2:0/3279072018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9136b9f0 msgr2=0x560f9176aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9136b9f0 0x560f9176aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3606377640 1 -- 172.21.15.2:0/3279072018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f917696e0 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.843+0000 7f3605b76640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f9175f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f3606377640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f35fc02a930 tx=0x7f35fc0053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fa6ad4170f1a70 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f35e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc035050 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f35fc0055b0 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc004f60 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35fc069050 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f360eb50740 10 client.16779 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.844+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f917dec50 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc004f60 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f35fc064030 con 0x560f913841b0 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 10 client.16779 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 10 client.16779 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:33:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 20 client.16779 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f913ad070 0x560f917e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 4 client.16779 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f916c7070 con 0x560f913ad070 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.845+0000 7f3605b76640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f913ad070 0x560f917e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f35e9ffb640 10 client.16779 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f3605b76640 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f913ad070 0x560f917e13f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5404942d212738c9 server_cookie=c887182118693ab8 in_seq=0 out_seq=0 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f35e9ffb640 1 -- 172.21.15.2:0/3279072018 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f916c7070 con 0x560f913ad070 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f35e9ffb640 10 client.16779 handle_command_reply: tid=0 2024-08-31T04:33:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 client.16779 shutdown 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 msgr2=0x560f9175ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f35fc02a930 tx=0x7f35fc0053c0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 shutdown_connections 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x560f913ad070 0x560f917e13f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f913841b0 0x560f9175ef40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f35e9ffb640 0 client.16779 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560f9138c390 0x560f9175f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 --2- 172.21.15.2:0/3279072018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560f9136b9f0 0x560f9176aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.846+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 >> 172.21.15.2:0/3279072018 conn(0x560f913a1460 msgr2=0x560f9175cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 shutdown_connections 2024-08-31T04:33:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f360eb50740 1 -- 172.21.15.2:0/3279072018 wait complete. 2024-08-31T04:33:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f360eb50740 20 client.16779 trim_cache size 0 max 16384 2024-08-31T04:33:26.853 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:33:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 msgr2=0x7f35ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 0x7f35ec0b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35f80abd60 tx=0x7f35f8079500 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 msgr2=0x7f360019fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f35f800efd0 tx=0x7f35f800c6a0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 shutdown_connections 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f35ec0b4ca0 0x7f35ec0b71b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f360010dbe0 0x7f360019fab0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36001050d0 0x7f360019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 --2- 172.21.15.2:0/409774000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3600104780 0x7f360019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.847+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 >> 172.21.15.2:0/409774000 conn(0x7f36000794d0 msgr2=0x7f3600107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.848+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 shutdown_connections 2024-08-31T04:33:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:26.848+0000 7f36085db640 1 -- 172.21.15.2:0/409774000 wait complete. 2024-08-31T04:33:27.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 820945 11.34 MB/sec execute 287 sec latency 69.133 ms 2024-08-31T04:33:28.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:33:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:28 smithi002 ceph-mon[18656]: pgmap v584: 129 pgs: 129 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-08-31T04:33:28.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 823634 11.35 MB/sec execute 288 sec latency 18.816 ms 2024-08-31T04:33:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:28 smithi064 ceph-mon[22007]: pgmap v584: 129 pgs: 129 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-08-31T04:33:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:28 smithi132 ceph-mon[22335]: pgmap v584: 129 pgs: 129 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-08-31T04:33:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 -- 172.21.15.2:0/3663661154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0103900 msgr2=0x7f23e0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 --2- 172.21.15.2:0/3663661154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0103900 0x7f23e0103d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009900 tx=0x7f23dc02a410 comp rx=0 tx=0).stop 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 -- 172.21.15.2:0/3663661154 shutdown_connections 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 --2- 172.21.15.2:0/3663661154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 --2- 172.21.15.2:0/3663661154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0109b90 0x7f23e01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 --2- 172.21.15.2:0/3663661154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0103900 0x7f23e0103d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 -- 172.21.15.2:0/3663661154 >> 172.21.15.2:0/3663661154 conn(0x7f23e007b5f0 msgr2=0x7f23e007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 -- 172.21.15.2:0/3663661154 shutdown_connections 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.260+0000 7f23e7518640 1 -- 172.21.15.2:0/3663661154 wait complete. 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 Processor -- start 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 -- start start 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 0x7f23e00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 0x7f23e0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0113850 con 0x7f23e0109240 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01136d0 con 0x7f23e0103900 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e7518640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01139d0 con 0x7f23e0109b90 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41662/0 (socket says 172.21.15.2:41662) 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e4ab3640 1 -- 172.21.15.2:0/3563053247 learned_addr learned my addr 172.21.15.2:0/3563053247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.261+0000 7f23e52b4640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 0x7f23e00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 0x7f23e0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 -- 172.21.15.2:0/3563053247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 msgr2=0x7f23e0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 0x7f23e0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 -- 172.21.15.2:0/3563053247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 msgr2=0x7f23e00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 0x7f23e00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 -- 172.21.15.2:0/3563053247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01a8500 con 0x7f23e0109240 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e52b4640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 0x7f23e00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 0x7f23e0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.262+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f23d000e970 tx=0x7f23d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.263+0000 7f23d67fc640 1 -- 172.21.15.2:0/3563053247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d000cd80 con 0x7f23e0109240 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.263+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01a87f0 con 0x7f23e0109240 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.263+0000 7f23d67fc640 1 -- 172.21.15.2:0/3563053247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d00035f0 con 0x7f23e0109240 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.263+0000 7f23d67fc640 1 -- 172.21.15.2:0/3563053247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0010690 con 0x7f23e0109240 2024-08-31T04:33:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.263+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01a8d80 con 0x7f23e0109240 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.266+0000 7f23eda8d740 1 Processor -- start 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.266+0000 7f23eda8d740 1 -- start start 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6af1070 0x55e2f6e96350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e96dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6e0d680 con 0x55e2f6af1070 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6dfcc10 con 0x55e2f6ac81b0 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23eda8d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6e00bc0 con 0x55e2f6ad0390 2024-08-31T04:33:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23d67fc640 1 -- 172.21.15.2:0/3563053247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f23d0003aa0 con 0x7f23e0109240 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e5ab5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6af1070 0x55e2f6e96350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51716/0 (socket says 172.21.15.2:51716) 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 -- 172.21.15.2:0/90182216 learned_addr learned my addr 172.21.15.2:0/90182216 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e96dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 -- 172.21.15.2:0/90182216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 msgr2=0x55e2f6e96dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e96dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 -- 172.21.15.2:0/90182216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6af1070 msgr2=0x55e2f6e96350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6af1070 0x55e2f6e96350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.267+0000 7f23e52b4640 1 -- 172.21.15.2:0/90182216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2f6b5c650 con 0x55e2f6ac81b0 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23e52b4640 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750f93d9cf2b0b56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23cb7fe640 1 -- 172.21.15.2:0/90182216 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc040070 con 0x55e2f6ac81b0 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23cb7fe640 1 -- 172.21.15.2:0/90182216 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23dc031720 con 0x55e2f6ac81b0 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23cb7fe640 1 -- 172.21.15.2:0/90182216 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc035040 con 0x55e2f6ac81b0 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23d67fc640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 0x7f23cc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 0x7f23cc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.268+0000 7f23d67fc640 1 -- 172.21.15.2:0/3563053247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f23d00e5c60 con 0x7f23e0109240 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 -- 172.21.15.2:0/90182216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 msgr2=0x55e2f6e96890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc005e20 comp rx=0 tx=0).stop 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 0x7f23cc0b7230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009fd0 tx=0x7f23d8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 -- 172.21.15.2:0/90182216 shutdown_connections 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e96dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e96890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 --2- 172.21.15.2:0/90182216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6af1070 0x55e2f6e96350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 -- 172.21.15.2:0/90182216 >> 172.21.15.2:0/90182216 conn(0x55e2f6ae5460 msgr2=0x55e2f6e94240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 -- 172.21.15.2:0/90182216 shutdown_connections 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.269+0000 7f23eda8d740 1 -- 172.21.15.2:0/90182216 wait complete. 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.270+0000 7f23eda8d740 1 -- start start 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.270+0000 7f23eda8d740 1 Processor -- start 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.270+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6ea1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6af1070 0x55e2f6eade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6c5f700 con 0x55e2f6ad0390 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6d83750 con 0x55e2f6af1070 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2f6ea4ad0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23eda8d740 10 client.0 _ll_register_callbacks cb 0x55e2f6db2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41690/0 (socket says 172.21.15.2:41690) 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e4ab3640 1 -- 172.21.15.2:0/1238011840 learned_addr learned my addr 172.21.15.2:0/1238011840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6ea1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6af1070 0x55e2f6eade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 -- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6af1070 msgr2=0x55e2f6eade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6af1070 0x55e2f6eade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 -- 172.21.15.2:0/1238011840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 msgr2=0x55e2f6ea2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e52b4640 1 -- 172.21.15.2:0/1238011840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2f6dbc900 con 0x55e2f6ac81b0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.271+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6ea1b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e1f665de6ae8cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc035070 con 0x55e2f6ac81b0 2024-08-31T04:33:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23dc031720 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f23dc03c650 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23dc056050 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23eda8d740 10 client.26332 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e2f6eb08e0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.272+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23dc031720 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f23dc044770 con 0x55e2f6ac81b0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 10 client.26332 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 10 client.26332 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 20 client.26332 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6aaf9f0 0x55e2f6eb3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 4 client.26332 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2f6e0f5d0 con 0x55e2f6aaf9f0 2024-08-31T04:33:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.273+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6aaf9f0 0x55e2f6eb3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.274+0000 7f23c8ff9640 10 client.26332 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.274+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6aaf9f0 0x55e2f6eb3c40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80169f6c9a20e9cb server_cookie=d728956e76362aa1 in_seq=0 out_seq=0 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.274+0000 7f23c8ff9640 1 -- 172.21.15.2:0/1238011840 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2f6e0f5d0 con 0x55e2f6aaf9f0 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.274+0000 7f23c8ff9640 10 client.26332 handle_command_reply: tid=0 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 client.26332 shutdown 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 msgr2=0x55e2f6ea1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6ea1b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc02a410 comp rx=0 tx=0).stop 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 shutdown_connections 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6aaf9f0 0x55e2f6eb3c40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ad0390 0x55e2f6ea2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6af1070 0x55e2f6eade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23c8ff9640 0 client.26332 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:33:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1238011840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6ea1b00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 >> 172.21.15.2:0/1238011840 conn(0x55e2f6ae5460 msgr2=0x55e2f6e99530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 shutdown_connections 2024-08-31T04:33:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 1 -- 172.21.15.2:0/1238011840 wait complete. 2024-08-31T04:33:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.275+0000 7f23eda8d740 20 client.26332 trim_cache size 0 max 16384 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 Processor -- start 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 -- start start 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6e99b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e9f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b5aa0 con 0x55e2f6ae5460 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b3370 con 0x55e2f6ac81b0 2024-08-31T04:33:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.295+0000 7f23eda8d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b11c0 con 0x55e2f6ad0390 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51734/0 (socket says 172.21.15.2:51734) 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 -- 172.21.15.2:0/1430205677 learned_addr learned my addr 172.21.15.2:0/1430205677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e5ab5640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e9f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6e99b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 -- 172.21.15.2:0/1430205677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 msgr2=0x55e2f6e9f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e9f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 -- 172.21.15.2:0/1430205677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 msgr2=0x55e2f6e99b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6e99b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 -- 172.21.15.2:0/1430205677 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2f6ea0000 con 0x55e2f6ac81b0 2024-08-31T04:33:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e52b4640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6e99b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c6a0 tx=0x7f23d0003a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1dbe5d8d039221 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.296+0000 7f23caffd640 1 -- 172.21.15.2:0/1430205677 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d00ab7f0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.297+0000 7f23caffd640 1 -- 172.21.15.2:0/1430205677 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d00ab9b0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.297+0000 7f23caffd640 1 -- 172.21.15.2:0/1430205677 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d00ab610 con 0x55e2f6ac81b0 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.297+0000 7f23eda8d740 1 -- 172.21.15.2:0/1430205677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 msgr2=0x55e2f6e9ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.297+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c6a0 tx=0x7f23d0003a10 comp rx=0 tx=0).stop 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.297+0000 7f23eda8d740 1 -- 172.21.15.2:0/1430205677 shutdown_connections 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ad0390 0x55e2f6e9f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ac81b0 0x55e2f6e9ecf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 --2- 172.21.15.2:0/1430205677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6e99b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 -- 172.21.15.2:0/1430205677 >> 172.21.15.2:0/1430205677 conn(0x55e2f6e9d450 msgr2=0x55e2f6e99450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 -- 172.21.15.2:0/1430205677 shutdown_connections 2024-08-31T04:33:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 -- 172.21.15.2:0/1430205677 wait complete. 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 -- start start 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.298+0000 7f23eda8d740 1 Processor -- start 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 0x55e2f6eb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6f17400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b1830 con 0x55e2f6ae5460 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b2ca0 con 0x55e2f6ad0390 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01b1f00 con 0x55e2f6ac81b0 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23eda8d740 10 client.0 _ll_register_callbacks cb 0x7f23d8009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e5ab5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6f17400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:34400/0 (socket says 172.21.15.2:34400) 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 -- 172.21.15.2:0/2331122220 learned_addr learned my addr 172.21.15.2:0/2331122220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 0x55e2f6eb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 -- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 msgr2=0x55e2f6eb5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 0x55e2f6eb5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 -- 172.21.15.2:0/2331122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 msgr2=0x55e2f6f17400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6f17400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 -- 172.21.15.2:0/2331122220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2f6f17a70 con 0x55e2f6ac81b0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 0x55e2f6eb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23e52b4640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc044930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796f6cb51ed811c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.299+0000 7f23c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc05f060 con 0x55e2f6ac81b0 2024-08-31T04:33:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d00ab9b0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f23dc03ca60 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23dc035040 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 10 client.26338 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e2f6f1ed70 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d00ab9b0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f23dc03bae0 con 0x55e2f6ac81b0 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 10 client.26338 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 10 client.26338 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 20 client.26338 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6af1070 0x55e2f6f21500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 4 client.26338 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:33:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.300+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2f6e0b070 con 0x55e2f6af1070 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6af1070 0x55e2f6f21500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23c8ff9640 10 client.26338 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23e4ab3640 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6af1070 0x55e2f6f21500 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10d8701f1ff098e4 server_cookie=2df3f78f20346ec5 in_seq=0 out_seq=0 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23c8ff9640 1 -- 172.21.15.2:0/2331122220 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2f6e0b070 con 0x55e2f6af1070 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23c8ff9640 10 client.26338 handle_command_reply: tid=0 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.301+0000 7f23eda8d740 1 client.26338 shutdown 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 msgr2=0x55e2f6eb5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a930 tx=0x7f23dc044930 comp rx=0 tx=0).stop 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 shutdown_connections 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55e2f6af1070 0x55e2f6f21500 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2f6ae5460 0x55e2f6f17400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e2f6ad0390 0x55e2f6eb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23c8ff9640 0 client.26338 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 --2- 172.21.15.2:0/2331122220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2f6ac81b0 0x55e2f6eb5590 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 >> 172.21.15.2:0/2331122220 conn(0x55e2f6e9d450 msgr2=0x55e2f6e97380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 shutdown_connections 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 1 -- 172.21.15.2:0/2331122220 wait complete. 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23eda8d740 20 client.26338 trim_cache size 0 max 16384 2024-08-31T04:33:29.310 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 msgr2=0x7f23cc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 0x7f23cc0b7230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009fd0 tx=0x7f23d8009500 comp rx=0 tx=0).stop 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 msgr2=0x7f23e00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.302+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f23d000e970 tx=0x7f23d000ee30 comp rx=0 tx=0).stop 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 shutdown_connections 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f23cc0b4d20 0x7f23cc0b7230 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0109240 0x7f23e00759f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23e0109b90 0x7f23e0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 --2- 172.21.15.2:0/3563053247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23e0103900 0x7f23e00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 >> 172.21.15.2:0/3563053247 conn(0x7f23e007b5f0 msgr2=0x7f23e0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 shutdown_connections 2024-08-31T04:33:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:29.303+0000 7f23e7518640 1 -- 172.21.15.2:0/3563053247 wait complete. 2024-08-31T04:33:29.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 825172 11.34 MB/sec execute 289 sec latency 38.228 ms 2024-08-31T04:33:30.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:33:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:30.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:30 smithi002 ceph-mon[18656]: pgmap v585: 129 pgs: 129 active+clean; 492 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T04:33:30.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 827471 11.35 MB/sec execute 290 sec latency 63.338 ms 2024-08-31T04:33:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:30 smithi064 ceph-mon[22007]: pgmap v585: 129 pgs: 129 active+clean; 492 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T04:33:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:30 smithi132 ceph-mon[22335]: pgmap v585: 129 pgs: 129 active+clean; 492 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T04:33:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 -- 172.21.15.2:0/4249477485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 msgr2=0x7f827410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 --2- 172.21.15.2:0/4249477485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827410f2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f826c009ca0 tx=0x7f826c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 -- 172.21.15.2:0/4249477485 shutdown_connections 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 --2- 172.21.15.2:0/4249477485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827410f2c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 --2- 172.21.15.2:0/4249477485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f8274108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 --2- 172.21.15.2:0/4249477485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 0x7f8274102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.501+0000 7f8278cc7640 1 -- 172.21.15.2:0/4249477485 >> 172.21.15.2:0/4249477485 conn(0x7f82740794d0 msgr2=0x7f82740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.502+0000 7f8278cc7640 1 -- 172.21.15.2:0/4249477485 shutdown_connections 2024-08-31T04:33:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.502+0000 7f8278cc7640 1 -- 172.21.15.2:0/4249477485 wait complete. 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.502+0000 7f8278cc7640 1 Processor -- start 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.502+0000 7f8278cc7640 1 -- start start 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 0x7f827419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f827419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8274113820 con 0x7f8274108a90 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82741136a0 con 0x7f8274108140 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8278cc7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82741139a0 con 0x7f8274102800 2024-08-31T04:33:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41728/0 (socket says 172.21.15.2:41728) 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 -- 172.21.15.2:0/2033985950 learned_addr learned my addr 172.21.15.2:0/2033985950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f827419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f827259c640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 0x7f827419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 -- 172.21.15.2:0/2033985950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 msgr2=0x7f827419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 0x7f827419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 -- 172.21.15.2:0/2033985950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 msgr2=0x7f827419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f827419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8272d9d640 1 -- 172.21.15.2:0/2033985950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82741a01a0 con 0x7f8274108a90 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.503+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f827419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f8272d9d640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f826c005cc0 tx=0x7f826c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f826b7fe640 1 -- 172.21.15.2:0/2033985950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c003b70 con 0x7f8274108a90 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82741a0430 con 0x7f8274108a90 2024-08-31T04:33:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f826b7fe640 1 -- 172.21.15.2:0/2033985950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c0318f0 con 0x7f8274108a90 2024-08-31T04:33:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f826b7fe640 1 -- 172.21.15.2:0/2033985950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c02f950 con 0x7f8274108a90 2024-08-31T04:33:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.504+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82741a6bf0 con 0x7f8274108a90 2024-08-31T04:33:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 Processor -- start 2024-08-31T04:33:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f826b7fe640 1 -- 172.21.15.2:0/2033985950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f826c02fb50 con 0x7f8274108a90 2024-08-31T04:33:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 -- start start 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x559907980310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907980d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5599078f7680 con 0x5599075b21b0 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5599078e6c10 con 0x5599075ba390 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.507+0000 7f827f23c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5599078eabc0 con 0x5599075db070 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41732/0 (socket says 172.21.15.2:41732) 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 -- 172.21.15.2:0/2929290452 learned_addr learned my addr 172.21.15.2:0/2929290452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907980d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x559907980310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f826b7fe640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 -- 172.21.15.2:0/2929290452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 msgr2=0x559907980310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x559907980310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 -- 172.21.15.2:0/2929290452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 msgr2=0x559907980d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907980d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 -- 172.21.15.2:0/2929290452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559907646650 con 0x5599075b21b0 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f8272d9d640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f826b7fe640 1 -- 172.21.15.2:0/2033985950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f826c106ac0 con 0x7f8274108a90 2024-08-31T04:33:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f827259c640 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8264009d20 tx=0x7f8264011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2934689dbae7aca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.508+0000 7f8268ff9640 1 -- 172.21.15.2:0/2929290452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401e070 con 0x5599075b21b0 2024-08-31T04:33:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.509+0000 7f8268ff9640 1 -- 172.21.15.2:0/2929290452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264009e10 con 0x5599075b21b0 2024-08-31T04:33:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.509+0000 7f8268ff9640 1 -- 172.21.15.2:0/2929290452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640187d0 con 0x5599075b21b0 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.509+0000 7f827f23c740 1 -- 172.21.15.2:0/2929290452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 msgr2=0x559907980850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.509+0000 7f8272d9d640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 0x7f82600b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f826c0c8dc0 tx=0x7f826c096ef0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.509+0000 7f827f23c740 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8264009d20 tx=0x7f8264011810 comp rx=0 tx=0).stop 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 -- 172.21.15.2:0/2929290452 shutdown_connections 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075b21b0 0x559907980850 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907980d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 --2- 172.21.15.2:0/2929290452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x559907980310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 -- 172.21.15.2:0/2929290452 >> 172.21.15.2:0/2929290452 conn(0x5599075cf460 msgr2=0x55990797e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 -- 172.21.15.2:0/2929290452 shutdown_connections 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 -- 172.21.15.2:0/2929290452 wait complete. 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 -- start start 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 Processor -- start 2024-08-31T04:33:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.510+0000 7f827f23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x5599079903d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827f23c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990799c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827f23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559907749700 con 0x5599075ba390 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827f23c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55990786d750 con 0x5599075b21b0 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827f23c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559907992e50 con 0x5599075db070 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827f23c740 10 client.0 _ll_register_callbacks cb 0x55990789ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51786/0 (socket says 172.21.15.2:51786) 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 -- 172.21.15.2:0/3214905989 learned_addr learned my addr 172.21.15.2:0/3214905989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990799c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827259c640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x5599079903d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 -- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 msgr2=0x55990798fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 -- 172.21.15.2:0/3214905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 msgr2=0x5599079903d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x5599079903d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 -- 172.21.15.2:0/3214905989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599078a6900 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f827259c640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x5599079903d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8271d9b640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990799c180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f825c00f7b0 tx=0x7f825c0096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7e9577a118bd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.511+0000 7f8259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c004050 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8264009e10 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f825c01a040 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f825c0041f0 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f827f23c740 10 client.26350 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55990799ec70 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.512+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264009e10 con 0x5599075db070 2024-08-31T04:33:31.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f825c0048c0 con 0x5599075db070 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 10 client.26350 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 10 client.26350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 20 client.26350 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5599075999f0 0x5599079a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 4 client.26350 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599078f95d0 con 0x5599075999f0 2024-08-31T04:33:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827259c640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5599075999f0 0x5599079a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f827259c640 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5599075999f0 0x5599079a21a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd566971f2f2a05b server_cookie=b1e393d1e06ff45d in_seq=0 out_seq=0 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.513+0000 7f8259ffb640 10 client.26350 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.514+0000 7f8259ffb640 1 -- 172.21.15.2:0/3214905989 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599078f95d0 con 0x5599075999f0 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.514+0000 7f8259ffb640 10 client.26350 handle_command_reply: tid=0 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.514+0000 7f827f23c740 1 client.26350 shutdown 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 msgr2=0x55990799c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990799c180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f825c00f7b0 tx=0x7f825c0096c0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 shutdown_connections 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5599075999f0 0x5599079a21a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x5599079903d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f8259ffb640 0 client.26350 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990799c180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 --2- 172.21.15.2:0/3214905989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 >> 172.21.15.2:0/3214905989 conn(0x5599075cf460 msgr2=0x559907981d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 shutdown_connections 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 1 -- 172.21.15.2:0/3214905989 wait complete. 2024-08-31T04:33:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.515+0000 7f827f23c740 20 client.26350 trim_cache size 0 max 16384 2024-08-31T04:33:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 Processor -- start 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 -- start start 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990798fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82741b16a0 con 0x5599075ba390 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82741aef70 con 0x5599075b21b0 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827f23c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82741acdc0 con 0x5599075db070 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41744/0 (socket says 172.21.15.2:41744) 2024-08-31T04:33:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f827259c640 1 -- 172.21.15.2:0/1224059308 learned_addr learned my addr 172.21.15.2:0/1224059308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.531+0000 7f8271d9b640 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990798fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 -- 172.21.15.2:0/1224059308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 msgr2=0x55990798fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990798fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 -- 172.21.15.2:0/1224059308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 msgr2=0x55990798e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 -- 172.21.15.2:0/1224059308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599079925d0 con 0x5599075ba390 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f8271d9b640 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f827259c640 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f826401afa0 tx=0x7f8264009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2088a34fd3118826 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f825bfff640 1 -- 172.21.15.2:0/1224059308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264031070 con 0x5599075ba390 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f825bfff640 1 -- 172.21.15.2:0/1224059308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264009930 con 0x5599075ba390 2024-08-31T04:33:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.532+0000 7f825bfff640 1 -- 172.21.15.2:0/1224059308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401e040 con 0x5599075ba390 2024-08-31T04:33:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- 172.21.15.2:0/1224059308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 msgr2=0x55990798ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f826401afa0 tx=0x7f8264009620 comp rx=0 tx=0).stop 2024-08-31T04:33:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- 172.21.15.2:0/1224059308 shutdown_connections 2024-08-31T04:33:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075ba390 0x55990798ec50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075db070 0x55990798fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 --2- 172.21.15.2:0/1224059308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075b21b0 0x55990798e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- 172.21.15.2:0/1224059308 >> 172.21.15.2:0/1224059308 conn(0x5599075cf460 msgr2=0x559907985440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- 172.21.15.2:0/1224059308 shutdown_connections 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- 172.21.15.2:0/1224059308 wait complete. 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.533+0000 7f827f23c740 1 -- start start 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 Processor -- start 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075b21b0 0x5599079987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907993cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82741ad430 con 0x5599075db070 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82741ae8a0 con 0x5599075ba390 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82741adb00 con 0x5599075b21b0 2024-08-31T04:33:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827f23c740 10 client.0 _ll_register_callbacks cb 0x7f825c012a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41754/0 (socket says 172.21.15.2:41754) 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 -- 172.21.15.2:0/2638602222 learned_addr learned my addr 172.21.15.2:0/2638602222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f827259c640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907993cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075b21b0 0x5599079987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 -- 172.21.15.2:0/2638602222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075b21b0 msgr2=0x5599079987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.534+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075b21b0 0x5599079987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8271d9b640 1 -- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 msgr2=0x559907993cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907993cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8271d9b640 1 -- 172.21.15.2:0/2638602222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599079948a0 con 0x5599075db070 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f827259c640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907993cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8271d9b640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f825c00f730 tx=0x7f825c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb2284df621fcd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c011030 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f825c030040 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8264009930 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f825c0111d0 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f827f23c740 10 client.16815 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559907a0c9c0 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.535+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264009930 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f825c012410 con 0x5599075db070 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 10 client.16815 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 20 client.16815 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55990756eda0 0x559907a0f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 4 client.16815 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5599078f5070 con 0x55990756eda0 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827259c640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55990756eda0 0x559907a0f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f827259c640 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55990756eda0 0x559907a0f180 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed4c5996aa271fd server_cookie=65a00ad945d1de36 in_seq=0 out_seq=0 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.536+0000 7f8259ffb640 10 client.16815 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f8259ffb640 1 -- 172.21.15.2:0/2638602222 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5599078f5070 con 0x55990756eda0 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f8259ffb640 10 client.16815 handle_command_reply: tid=0 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 client.16815 shutdown 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 msgr2=0x559907994200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f825c00f730 tx=0x7f825c009e30 comp rx=0 tx=0).stop 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 shutdown_connections 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55990756eda0 0x559907a0f180 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f8259ffb640 0 client.16815 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599075db070 0x559907994200 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599075ba390 0x559907993cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 --2- 172.21.15.2:0/2638602222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5599075b21b0 0x5599079987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 >> 172.21.15.2:0/2638602222 conn(0x5599075cf460 msgr2=0x559907985440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 shutdown_connections 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 1 -- 172.21.15.2:0/2638602222 wait complete. 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.537+0000 7f827f23c740 20 client.16815 trim_cache size 0 max 16384 2024-08-31T04:33:31.544 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 msgr2=0x7f82600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 0x7f82600b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f826c0c8dc0 tx=0x7f826c096ef0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 msgr2=0x7f827419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f826c005cc0 tx=0x7f826c031700 comp rx=0 tx=0).stop 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 shutdown_connections 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8274108a90 0x7f827419fa70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8274108140 0x7f827419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 --2- 172.21.15.2:0/2033985950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8274102800 0x7f827419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 >> 172.21.15.2:0/2033985950 conn(0x7f82740794d0 msgr2=0x7f8274104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 shutdown_connections 2024-08-31T04:33:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:31.538+0000 7f8278cc7640 1 -- 172.21.15.2:0/2033985950 wait complete. 2024-08-31T04:33:31.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 828895 11.33 MB/sec execute 291 sec latency 81.182 ms 2024-08-31T04:33:32.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:32 smithi002 ceph-mon[18656]: pgmap v586: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 235 op/s 2024-08-31T04:33:32.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 831222 11.34 MB/sec execute 292 sec latency 27.512 ms 2024-08-31T04:33:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:32 smithi064 ceph-mon[22007]: pgmap v586: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 235 op/s 2024-08-31T04:33:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:32 smithi132 ceph-mon[22335]: pgmap v586: 129 pgs: 129 active+clean; 494 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 235 op/s 2024-08-31T04:33:33.554 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:33:33.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:33:33.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 833334 11.32 MB/sec execute 293 sec latency 40.401 ms 2024-08-31T04:33:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 -- 172.21.15.2:0/293085080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108170 msgr2=0x7f51e0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 --2- 172.21.15.2:0/293085080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108170 0x7f51e0108580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009900 tx=0x7f51d002a410 comp rx=0 tx=0).stop 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 -- 172.21.15.2:0/293085080 shutdown_connections 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 --2- 172.21.15.2:0/293085080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108170 0x7f51e0108580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 --2- 172.21.15.2:0/293085080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0108ac0 0x7f51e010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 --2- 172.21.15.2:0/293085080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0102880 0x7f51e0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 -- 172.21.15.2:0/293085080 >> 172.21.15.2:0/293085080 conn(0x7f51e0079530 msgr2=0x7f51e0079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 -- 172.21.15.2:0/293085080 shutdown_connections 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.332+0000 7f51e829a640 1 -- 172.21.15.2:0/293085080 wait complete. 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 Processor -- start 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 -- start start 2024-08-31T04:33:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0102880 0x7f51e019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0108170 0x7f51e019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0112750 con 0x7f51e0108ac0 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01125d0 con 0x7f51e0108170 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e829a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01128d0 con 0x7f51e0102880 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e5835640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0108170 0x7f51e019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41776/0 (socket says 172.21.15.2:41776) 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.333+0000 7f51e6837640 1 -- 172.21.15.2:0/1081277764 learned_addr learned my addr 172.21.15.2:0/1081277764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6036640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0102880 0x7f51e019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 -- 172.21.15.2:0/1081277764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0102880 msgr2=0x7f51e019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0102880 0x7f51e019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 -- 172.21.15.2:0/1081277764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0108170 msgr2=0x7f51e019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0108170 0x7f51e019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 -- 172.21.15.2:0/1081277764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e01a0240 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e6837640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51d800e970 tx=0x7f51d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51d77fe640 1 -- 172.21.15.2:0/1081277764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d800ccc0 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51d77fe640 1 -- 172.21.15.2:0/1081277764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d800ce60 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e01a0530 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51d77fe640 1 -- 172.21.15.2:0/1081277764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8010430 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.334+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e01a6c90 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 Processor -- start 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51d77fe640 1 -- 172.21.15.2:0/1081277764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f51d8004f70 con 0x7f51e0108ac0 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 -- start start 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146727acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146727b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614671f05f0 con 0x561466ed4350 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5614671dfb80 con 0x561466eab490 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.337+0000 7f51ee80f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5614671e3b30 con 0x561466eb3670 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41792/0 (socket says 172.21.15.2:41792) 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 -- 172.21.15.2:0/705276978 learned_addr learned my addr 172.21.15.2:0/705276978 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e6036640 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146727acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146727b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 -- 172.21.15.2:0/705276978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 msgr2=0x56146727b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146727b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 -- 172.21.15.2:0/705276978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 msgr2=0x56146727acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146727acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 -- 172.21.15.2:0/705276978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561466f3f930 con 0x561466ed4350 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51d77fe640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 0x7f51cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e5835640 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009900 tx=0x7f51d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fa406c934f7444 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51e6036640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 0x7f51cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51d77fe640 1 -- 172.21.15.2:0/1081277764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f51d80e5da0 con 0x7f51e0108ac0 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.338+0000 7f51d4d9a640 1 -- 172.21.15.2:0/705276978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0044020 con 0x561466ed4350 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51d4d9a640 1 -- 172.21.15.2:0/705276978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d0031d10 con 0x561466ed4350 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51d4d9a640 1 -- 172.21.15.2:0/705276978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0035040 con 0x561466ed4350 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 -- 172.21.15.2:0/705276978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 msgr2=0x56146727a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51e6036640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 0x7f51cc0b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005fd0 tx=0x7f51dc009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009900 tx=0x7f51d0000bc0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 -- 172.21.15.2:0/705276978 shutdown_connections 2024-08-31T04:33:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146727b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146727acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.339+0000 7f51ee80f740 1 --2- 172.21.15.2:0/705276978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146727a780 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- 172.21.15.2:0/705276978 >> 172.21.15.2:0/705276978 conn(0x561466ec8740 msgr2=0x561467278670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- 172.21.15.2:0/705276978 shutdown_connections 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- 172.21.15.2:0/705276978 wait complete. 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- start start 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 Processor -- start 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146728a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561467042890 con 0x561466ed4350 2024-08-31T04:33:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561467166790 con 0x561466eab490 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56146728d230 con 0x561466eb3670 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.340+0000 7f51ee80f740 10 client.0 _ll_register_callbacks cb 0x561466eebba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6036640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41808/0 (socket says 172.21.15.2:41808) 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6036640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51830/0 (socket says 172.21.15.2:51830) 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6036640 1 -- 172.21.15.2:0/902808040 learned_addr learned my addr 172.21.15.2:0/902808040 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e5835640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146728a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 -- 172.21.15.2:0/902808040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 msgr2=0x56146728a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146728a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 -- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 msgr2=0x56146728a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 -- 172.21.15.2:0/902808040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146719df30 con 0x561466ed4350 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6036640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e5835640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146728a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51e6837640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f51d80e3080 tx=0x7f51d8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef86111cd7c1ce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.341+0000 7f51c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d80ac020 con 0x561466ed4350 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d0031d10 con 0x561466ed4350 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f51d80b4eb0 con 0x561466ed4350 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51d80b0890 con 0x561466ed4350 2024-08-31T04:33:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51ee80f740 10 client.16827 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561467299100 con 0x561466ed4350 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.345+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d806ae50 con 0x561466ed4350 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f51d80b03e0 con 0x561466ed4350 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 10 client.16827 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 20 client.16827 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e92cd0 0x56146729c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 4 client.16827 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614671f2540 con 0x561466e92cd0 2024-08-31T04:33:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51e6036640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e92cd0 0x56146729c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51e6036640 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e92cd0 0x56146729c5a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962658aa86774658 server_cookie=ba70a3ed88780d1 in_seq=0 out_seq=0 2024-08-31T04:33:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.346+0000 7f51c9ffb640 10 client.16827 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.347+0000 7f51c9ffb640 1 -- 172.21.15.2:0/902808040 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614671f2540 con 0x561466e92cd0 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.347+0000 7f51c9ffb640 10 client.16827 handle_command_reply: tid=0 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.347+0000 7f51ee80f740 1 client.16827 shutdown 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 msgr2=0x5614672965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f51d80e3080 tx=0x7f51d8005720 comp rx=0 tx=0).stop 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 shutdown_connections 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e92cd0 0x56146729c5a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x5614672965c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x56146728a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 --2- 172.21.15.2:0/902808040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eab490 0x56146728a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51c9ffb640 0 client.16827 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 >> 172.21.15.2:0/902808040 conn(0x561466ec8740 msgr2=0x56146727d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 shutdown_connections 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 1 -- 172.21.15.2:0/902808040 wait complete. 2024-08-31T04:33:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.348+0000 7f51ee80f740 20 client.16827 trim_cache size 0 max 16384 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 Processor -- start 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 -- start start 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x5614672964c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466ed4350 0x561467296a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b1600 con 0x561466eab490 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01aeed0 con 0x561466ed4350 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51ee80f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01acd20 con 0x561466eb3670 2024-08-31T04:33:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51e6036640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51e6036640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41822/0 (socket says 172.21.15.2:41822) 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51e6036640 1 -- 172.21.15.2:0/2456761130 learned_addr learned my addr 172.21.15.2:0/2456761130 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.369+0000 7f51e6837640 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466ed4350 0x561467296a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e5835640 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x5614672964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 -- 172.21.15.2:0/2456761130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 msgr2=0x5614672964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x5614672964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 -- 172.21.15.2:0/2456761130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466ed4350 msgr2=0x561467296a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466ed4350 0x561467296a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 -- 172.21.15.2:0/2456761130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467288800 con 0x561466eab490 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51e6036640 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009fd0 tx=0x7f51dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26de1bece4bc905 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51cbfff640 1 -- 172.21.15.2:0/2456761130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc035070 con 0x561466eab490 2024-08-31T04:33:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51cbfff640 1 -- 172.21.15.2:0/2456761130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc01ce30 con 0x561466eab490 2024-08-31T04:33:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.370+0000 7f51cbfff640 1 -- 172.21.15.2:0/2456761130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc030d40 con 0x561466eab490 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 -- 172.21.15.2:0/2456761130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 msgr2=0x56146728a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009fd0 tx=0x7f51dc019000 comp rx=0 tx=0).stop 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 -- 172.21.15.2:0/2456761130 shutdown_connections 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466ed4350 0x561467296a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eb3670 0x5614672964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 --2- 172.21.15.2:0/2456761130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466eab490 0x56146728a8e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 -- 172.21.15.2:0/2456761130 >> 172.21.15.2:0/2456761130 conn(0x561466ec8740 msgr2=0x561467288b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 -- 172.21.15.2:0/2456761130 shutdown_connections 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.371+0000 7f51ee80f740 1 -- 172.21.15.2:0/2456761130 wait complete. 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 -- start start 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 Processor -- start 2024-08-31T04:33:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 0x56146728e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ad390 con 0x561466ed4350 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ae800 con 0x561466eb3670 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ada60 con 0x561466eab490 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51ee80f740 10 client.0 _ll_register_callbacks cb 0x7f51d80a7ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51846/0 (socket says 172.21.15.2:51846) 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e6837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41836/0 (socket says 172.21.15.2:41836) 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 -- 172.21.15.2:0/1885974626 learned_addr learned my addr 172.21.15.2:0/1885974626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e6036640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 0x56146728e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 -- 172.21.15.2:0/1885974626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 msgr2=0x56146728e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 0x56146728e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 -- 172.21.15.2:0/1885974626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 msgr2=0x56146728f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e5835640 1 -- 172.21.15.2:0/1885974626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561467306190 con 0x561466eb3670 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e6036640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 0x56146728e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.372+0000 7f51e6837640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51e5835640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009900 tx=0x7f51d00043c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd6da2f9dc1ae05b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d004d020 con 0x561466eb3670 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc01ce30 con 0x561466eb3670 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7f51d00318b0 con 0x561466eb3670 2024-08-31T04:33:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51d0058050 con 0x561466eb3670 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51ee80f740 10 client.26555 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561467307450 con 0x561466eb3670 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.373+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc01ce30 con 0x561466eb3670 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f51d003a3f0 con 0x561466eb3670 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 10 client.26555 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 10 client.26555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 20 client.26555 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e68080 0x561467309730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 4 client.26555 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5614671edfe0 con 0x561466e68080 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51e6036640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e68080 0x561467309730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51c9ffb640 10 client.26555 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.374+0000 7f51e6036640 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e68080 0x561467309730 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d7a2f5b8b8e247c server_cookie=87acda0bab8d4089 in_seq=0 out_seq=0 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51c9ffb640 1 -- 172.21.15.2:0/1885974626 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5614671edfe0 con 0x561466e68080 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51c9ffb640 10 client.26555 handle_command_reply: tid=0 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 client.26555 shutdown 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 msgr2=0x56146728ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009900 tx=0x7f51d00043c0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 shutdown_connections 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x561466e68080 0x561467309730 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561466ed4350 0x56146728f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561466eb3670 0x56146728ec70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51c9ffb640 0 client.26555 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 --2- 172.21.15.2:0/1885974626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561466eab490 0x56146728e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 >> 172.21.15.2:0/1885974626 conn(0x561466ec8740 msgr2=0x56146728b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 shutdown_connections 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 1 -- 172.21.15.2:0/1885974626 wait complete. 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.377+0000 7f51ee80f740 20 client.26555 trim_cache size 0 max 16384 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "04849146-1ea3-4a8d-b037-ce03f237fdd7", 2024-08-31T04:33:34.383 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:33:34.384 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:33:34.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 msgr2=0x7f51cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 0x7f51cc0b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005fd0 tx=0x7f51dc009500 comp rx=0 tx=0).stop 2024-08-31T04:33:34.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 msgr2=0x7f51e019fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51d800e970 tx=0x7f51d800ed70 comp rx=0 tx=0).stop 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 shutdown_connections 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f51cc0b4ca0 0x7f51cc0b71b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0108ac0 0x7f51e019fb10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0108170 0x7f51e019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 --2- 172.21.15.2:0/1081277764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51e0102880 0x7f51e019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 >> 172.21.15.2:0/1081277764 conn(0x7f51e0079530 msgr2=0x7f51e0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 shutdown_connections 2024-08-31T04:33:34.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:34.378+0000 7f51e829a640 1 -- 172.21.15.2:0/1081277764 wait complete. 2024-08-31T04:33:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:34 smithi002 ceph-mon[18656]: pgmap v587: 129 pgs: 129 active+clean; 498 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T04:33:34.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 834985 11.32 MB/sec execute 294 sec latency 62.400 ms 2024-08-31T04:33:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:34 smithi064 ceph-mon[22007]: pgmap v587: 129 pgs: 129 active+clean; 498 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T04:33:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:34 smithi132 ceph-mon[22335]: pgmap v587: 129 pgs: 129 active+clean; 498 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T04:33:35.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:33:35.493 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:33:35.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:33:35.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:33:35.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:33:35.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:35 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 836953 11.31 MB/sec execute 295 sec latency 143.615 ms 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:35 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:35.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:35 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 -- 172.21.15.2:0/2803562540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108180 msgr2=0x7ff0e4108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2803562540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108180 0x7ff0e4108590 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009900 tx=0x7ff0d002a410 comp rx=0 tx=0).stop 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 -- 172.21.15.2:0/2803562540 shutdown_connections 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2803562540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108180 0x7ff0e4108590 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2803562540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4108ad0 0x7ff0e410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2803562540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4102840 0x7ff0e4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 -- 172.21.15.2:0/2803562540 >> 172.21.15.2:0/2803562540 conn(0x7ff0e4079580 msgr2=0x7ff0e4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 -- 172.21.15.2:0/2803562540 shutdown_connections 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.998+0000 7ff0eab34640 1 -- 172.21.15.2:0/2803562540 wait complete. 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 Processor -- start 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 -- start start 2024-08-31T04:33:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 0x7ff0e41102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108ad0 0x7ff0e4110810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4113860 con 0x7ff0e4108ad0 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41136e0 con 0x7ff0e4102840 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0eab34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41139e0 con 0x7ff0e4108180 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0e88d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0e88d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48528/0 (socket says 172.21.15.2:48528) 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0e88d0640 1 -- 172.21.15.2:0/2236364722 learned_addr learned my addr 172.21.15.2:0/2236364722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108ad0 0x7ff0e4110810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:35.999+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 0x7ff0e41102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 -- 172.21.15.2:0/2236364722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 msgr2=0x7ff0e41102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 0x7ff0e41102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 -- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108ad0 msgr2=0x7ff0e4110810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108ad0 0x7ff0e4110810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 -- 172.21.15.2:0/2236364722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e41a8550 con 0x7ff0e4102840 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 0x7ff0e41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e9f0 tx=0x7ff0d800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e1ffb640 1 -- 172.21.15.2:0/2236364722 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800cd80 con 0x7ff0e4102840 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e41a8840 con 0x7ff0e4102840 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e1ffb640 1 -- 172.21.15.2:0/2236364722 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0d80054d0 con 0x7ff0e4102840 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0e1ffb640 1 -- 172.21.15.2:0/2236364722 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8010690 con 0x7ff0e4102840 2024-08-31T04:33:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.000+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e41a8d00 con 0x7ff0e4102840 2024-08-31T04:33:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 Processor -- start 2024-08-31T04:33:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 -- start start 2024-08-31T04:33:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0e1ffb640 1 -- 172.21.15.2:0/2236364722 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff0d8004e90 con 0x7ff0e4102840 2024-08-31T04:33:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56119b949630 con 0x56119b6041b0 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56119b938bc0 con 0x56119b62d070 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.003+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56119b93cb70 con 0x56119b60c390 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e88d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48538/0 (socket says 172.21.15.2:48538) 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 -- 172.21.15.2:0/3107031039 learned_addr learned my addr 172.21.15.2:0/3107031039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 -- 172.21.15.2:0/3107031039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 msgr2=0x56119b9d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 -- 172.21.15.2:0/3107031039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 msgr2=0x56119b9d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 -- 172.21.15.2:0/3107031039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119b698650 con 0x56119b62d070 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e1ffb640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 0x7ff0d40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009f50 tx=0x7ff0dc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295a7617be94d702 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 0x7ff0d40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0e1ffb640 1 -- 172.21.15.2:0/2236364722 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7ff0d80e5e40 con 0x7ff0e4102840 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0ceffd640 1 -- 172.21.15.2:0/3107031039 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004d20 con 0x56119b62d070 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.004+0000 7ff0ceffd640 1 -- 172.21.15.2:0/3107031039 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0dc004050 con 0x56119b62d070 2024-08-31T04:33:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0ceffd640 1 -- 172.21.15.2:0/3107031039 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc005280 con 0x56119b62d070 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3107031039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 msgr2=0x56119b9d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009f50 tx=0x7ff0dc0118d0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0e88d0640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 0x7ff0d40b71b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x56119b9d0f40 tx=0x7ff0d80e98f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3107031039 shutdown_connections 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3107031039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9d22c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.005+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3107031039 >> 172.21.15.2:0/3107031039 conn(0x56119b621460 msgr2=0x56119b9d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.006+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3107031039 shutdown_connections 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.006+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3107031039 wait complete. 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.006+0000 7ff0f10a9740 1 -- start start 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.006+0000 7ff0f10a9740 1 Processor -- start 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9e7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56119b79b700 con 0x56119b6041b0 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56119b8bf700 con 0x56119b62d070 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56119b9e0af0 con 0x56119b60c390 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0f10a9740 10 client.0 _ll_register_callbacks cb 0x56119b8eedc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40464/0 (socket says 172.21.15.2:40464) 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 -- 172.21.15.2:0/4207959887 learned_addr learned my addr 172.21.15.2:0/4207959887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 -- 172.21.15.2:0/4207959887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 msgr2=0x56119b9e7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9e7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 -- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 msgr2=0x56119b9ec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9ec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.007+0000 7ff0e90d1640 1 -- 172.21.15.2:0/4207959887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119b8f88b0 con 0x56119b6041b0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc003fd0 tx=0x7ff0dc0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb4403c1cfcfbeb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc02c020 con 0x56119b6041b0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0dc004050 con 0x56119b6041b0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7ff0dc027440 con 0x56119b6041b0 2024-08-31T04:33:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0dc0044f0 con 0x56119b6041b0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0f10a9740 10 client.16845 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56119b9f4fe0 con 0x56119b6041b0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.008+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0dc004050 con 0x56119b6041b0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff0dc00f610 con 0x56119b6041b0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 10 client.16845 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 20 client.16845 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5eb9f0 0x56119b9f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 4 client.16845 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56119b94b580 con 0x56119b5eb9f0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.009+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5eb9f0 0x56119b9f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.010+0000 7ff0c3fff640 10 client.16845 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.010+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5eb9f0 0x56119b9f83a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d9feab9c5581c57 server_cookie=cb443e92adc26ed6 in_seq=0 out_seq=0 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0c3fff640 1 -- 172.21.15.2:0/4207959887 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56119b94b580 con 0x56119b5eb9f0 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0c3fff640 10 client.16845 handle_command_reply: tid=0 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 client.16845 shutdown 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 msgr2=0x56119b9e6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc003fd0 tx=0x7ff0dc0096c0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 shutdown_connections 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5eb9f0 0x56119b9f83a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9ec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b60c390 0x56119b9e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0c3fff640 0 client.16845 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/4207959887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9e6a90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.011+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 >> 172.21.15.2:0/4207959887 conn(0x56119b621460 msgr2=0x56119b9d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.012+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 shutdown_connections 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.012+0000 7ff0f10a9740 1 -- 172.21.15.2:0/4207959887 wait complete. 2024-08-31T04:33:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.012+0000 7ff0f10a9740 20 client.16845 trim_cache size 0 max 16384 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 Processor -- start 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 -- start start 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 0x56119b9e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b62d070 0x56119b9dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41b16f0 con 0x56119b6041b0 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41aefc0 con 0x56119b60c390 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.031+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41ace10 con 0x56119b62d070 2024-08-31T04:33:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40468/0 (socket says 172.21.15.2:40468) 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 -- 172.21.15.2:0/1956729890 learned_addr learned my addr 172.21.15.2:0/1956729890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 0x56119b9e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b62d070 0x56119b9dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 -- 172.21.15.2:0/1956729890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b62d070 msgr2=0x56119b9dfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b62d070 0x56119b9dfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 -- 172.21.15.2:0/1956729890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 msgr2=0x56119b9e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 0x56119b9e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 -- 172.21.15.2:0/1956729890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119b9d0d70 con 0x56119b6041b0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 0x56119b9e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76d8f3915f85ad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.032+0000 7ff0ce7fc640 1 -- 172.21.15.2:0/1956729890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc02c040 con 0x56119b6041b0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0ce7fc640 1 -- 172.21.15.2:0/1956729890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0dc004890 con 0x56119b6041b0 2024-08-31T04:33:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0ce7fc640 1 -- 172.21.15.2:0/1956729890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc028920 con 0x56119b6041b0 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 -- 172.21.15.2:0/1956729890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 msgr2=0x56119b9d3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc009500 comp rx=0 tx=0).stop 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 -- 172.21.15.2:0/1956729890 shutdown_connections 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b62d070 0x56119b9dfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b60c390 0x56119b9e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/1956729890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b6041b0 0x56119b9d3940 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.033+0000 7ff0f10a9740 1 -- 172.21.15.2:0/1956729890 >> 172.21.15.2:0/1956729890 conn(0x56119b621460 msgr2=0x56119b9e7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- 172.21.15.2:0/1956729890 shutdown_connections 2024-08-31T04:33:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- 172.21.15.2:0/1956729890 wait complete. 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- start start 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 Processor -- start 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b6041b0 0x56119b9f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 0x56119b9ee470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41ad480 con 0x56119b60c390 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41ae8f0 con 0x56119b62d070 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.034+0000 7ff0f10a9740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41adb50 con 0x56119b6041b0 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0f10a9740 10 client.0 _ll_register_callbacks cb 0x7ff0d80e97c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 0x56119b9ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e90d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9eeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48562/0 (socket says 172.21.15.2:48562) 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e90d1640 1 -- 172.21.15.2:0/3062416278 learned_addr learned my addr 172.21.15.2:0/3062416278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b6041b0 0x56119b9f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 -- 172.21.15.2:0/3062416278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b6041b0 msgr2=0x56119b9f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b6041b0 0x56119b9f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 -- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 msgr2=0x56119b9eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 -- 172.21.15.2:0/3062416278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119ba61bd0 con 0x56119b60c390 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0e3fff640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 0x56119b9ee470 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0006010 tx=0x7ff0d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8478699403a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0035040 con 0x56119b60c390 2024-08-31T04:33:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9664+0+0 (secure 0 0 0) 0x7ff0d0005240 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.035+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0dc004890 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0d0056050 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 10 client.16851 fetch_fsmap learned FSMap version 30 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56119ba62d70 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0dc004890 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff0d0031640 con 0x56119b60c390 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 10 client.16851 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 20 client.16851 populate_metadata read hostname 'smithi002' 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5c0da0 0x56119ba65580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 4 client.16851 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:33:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56119b947020 con 0x56119b5c0da0 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.036+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5c0da0 0x56119ba65580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0c3fff640 10 client.16851 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0e90d1640 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5c0da0 0x56119ba65580 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8af9686bccc6940 server_cookie=abd25f3ed18f82a6 in_seq=0 out_seq=0 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0c3fff640 1 -- 172.21.15.2:0/3062416278 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x56119b947020 con 0x56119b5c0da0 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0c3fff640 10 client.16851 handle_command_reply: tid=0 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 client.16851 shutdown 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 msgr2=0x56119b9ee470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 0x56119b9ee470 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0006010 tx=0x7ff0d0000bc0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 shutdown_connections 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x56119b5c0da0 0x56119ba65580 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56119b60c390 0x56119b9ee470 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56119b62d070 0x56119b9eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 --2- 172.21.15.2:0/3062416278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56119b6041b0 0x56119b9f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 >> 172.21.15.2:0/3062416278 conn(0x56119b621460 msgr2=0x56119b9eb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.037+0000 7ff0c3fff640 0 client.16851 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 shutdown_connections 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0f10a9740 1 -- 172.21.15.2:0/3062416278 wait complete. 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0f10a9740 20 client.16851 trim_cache size 0 max 16384 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:33:36.048 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "04849146-1ea3-4a8d-b037-ce03f237fdd7", 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:33:36.049 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.050 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.051 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.052 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.053 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.054 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.055 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.056 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:33:36.057 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 msgr2=0x7ff0d40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 0x7ff0d40b71b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x56119b9d0f40 tx=0x7ff0d80e98f0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 msgr2=0x7ff0e410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.038+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e9f0 tx=0x7ff0d800edf0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 shutdown_connections 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0d40b4ca0 0x7ff0d40b71b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e4108ad0 0x7ff0e4110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e4108180 0x7ff0e41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 --2- 172.21.15.2:0/2236364722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0e4102840 0x7ff0e410fd90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:36.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 >> 172.21.15.2:0/2236364722 conn(0x7ff0e4079580 msgr2=0x7ff0e41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:36.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 shutdown_connections 2024-08-31T04:33:36.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:33:36.039+0000 7ff0eab34640 1 -- 172.21.15.2:0/2236364722 wait complete. 2024-08-31T04:33:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:36 smithi002 ceph-mon[18656]: pgmap v588: 129 pgs: 129 active+clean; 502 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 239 op/s 2024-08-31T04:33:36.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 838583 11.31 MB/sec execute 296 sec latency 59.308 ms 2024-08-31T04:33:36.707 INFO:tasks.cephfs.filesystem:scrub status for tag:04849146-1ea3-4a8d-b037-ce03f237fdd7 - {'path': '/', 'tag': '04849146-1ea3-4a8d-b037-ce03f237fdd7', 'options': 'recursive,force'} 2024-08-31T04:33:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:36 smithi064 ceph-mon[22007]: pgmap v588: 129 pgs: 129 active+clean; 502 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 239 op/s 2024-08-31T04:33:36.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:36 smithi132 ceph-mon[22335]: pgmap v588: 129 pgs: 129 active+clean; 502 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 239 op/s 2024-08-31T04:33:37.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 840666 11.31 MB/sec execute 297 sec latency 103.053 ms 2024-08-31T04:33:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:38 smithi002 ceph-mon[18656]: pgmap v589: 129 pgs: 129 active+clean; 508 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T04:33:38.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 842261 11.30 MB/sec execute 298 sec latency 88.992 ms 2024-08-31T04:33:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:38 smithi064 ceph-mon[22007]: pgmap v589: 129 pgs: 129 active+clean; 508 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T04:33:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:38 smithi132 ceph-mon[22335]: pgmap v589: 129 pgs: 129 active+clean; 508 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T04:33:39.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 843294 11.28 MB/sec execute 299 sec latency 45.025 ms 2024-08-31T04:33:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:40 smithi002 ceph-mon[18656]: pgmap v590: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T04:33:40.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 845453 11.29 MB/sec execute 300 sec latency 14.665 ms 2024-08-31T04:33:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:40 smithi064 ceph-mon[22007]: pgmap v590: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T04:33:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:40 smithi132 ceph-mon[22335]: pgmap v590: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T04:33:41.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 846828 11.27 MB/sec execute 301 sec latency 65.697 ms 2024-08-31T04:33:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:42 smithi002 ceph-mon[18656]: pgmap v591: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:33:42.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 849089 11.28 MB/sec execute 302 sec latency 28.365 ms 2024-08-31T04:33:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:42 smithi064 ceph-mon[22007]: pgmap v591: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:33:42.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:42 smithi132 ceph-mon[22335]: pgmap v591: 129 pgs: 129 active+clean; 513 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:33:43.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:43 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:33:43.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:43 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:33:43.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 850971 11.26 MB/sec execute 303 sec latency 74.222 ms 2024-08-31T04:33:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:43 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:33:43.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:43 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:33:43.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:43 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:33:43.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:43 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:33:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:44 smithi002 ceph-mon[18656]: pgmap v592: 129 pgs: 129 active+clean; 516 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 232 op/s 2024-08-31T04:33:44.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 852918 11.27 MB/sec execute 304 sec latency 28.064 ms 2024-08-31T04:33:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:44 smithi064 ceph-mon[22007]: pgmap v592: 129 pgs: 129 active+clean; 516 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 232 op/s 2024-08-31T04:33:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:44 smithi132 ceph-mon[22335]: pgmap v592: 129 pgs: 129 active+clean; 516 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 232 op/s 2024-08-31T04:33:45.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 855473 11.28 MB/sec execute 305 sec latency 19.466 ms 2024-08-31T04:33:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:46 smithi002 ceph-mon[18656]: pgmap v593: 129 pgs: 129 active+clean; 521 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-08-31T04:33:46.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 856236 11.26 MB/sec execute 306 sec latency 88.652 ms 2024-08-31T04:33:46.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:46 smithi064 ceph-mon[22007]: pgmap v593: 129 pgs: 129 active+clean; 521 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-08-31T04:33:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:46 smithi132 ceph-mon[22335]: pgmap v593: 129 pgs: 129 active+clean; 521 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-08-31T04:33:47.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 857570 11.24 MB/sec execute 307 sec latency 74.618 ms 2024-08-31T04:33:48.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:48 smithi132 ceph-mon[22335]: pgmap v594: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 258 op/s 2024-08-31T04:33:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:48 smithi002 ceph-mon[18656]: pgmap v594: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 258 op/s 2024-08-31T04:33:48.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 859402 11.24 MB/sec execute 308 sec latency 41.701 ms 2024-08-31T04:33:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:48 smithi064 ceph-mon[22007]: pgmap v594: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.6 MiB/s wr, 258 op/s 2024-08-31T04:33:49.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 861097 11.23 MB/sec execute 309 sec latency 42.673 ms 2024-08-31T04:33:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:50 smithi002 ceph-mon[18656]: pgmap v595: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 208 op/s 2024-08-31T04:33:50.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 863000 11.23 MB/sec execute 310 sec latency 21.748 ms 2024-08-31T04:33:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:50 smithi064 ceph-mon[22007]: pgmap v595: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 208 op/s 2024-08-31T04:33:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:50 smithi132 ceph-mon[22335]: pgmap v595: 129 pgs: 129 active+clean; 528 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 208 op/s 2024-08-31T04:33:51.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 864263 11.21 MB/sec execute 311 sec latency 75.625 ms 2024-08-31T04:33:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:52 smithi002 ceph-mon[18656]: pgmap v596: 129 pgs: 129 active+clean; 532 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:33:52.683 INFO:tasks.workunit.client.0.smithi002.stdout: 1 866386 11.22 MB/sec execute 312 sec latency 64.592 ms 2024-08-31T04:33:52.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:52 smithi064 ceph-mon[22007]: pgmap v596: 129 pgs: 129 active+clean; 532 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:33:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:52 smithi132 ceph-mon[22335]: pgmap v596: 129 pgs: 129 active+clean; 532 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:33:53.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 867749 11.20 MB/sec execute 313 sec latency 80.696 ms 2024-08-31T04:33:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:54 smithi002 ceph-mon[18656]: pgmap v597: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:33:54.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 869908 11.21 MB/sec execute 314 sec latency 16.590 ms 2024-08-31T04:33:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:54 smithi064 ceph-mon[22007]: pgmap v597: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:33:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:54 smithi132 ceph-mon[22335]: pgmap v597: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T04:33:55.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 871245 11.19 MB/sec execute 315 sec latency 28.144 ms 2024-08-31T04:33:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:56 smithi002 ceph-mon[18656]: pgmap v598: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 217 op/s 2024-08-31T04:33:56.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 873336 11.20 MB/sec execute 316 sec latency 60.840 ms 2024-08-31T04:33:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:56 smithi064 ceph-mon[22007]: pgmap v598: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 217 op/s 2024-08-31T04:33:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:56 smithi132 ceph-mon[22335]: pgmap v598: 129 pgs: 129 active+clean; 538 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 217 op/s 2024-08-31T04:33:57.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 874443 11.17 MB/sec execute 317 sec latency 30.561 ms 2024-08-31T04:33:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:33:58 smithi002 ceph-mon[18656]: pgmap v599: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 253 op/s 2024-08-31T04:33:58.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 876653 11.18 MB/sec execute 318 sec latency 162.686 ms 2024-08-31T04:33:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:33:58 smithi064 ceph-mon[22007]: pgmap v599: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 253 op/s 2024-08-31T04:33:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:33:58 smithi132 ceph-mon[22335]: pgmap v599: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 253 op/s 2024-08-31T04:33:59.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 877728 11.16 MB/sec execute 319 sec latency 30.782 ms 2024-08-31T04:34:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:00 smithi002 ceph-mon[18656]: pgmap v600: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 184 op/s 2024-08-31T04:34:00.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 880160 11.16 MB/sec execute 320 sec latency 46.271 ms 2024-08-31T04:34:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:00 smithi064 ceph-mon[22007]: pgmap v600: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 184 op/s 2024-08-31T04:34:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:00 smithi132 ceph-mon[22335]: pgmap v600: 129 pgs: 129 active+clean; 544 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 184 op/s 2024-08-31T04:34:01.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 880303 11.13 MB/sec execute 321 sec latency 135.832 ms 2024-08-31T04:34:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:02 smithi002 ceph-mon[18656]: pgmap v601: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 190 op/s 2024-08-31T04:34:02.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 881298 11.11 MB/sec execute 322 sec latency 42.907 ms 2024-08-31T04:34:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:02 smithi064 ceph-mon[22007]: pgmap v601: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 190 op/s 2024-08-31T04:34:02.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:02 smithi132 ceph-mon[22335]: pgmap v601: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 190 op/s 2024-08-31T04:34:03.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 883498 11.12 MB/sec execute 323 sec latency 27.161 ms 2024-08-31T04:34:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:04 smithi002 ceph-mon[18656]: pgmap v602: 129 pgs: 129 active+clean; 547 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T04:34:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:04 smithi002 ceph-mon[18656]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T04:34:04.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:04 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:04.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 884321 11.10 MB/sec execute 324 sec latency 213.629 ms 2024-08-31T04:34:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:04 smithi064 ceph-mon[22007]: pgmap v602: 129 pgs: 129 active+clean; 547 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T04:34:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:04 smithi064 ceph-mon[22007]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T04:34:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:04 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:04 smithi132 ceph-mon[22335]: pgmap v602: 129 pgs: 129 active+clean; 547 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T04:34:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:04 smithi132 ceph-mon[22335]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T04:34:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:04 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:05.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 885843 11.08 MB/sec execute 325 sec latency 51.234 ms 2024-08-31T04:34:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:06 smithi002 ceph-mon[18656]: pgmap v604: 129 pgs: 129 active+clean; 535 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2024-08-31T04:34:06.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 887636 11.09 MB/sec execute 326 sec latency 191.251 ms 2024-08-31T04:34:06.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:34:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:06 smithi064 ceph-mon[22007]: pgmap v604: 129 pgs: 129 active+clean; 535 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2024-08-31T04:34:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:06 smithi132 ceph-mon[22335]: pgmap v604: 129 pgs: 129 active+clean; 535 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2024-08-31T04:34:06.972 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 -- 172.21.15.2:0/2226173374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2564102cc0 msgr2=0x7f256410f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 --2- 172.21.15.2:0/2226173374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2564102cc0 0x7f256410f9e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2554009900 tx=0x7f255402a480 comp rx=0 tx=0).stop 2024-08-31T04:34:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 -- 172.21.15.2:0/2226173374 shutdown_connections 2024-08-31T04:34:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 --2- 172.21.15.2:0/2226173374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2564102cc0 0x7f256410f9e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 --2- 172.21.15.2:0/2226173374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f256410ff20 0x7f2564112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 --2- 172.21.15.2:0/2226173374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102370 0x7f2564102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 -- 172.21.15.2:0/2226173374 >> 172.21.15.2:0/2226173374 conn(0x7f25640794d0 msgr2=0x7f25640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.568+0000 7f256b836640 1 -- 172.21.15.2:0/2226173374 shutdown_connections 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.569+0000 7f256b836640 1 -- 172.21.15.2:0/2226173374 wait complete. 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.569+0000 7f256b836640 1 Processor -- start 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.569+0000 7f256b836640 1 -- start start 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 0x7f256419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 0x7f25641a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25641159d0 con 0x7f256410ff20 2024-08-31T04:34:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2564115850 con 0x7f2564102cc0 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f256b836640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2564115b50 con 0x7f2564102370 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43630/0 (socket says 172.21.15.2:43630) 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 -- 172.21.15.2:0/4224574896 learned_addr learned my addr 172.21.15.2:0/4224574896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f25695d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 0x7f256419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2569dd3640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 0x7f25641a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 -- 172.21.15.2:0/4224574896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 msgr2=0x7f256419c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 0x7f256419c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 -- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 msgr2=0x7f25641a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 0x7f25641a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2568dd1640 1 -- 172.21.15.2:0/4224574896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25641a2370 con 0x7f2564102cc0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f2569dd3640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 0x7f25641a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.570+0000 7f25695d2640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 0x7f256419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f2568dd1640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2554005940 tx=0x7f25540040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f255a7fc640 1 -- 172.21.15.2:0/4224574896 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255403f030 con 0x7f2564102cc0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25641a2600 con 0x7f2564102cc0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f255a7fc640 1 -- 172.21.15.2:0/4224574896 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25540044c0 con 0x7f2564102cc0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f255a7fc640 1 -- 172.21.15.2:0/4224574896 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554035070 con 0x7f2564102cc0 2024-08-31T04:34:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.571+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25641a8dc0 con 0x7f2564102cc0 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f255a7fc640 1 -- 172.21.15.2:0/4224574896 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2554042030 con 0x7f2564102cc0 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 Processor -- start 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 -- start start 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9709800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9343390 0x55cfb9709d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.574+0000 7f2571dab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cfb9680630 con 0x55cfb9364070 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2571dab740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfb966fbc0 con 0x55cfb9343390 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2571dab740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfb9673b70 con 0x55cfb933b1b0 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39260/0 (socket says 172.21.15.2:39260) 2024-08-31T04:34:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 -- 172.21.15.2:0/672527957 learned_addr learned my addr 172.21.15.2:0/672527957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2568dd1640 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9343390 0x55cfb9709d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 -- 172.21.15.2:0/672527957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 msgr2=0x55cfb9709800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9709800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 -- 172.21.15.2:0/672527957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9343390 msgr2=0x55cfb9709d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9343390 0x55cfb9709d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 -- 172.21.15.2:0/672527957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb93cf650 con 0x55cfb9364070 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f255a7fc640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 0x7f25500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f255a7fc640 1 -- 172.21.15.2:0/4224574896 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7f2554105da0 con 0x7f2564102cc0 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f2569dd3640 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f255c0117e0 tx=0x7f255c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7899bb1587653cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.575+0000 7f25695d2640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 0x7f25500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.576+0000 7f254f7fe640 1 -- 172.21.15.2:0/672527957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c011310 con 0x55cfb9364070 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.576+0000 7f254f7fe640 1 -- 172.21.15.2:0/672527957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c003e20 con 0x55cfb9364070 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.576+0000 7f254f7fe640 1 -- 172.21.15.2:0/672527957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0044f0 con 0x55cfb9364070 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 -- 172.21.15.2:0/672527957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 msgr2=0x55cfb97092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f255c0117e0 tx=0x7f255c011ca0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f25695d2640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 0x7f25500b71b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2560009730 tx=0x7f25600096c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 -- 172.21.15.2:0/672527957 shutdown_connections 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9343390 0x55cfb9709d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9709800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 --2- 172.21.15.2:0/672527957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9364070 0x55cfb97092c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 -- 172.21.15.2:0/672527957 >> 172.21.15.2:0/672527957 conn(0x55cfb9358460 msgr2=0x55cfb97071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 -- 172.21.15.2:0/672527957 shutdown_connections 2024-08-31T04:34:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.577+0000 7f2571dab740 1 -- 172.21.15.2:0/672527957 wait complete. 2024-08-31T04:34:07.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 -- start start 2024-08-31T04:34:07.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 Processor -- start 2024-08-31T04:34:07.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9714a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb9714f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cfb94d2700 con 0x55cfb9343390 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfb95f6700 con 0x55cfb9364070 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfb9717aa0 con 0x55cfb933b1b0 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2571dab740 10 client.0 _ll_register_callbacks cb 0x55cfb9625dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2569dd3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f25695d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9714a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2569dd3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43646/0 (socket says 172.21.15.2:43646) 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.578+0000 7f2569dd3640 1 -- 172.21.15.2:0/3985999893 learned_addr learned my addr 172.21.15.2:0/3985999893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb9714f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 -- 172.21.15.2:0/3985999893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 msgr2=0x55cfb9714a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9714a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 -- 172.21.15.2:0/3985999893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 msgr2=0x55cfb9714f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb9714f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 -- 172.21.15.2:0/3985999893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb962f8b0 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb9714f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2569dd3640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f255c011500 tx=0x7f255c011530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47712c7410778569 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f254cff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c02a060 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7f255c00f9a0 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.579+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c003e20 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f255c031050 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 10 client.26585 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cfb9723840 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c003e20 con 0x55cfb9364070 2024-08-31T04:34:07.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f255c018020 con 0x55cfb9364070 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 10 client.26585 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 10 client.26585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 20 client.26585 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb93229f0 0x55cfb9726ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 4 client.26585 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfb9682580 con 0x55cfb93229f0 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.580+0000 7f25695d2640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb93229f0 0x55cfb9726ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.581+0000 7f254cff9640 10 client.26585 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.581+0000 7f25695d2640 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb93229f0 0x55cfb9726ba0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb7c48d96b43ca1 server_cookie=780d1a04e81bd7d5 in_seq=0 out_seq=0 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f254cff9640 1 -- 172.21.15.2:0/3985999893 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfb9682580 con 0x55cfb93229f0 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f254cff9640 10 client.26585 handle_command_reply: tid=0 2024-08-31T04:34:07.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 client.26585 shutdown 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 msgr2=0x55cfb9720dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f255c011500 tx=0x7f255c011530 comp rx=0 tx=0).stop 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 shutdown_connections 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb93229f0 0x55cfb9726ba0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb9714f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f254cff9640 0 client.26585 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb9364070 0x55cfb9720dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 --2- 172.21.15.2:0/3985999893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9714a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 >> 172.21.15.2:0/3985999893 conn(0x55cfb9358460 msgr2=0x55cfb970c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 shutdown_connections 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 1 -- 172.21.15.2:0/3985999893 wait complete. 2024-08-31T04:34:07.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.583+0000 7f2571dab740 20 client.26585 trim_cache size 0 max 16384 2024-08-31T04:34:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.602+0000 7f2571dab740 1 Processor -- start 2024-08-31T04:34:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.602+0000 7f2571dab740 1 -- start start 2024-08-31T04:34:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb970cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb9343390 0x55cfb97147f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b5b70 con 0x55cfb933b1b0 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b3440 con 0x55cfb93229f0 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2571dab740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b12b0 con 0x55cfb9343390 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39282/0 (socket says 172.21.15.2:39282) 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 -- 172.21.15.2:0/1547284307 learned_addr learned my addr 172.21.15.2:0/1547284307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f25695d2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb970cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2569dd3640 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb9343390 0x55cfb97147f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 -- 172.21.15.2:0/1547284307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb9343390 msgr2=0x55cfb97147f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb9343390 0x55cfb97147f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 -- 172.21.15.2:0/1547284307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 msgr2=0x55cfb970cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb970cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f2568dd1640 1 -- 172.21.15.2:0/1547284307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb970d010 con 0x55cfb933b1b0 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.603+0000 7f25695d2640 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb970cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.604+0000 7f2568dd1640 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25540c8240 tx=0x7f2554005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819e2f5869f607ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.604+0000 7f254effd640 1 -- 172.21.15.2:0/1547284307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554049040 con 0x55cfb933b1b0 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.604+0000 7f254effd640 1 -- 172.21.15.2:0/1547284307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25540cbcd0 con 0x55cfb933b1b0 2024-08-31T04:34:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.604+0000 7f254effd640 1 -- 172.21.15.2:0/1547284307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540d3bb0 con 0x55cfb933b1b0 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- 172.21.15.2:0/1547284307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 msgr2=0x55cfb9720cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25540c8240 tx=0x7f2554005eb0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- 172.21.15.2:0/1547284307 shutdown_connections 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb933b1b0 0x55cfb9720cc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb9343390 0x55cfb97147f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 --2- 172.21.15.2:0/1547284307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb970cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- 172.21.15.2:0/1547284307 >> 172.21.15.2:0/1547284307 conn(0x55cfb9358460 msgr2=0x55cfb970c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- 172.21.15.2:0/1547284307 shutdown_connections 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- 172.21.15.2:0/1547284307 wait complete. 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.605+0000 7f2571dab740 1 -- start start 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.606+0000 7f2571dab740 1 Processor -- start 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.607+0000 7f2571dab740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb9718f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.607+0000 7f2571dab740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9719460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.607+0000 7f2571dab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb97199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f25695d2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb9718f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f25695d2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb9718f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43672/0 (socket says 172.21.15.2:43672) 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f25695d2640 1 -- 172.21.15.2:0/3783867232 learned_addr learned my addr 172.21.15.2:0/3783867232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b1900 con 0x55cfb9343390 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b2d70 con 0x55cfb93229f0 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b1fd0 con 0x55cfb933b1b0 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9719460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2571dab740 10 client.0 _ll_register_callbacks cb 0x7f25541097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2569dd3640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb97199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 -- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 msgr2=0x55cfb9718f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb9718f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 -- 172.21.15.2:0/3783867232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 msgr2=0x55cfb97199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb97199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb97906a0 con 0x55cfb933b1b0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2568dd1640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9719460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f25540c8240 tx=0x7f2554103550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7448a1bec7fff74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f254cff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540cbf90 con 0x55cfb933b1b0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7f25540d3dc0 con 0x55cfb933b1b0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.608+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25540cbcd0 con 0x55cfb933b1b0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f25540cb930 con 0x55cfb933b1b0 2024-08-31T04:34:07.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 10 client.26407 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:07.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cfb9791910 con 0x55cfb933b1b0 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25540cbcd0 con 0x55cfb933b1b0 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f25540caf20 con 0x55cfb933b1b0 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 10 client.26407 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 10 client.26407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 20 client.26407 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb9364070 0x55cfb9794000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 4 client.26407 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cfb967e020 con 0x55cfb9364070 2024-08-31T04:34:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.609+0000 7f25695d2640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb9364070 0x55cfb9794000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.610+0000 7f254cff9640 10 client.26407 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:07.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.610+0000 7f25695d2640 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb9364070 0x55cfb9794000 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b8e144b0baf45b server_cookie=16aab2b966ccef06 in_seq=0 out_seq=0 2024-08-31T04:34:07.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f254cff9640 1 -- 172.21.15.2:0/3783867232 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55cfb967e020 con 0x55cfb9364070 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f254cff9640 10 client.26407 handle_command_reply: tid=0 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 client.26407 shutdown 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 msgr2=0x55cfb9719460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9719460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f25540c8240 tx=0x7f2554103550 comp rx=0 tx=0).stop 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 shutdown_connections 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55cfb9364070 0x55cfb9794000 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfb9343390 0x55cfb97199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfb933b1b0 0x55cfb9719460 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 --2- 172.21.15.2:0/3783867232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfb93229f0 0x55cfb9718f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f254cff9640 0 client.26407 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.617+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 >> 172.21.15.2:0/3783867232 conn(0x55cfb9358460 msgr2=0x55cfb97147f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.618+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 shutdown_connections 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.618+0000 7f2571dab740 1 -- 172.21.15.2:0/3783867232 wait complete. 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.618+0000 7f2571dab740 20 client.26407 trim_cache size 0 max 16384 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:34:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:34:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:34:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:07.629 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 msgr2=0x7f25500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 0x7f25500b71b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2560009730 tx=0x7f25600096c0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 msgr2=0x7f256419c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2554005940 tx=0x7f25540040c0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 shutdown_connections 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25500b4ca0 0x7f25500b71b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256410ff20 0x7f25641a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2564102cc0 0x7f256419c9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 --2- 172.21.15.2:0/4224574896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2564102370 0x7f256419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 >> 172.21.15.2:0/4224574896 conn(0x7f25640794d0 msgr2=0x7f25641113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.619+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 shutdown_connections 2024-08-31T04:34:07.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:07.620+0000 7f256b836640 1 -- 172.21.15.2:0/4224574896 wait complete. 2024-08-31T04:34:07.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 888721 11.06 MB/sec execute 327 sec latency 30.636 ms 2024-08-31T04:34:08.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:08 smithi002 ceph-mon[18656]: pgmap v605: 129 pgs: 129 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 225 op/s 2024-08-31T04:34:08.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:08 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:08.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:08 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:08.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:08 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:34:08.496 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:34:08.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:34:08.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 891074 11.08 MB/sec execute 328 sec latency 17.466 ms 2024-08-31T04:34:08.777 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:08 smithi064 ceph-mon[22007]: pgmap v605: 129 pgs: 129 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 225 op/s 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:08 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:08 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:08 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:08 smithi132 ceph-mon[22335]: pgmap v605: 129 pgs: 129 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 225 op/s 2024-08-31T04:34:08.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:08 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:08 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:08.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:08 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.433+0000 7f9d5c993640 1 -- 172.21.15.2:0/4088166646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d58108b40 msgr2=0x7f9d5810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.433+0000 7f9d5c993640 1 --2- 172.21.15.2:0/4088166646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d58108b40 0x7f9d5810f370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009ca0 tx=0x7f9d5002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 -- 172.21.15.2:0/4088166646 shutdown_connections 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 --2- 172.21.15.2:0/4088166646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d58108b40 0x7f9d5810f370 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 --2- 172.21.15.2:0/4088166646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581081f0 0x7f9d58108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 --2- 172.21.15.2:0/4088166646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d581028b0 0x7f9d58102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 -- 172.21.15.2:0/4088166646 >> 172.21.15.2:0/4088166646 conn(0x7f9d58079470 msgr2=0x7f9d58079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 -- 172.21.15.2:0/4088166646 shutdown_connections 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.434+0000 7f9d5c993640 1 -- 172.21.15.2:0/4088166646 wait complete. 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 Processor -- start 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 -- start start 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d58108b40 0x7f9d5819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58112860 con 0x7f9d581081f0 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581126e0 con 0x7f9d581028b0 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5c993640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581129e0 con 0x7f9d58108b40 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d5659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.435+0000 7f9d55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d5659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43680/0 (socket says 172.21.15.2:43680) 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d5659c640 1 -- 172.21.15.2:0/1440004791 learned_addr learned my addr 172.21.15.2:0/1440004791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39318/0 (socket says 172.21.15.2:39318) 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d56d9d640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d58108b40 0x7f9d5819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 -- 172.21.15.2:0/1440004791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d58108b40 msgr2=0x7f9d5819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d58108b40 0x7f9d5819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 -- 172.21.15.2:0/1440004791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 msgr2=0x7f9d5819aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 -- 172.21.15.2:0/1440004791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d581a6300 con 0x7f9d581081f0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d5659c640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d55d9b640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806b790 tx=0x7f9d4c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00cc40 con 0x7f9d581081f0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d4c00cde0 con 0x7f9d581081f0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d581a65f0 con 0x7f9d581081f0 2024-08-31T04:34:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c018780 con 0x7f9d581081f0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.436+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581a6b80 con 0x7f9d581081f0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.437+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d58102cc0 con 0x7f9d581081f0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.439+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9d4c010a90 con 0x7f9d581081f0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.440+0000 7f9d477fe640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.440+0000 7f9d5659c640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.440+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7f9d4c0e61a0 con 0x7f9d581081f0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.440+0000 7f9d5659c640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 0x7f9d400b7230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806c4c0 tx=0x7f9d4800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.443+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9d4c0ac410 con 0x7f9d581081f0 2024-08-31T04:34:09.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 891922 11.05 MB/sec execute 329 sec latency 29.231 ms 2024-08-31T04:34:09.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.716+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d5806bd70 con 0x7f9d581081f0 2024-08-31T04:34:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.716+0000 7f9d477fe640 1 -- 172.21.15.2:0/1440004791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11897 (secure 0 0 0) 0x7f9d4c0b0bd0 con 0x7f9d581081f0 2024-08-31T04:34:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:34:09.718 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"btime":"2024-08-31T04:32:19:298680+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:32:18.727298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:34:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-08-31T04:34:09.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.719+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 msgr2=0x7f9d400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:09.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 0x7f9d400b7230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806c4c0 tx=0x7f9d4800b410 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 msgr2=0x7f9d5819b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806b790 tx=0x7f9d4c00ee50 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 shutdown_connections 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d581081f0 0x7f9d5819b530 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d58108b40 0x7f9d5819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 --2- 172.21.15.2:0/1440004791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d581028b0 0x7f9d5819aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 >> 172.21.15.2:0/1440004791 conn(0x7f9d58079470 msgr2=0x7f9d581040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 shutdown_connections 2024-08-31T04:34:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:09.720+0000 7f9d5c993640 1 -- 172.21.15.2:0/1440004791 wait complete. 2024-08-31T04:34:10.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:34:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:10 smithi002 ceph-mon[18656]: pgmap v606: 129 pgs: 129 active+clean; 519 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2024-08-31T04:34:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:10 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1440004791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:10.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 894002 11.05 MB/sec execute 330 sec latency 120.487 ms 2024-08-31T04:34:10.713 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:10 smithi064 ceph-mon[22007]: pgmap v606: 129 pgs: 129 active+clean; 519 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2024-08-31T04:34:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:10 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1440004791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:10 smithi132 ceph-mon[22335]: pgmap v606: 129 pgs: 129 active+clean; 519 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2024-08-31T04:34:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:10 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1440004791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:11.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 -- 172.21.15.2:0/2489535832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 msgr2=0x7fa874102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 --2- 172.21.15.2:0/2489535832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa874102c90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa864009ca0 tx=0x7fa86402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 -- 172.21.15.2:0/2489535832 shutdown_connections 2024-08-31T04:34:11.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 --2- 172.21.15.2:0/2489535832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108ac0 0x7fa87410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 --2- 172.21.15.2:0/2489535832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108170 0x7fa874108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 --2- 172.21.15.2:0/2489535832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa874102c90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 -- 172.21.15.2:0/2489535832 >> 172.21.15.2:0/2489535832 conn(0x7fa874079530 msgr2=0x7fa874079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 -- 172.21.15.2:0/2489535832 shutdown_connections 2024-08-31T04:34:11.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.242+0000 7fa87c59a640 1 -- 172.21.15.2:0/2489535832 wait complete. 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 Processor -- start 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 -- start start 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108170 0x7fa87419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108ac0 0x7fa87419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741127b0 con 0x7fa874102880 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa874112630 con 0x7fa874108170 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.243+0000 7fa87c59a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa874112930 con 0x7fa874108ac0 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39336/0 (socket says 172.21.15.2:39336) 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 -- 172.21.15.2:0/1262101389 learned_addr learned my addr 172.21.15.2:0/1262101389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa879b35640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108170 0x7fa87419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87ab37640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108ac0 0x7fa87419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 -- 172.21.15.2:0/1262101389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108ac0 msgr2=0x7fa87419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108ac0 0x7fa87419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 -- 172.21.15.2:0/1262101389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108170 msgr2=0x7fa87419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108170 0x7fa87419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 -- 172.21.15.2:0/1262101389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8741a6350 con 0x7fa874102880 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87a336640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa86402ade0 tx=0x7fa864031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa8737fe640 1 -- 172.21.15.2:0/1262101389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864003b70 con 0x7fa874102880 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa8737fe640 1 -- 172.21.15.2:0/1262101389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa864003d10 con 0x7fa874102880 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8741a65e0 con 0x7fa874102880 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.244+0000 7fa8737fe640 1 -- 172.21.15.2:0/1262101389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86402fa50 con 0x7fa874102880 2024-08-31T04:34:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.245+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741a6b20 con 0x7fa874102880 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.247+0000 7fa882b0f740 1 Processor -- start 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.247+0000 7fa8737fe640 1 -- 172.21.15.2:0/1262101389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa864004580 con 0x7fa874102880 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 -- start start 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc254350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc254dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fbc1cb680 con 0x556fbbe861b0 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556fbc1bac10 con 0x556fbbeaf070 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa882b0f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556fbc1bebc0 con 0x556fbbe8e390 2024-08-31T04:34:11.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39344/0 (socket says 172.21.15.2:39344) 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa87a336640 1 -- 172.21.15.2:0/907708957 learned_addr learned my addr 172.21.15.2:0/907708957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa87ab37640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc254350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.248+0000 7fa879b35640 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc254dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa8737fe640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 0x7fa85c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 -- 172.21.15.2:0/907708957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 msgr2=0x556fbc254350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc254350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 -- 172.21.15.2:0/907708957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 msgr2=0x556fbc254890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 -- 172.21.15.2:0/907708957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fbbf1a650 con 0x556fbbe8e390 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa87a336640 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa87ab37640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 0x7fa85c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa8737fe640 1 -- 172.21.15.2:0/1262101389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7fa864106c60 con 0x7fa874102880 2024-08-31T04:34:11.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa879b35640 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc254dd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8680058c0 tx=0x7fa86800f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ebd22664b630c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa870ff9640 1 -- 172.21.15.2:0/907708957 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86801d070 con 0x556fbbe8e390 2024-08-31T04:34:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa870ff9640 1 -- 172.21.15.2:0/907708957 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8680188f0 con 0x556fbbe8e390 2024-08-31T04:34:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.249+0000 7fa870ff9640 1 -- 172.21.15.2:0/907708957 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868010910 con 0x556fbbe8e390 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 -- 172.21.15.2:0/907708957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 msgr2=0x556fbc254dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa87ab37640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 0x7fa85c0b71b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa87406c6a0 tx=0x7fa86c0046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc254dd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8680058c0 tx=0x7fa86800f3c0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 -- 172.21.15.2:0/907708957 shutdown_connections 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc254890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc254dd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 --2- 172.21.15.2:0/907708957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc254350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 -- 172.21.15.2:0/907708957 >> 172.21.15.2:0/907708957 conn(0x556fbbea3460 msgr2=0x556fbc252240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 -- 172.21.15.2:0/907708957 shutdown_connections 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.250+0000 7fa882b0f740 1 -- 172.21.15.2:0/907708957 wait complete. 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 -- start start 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 Processor -- start 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 0x556fbc25fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc25ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fbc01d700 con 0x556fbbeaf070 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556fbc141750 con 0x556fbbe861b0 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556fbc266f40 con 0x556fbbe8e390 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa882b0f740 10 client.0 _ll_register_callbacks cb 0x556fbc170e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87a336640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 0x556fbc25fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa879b35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc25ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39356/0 (socket says 172.21.15.2:39356) 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 -- 172.21.15.2:0/767187123 learned_addr learned my addr 172.21.15.2:0/767187123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 -- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 msgr2=0x556fbc25ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc25ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 -- 172.21.15.2:0/767187123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 msgr2=0x556fbc25fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.251+0000 7fa87ab37640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 0x556fbc25fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa87ab37640 1 -- 172.21.15.2:0/767187123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fbc17a900 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa87a336640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 0x556fbc25fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa87ab37640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0106e0 tx=0x7fa86c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cf2500d9d09bac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c02e060 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7fa86c01d8c0 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8680188f0 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa86c01dac0 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa882b0f740 10 client.16887 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fbc272d40 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.252+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8680188f0 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa86c01b3d0 con 0x556fbbeaf070 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 10 client.16887 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 10 client.16887 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 20 client.16887 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe6d9f0 0x556fbc276210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 4 client.16887 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fbc1cd5d0 con 0x556fbbe6d9f0 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa87a336640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe6d9f0 0x556fbc276210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa87a336640 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe6d9f0 0x556fbc276210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1641d1e31d6e2d19 server_cookie=196c1240a694e585 in_seq=0 out_seq=0 2024-08-31T04:34:11.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.253+0000 7fa859ffb640 10 client.16887 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa859ffb640 1 -- 172.21.15.2:0/767187123 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556fbc1cd5d0 con 0x556fbbe6d9f0 2024-08-31T04:34:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa859ffb640 10 client.16887 handle_command_reply: tid=0 2024-08-31T04:34:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 client.16887 shutdown 2024-08-31T04:34:11.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 msgr2=0x556fbc270290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0106e0 tx=0x7fa86c004730 comp rx=0 tx=0).stop 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 shutdown_connections 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe6d9f0 0x556fbc276210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbeaf070 0x556fbc270290 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc25ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa859ffb640 0 client.16887 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 --2- 172.21.15.2:0/767187123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbe861b0 0x556fbc25fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.254+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 >> 172.21.15.2:0/767187123 conn(0x556fbbea3460 msgr2=0x556fbc2574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.255+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 shutdown_connections 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.255+0000 7fa882b0f740 1 -- 172.21.15.2:0/767187123 wait complete. 2024-08-31T04:34:11.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.255+0000 7fa882b0f740 20 client.16887 trim_cache size 0 max 16384 2024-08-31T04:34:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 Processor -- start 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 -- start start 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc251810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc251d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741b1790 con 0x556fbbe861b0 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741af060 con 0x556fbbeaf070 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa882b0f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741aced0 con 0x556fbbe8e390 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39368/0 (socket says 172.21.15.2:39368) 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa87a336640 1 -- 172.21.15.2:0/983220426 learned_addr learned my addr 172.21.15.2:0/983220426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa879b35640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc251810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.268+0000 7fa87ab37640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc251d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 -- 172.21.15.2:0/983220426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 msgr2=0x556fbc251810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc251810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 -- 172.21.15.2:0/983220426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 msgr2=0x556fbc251d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc251d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 -- 172.21.15.2:0/983220426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fbc261e60 con 0x556fbbe861b0 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa879b35640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc251810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa87a336640 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa86402f550 tx=0x7fa86410a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c4bc669747d4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa85bfff640 1 -- 172.21.15.2:0/983220426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640ccc50 con 0x556fbbe861b0 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa85bfff640 1 -- 172.21.15.2:0/983220426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa864036030 con 0x556fbbe861b0 2024-08-31T04:34:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.269+0000 7fa85bfff640 1 -- 172.21.15.2:0/983220426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640cc5f0 con 0x556fbbe861b0 2024-08-31T04:34:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- 172.21.15.2:0/983220426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 msgr2=0x556fbc260fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa86402f550 tx=0x7fa86410a7b0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- 172.21.15.2:0/983220426 shutdown_connections 2024-08-31T04:34:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc251d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc251810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 --2- 172.21.15.2:0/983220426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc260fb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- 172.21.15.2:0/983220426 >> 172.21.15.2:0/983220426 conn(0x556fbbea3460 msgr2=0x556fbc255d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- 172.21.15.2:0/983220426 shutdown_connections 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- 172.21.15.2:0/983220426 wait complete. 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 -- start start 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.270+0000 7fa882b0f740 1 Processor -- start 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc268a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc2dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ad520 con 0x556fbbe861b0 2024-08-31T04:34:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ae990 con 0x556fbbeaf070 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741adbf0 con 0x556fbbe8e390 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39378/0 (socket says 172.21.15.2:39378) 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 -- 172.21.15.2:0/521486107 learned_addr learned my addr 172.21.15.2:0/521486107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa882b0f740 10 client.0 _ll_register_callbacks cb 0x7fa86c009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87ab37640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc2dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa879b35640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc268a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 -- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 msgr2=0x556fbc268a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc268a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 -- 172.21.15.2:0/521486107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 msgr2=0x556fbc2dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc2dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 -- 172.21.15.2:0/521486107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fbc269350 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87ab37640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc2dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa879b35640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc268a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa87a336640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa864004af0 tx=0x7fa8640cc700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd8cfc6c93bc8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.271+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640e7060 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9752+0+0 (secure 0 0 0) 0x7fa8640c9110 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa864036030 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa8640cc7d0 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 10 client.16893 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fbc2e11c0 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa864036030 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa8640d1020 con 0x556fbbe861b0 2024-08-31T04:34:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 10 client.16893 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 10 client.16893 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 20 client.16893 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe42da0 0x556fbc2e3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 4 client.16893 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fbc1c9070 con 0x556fbbe42da0 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.272+0000 7fa879b35640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe42da0 0x556fbc2e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa879b35640 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe42da0 0x556fbc2e3970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=471b8696a3d53a8a server_cookie=18e7840c2b7eec50 in_seq=0 out_seq=0 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa859ffb640 10 client.16893 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa859ffb640 1 -- 172.21.15.2:0/521486107 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fbc1c9070 con 0x556fbbe42da0 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa859ffb640 10 client.16893 handle_command_reply: tid=0 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 client.16893 shutdown 2024-08-31T04:34:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 msgr2=0x556fbc268520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa864004af0 tx=0x7fa8640cc700 comp rx=0 tx=0).stop 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 shutdown_connections 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x556fbbe42da0 0x556fbc2e3970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fbbeaf070 0x556fbc2dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fbbe8e390 0x556fbc268a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa859ffb640 0 client.16893 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 --2- 172.21.15.2:0/521486107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fbbe861b0 0x556fbc268520 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 >> 172.21.15.2:0/521486107 conn(0x556fbbea3460 msgr2=0x556fbc255b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 shutdown_connections 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 1 -- 172.21.15.2:0/521486107 wait complete. 2024-08-31T04:34:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.273+0000 7fa882b0f740 20 client.16893 trim_cache size 0 max 16384 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 msgr2=0x7fa85c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 0x7fa85c0b71b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa87406c6a0 tx=0x7fa86c0046c0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 msgr2=0x7fa87419b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa86402ade0 tx=0x7fa864031770 comp rx=0 tx=0).stop 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 shutdown_connections 2024-08-31T04:34:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa874108ac0 0x7fa87419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa874108170 0x7fa87419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fa85c0b4ca0 0x7fa85c0b71b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 --2- 172.21.15.2:0/1262101389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa874102880 0x7fa87419b040 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 >> 172.21.15.2:0/1262101389 conn(0x7fa874079530 msgr2=0x7fa874106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 shutdown_connections 2024-08-31T04:34:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:11.274+0000 7fa87c59a640 1 -- 172.21.15.2:0/1262101389 wait complete. 2024-08-31T04:34:11.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 895041 11.04 MB/sec execute 331 sec latency 51.030 ms 2024-08-31T04:34:11.972 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:34:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:12.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:12 smithi002 ceph-mon[18656]: pgmap v607: 129 pgs: 129 active+clean; 524 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-08-31T04:34:12.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:12 smithi002 ceph-mon[18656]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T04:34:12.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 896636 11.02 MB/sec execute 332 sec latency 79.592 ms 2024-08-31T04:34:12.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 -- 172.21.15.2:0/3961033905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc841045e0 msgr2=0x7efc841049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 --2- 172.21.15.2:0/3961033905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc841045e0 0x7efc841049f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7efc74009ca0 tx=0x7efc7402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 -- 172.21.15.2:0/3961033905 shutdown_connections 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 --2- 172.21.15.2:0/3961033905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc8410db90 0x7efc841100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 --2- 172.21.15.2:0/3961033905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc84105010 0x7efc8410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 --2- 172.21.15.2:0/3961033905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc841045e0 0x7efc841049f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 -- 172.21.15.2:0/3961033905 >> 172.21.15.2:0/3961033905 conn(0x7efc840794d0 msgr2=0x7efc840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 -- 172.21.15.2:0/3961033905 shutdown_connections 2024-08-31T04:34:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.793+0000 7efc8c590640 1 -- 172.21.15.2:0/3961033905 wait complete. 2024-08-31T04:34:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.794+0000 7efc8c590640 1 Processor -- start 2024-08-31T04:34:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.794+0000 7efc8c590640 1 -- start start 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc84105010 0x7efc8419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc8410db90 0x7efc8419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc84113830 con 0x7efc8410db90 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc841136b0 con 0x7efc841045e0 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8c590640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efc841139b0 con 0x7efc84105010 2024-08-31T04:34:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43756/0 (socket says 172.21.15.2:43756) 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8a32c640 1 -- 172.21.15.2:0/3749849345 learned_addr learned my addr 172.21.15.2:0/3749849345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc89b2b640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc84105010 0x7efc8419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.795+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc8410db90 0x7efc8419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 -- 172.21.15.2:0/3749849345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc84105010 msgr2=0x7efc8419a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc84105010 0x7efc8419a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 -- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc8410db90 msgr2=0x7efc8419fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc8410db90 0x7efc8419fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 -- 172.21.15.2:0/3749849345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc841a0250 con 0x7efc841045e0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8a32c640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc74033040 tx=0x7efc740316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc837fe640 1 -- 172.21.15.2:0/3749849345 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74003b70 con 0x7efc841045e0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc841a04e0 con 0x7efc841045e0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc837fe640 1 -- 172.21.15.2:0/3749849345 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc74003d10 con 0x7efc841045e0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc837fe640 1 -- 172.21.15.2:0/3749849345 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7402fa80 con 0x7efc841045e0 2024-08-31T04:34:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.796+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc841023d0 con 0x7efc841045e0 2024-08-31T04:34:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 Processor -- start 2024-08-31T04:34:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 -- start start 2024-08-31T04:34:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c499310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0cb1b0 0x563f9c499850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563f9c410680 con 0x563f9c0f4070 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563f9c3ffc10 con 0x563f9c0d3390 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.799+0000 7efc92b05740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563f9c403bc0 con 0x563f9c0cb1b0 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc837fe640 1 -- 172.21.15.2:0/3749849345 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7efc7402fc20 con 0x7efc841045e0 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43762/0 (socket says 172.21.15.2:43762) 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 -- 172.21.15.2:0/1579358059 learned_addr learned my addr 172.21.15.2:0/1579358059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c499310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc8a32c640 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0cb1b0 0x563f9c499850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 -- 172.21.15.2:0/1579358059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0cb1b0 msgr2=0x563f9c499850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0cb1b0 0x563f9c499850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 -- 172.21.15.2:0/1579358059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 msgr2=0x563f9c499310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c499310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 -- 172.21.15.2:0/1579358059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9c15f650 con 0x563f9c0d3390 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc89b2b640 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc78010bc0 tx=0x7efc78005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e24c253ce114733f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.800+0000 7efc80ff9640 1 -- 172.21.15.2:0/1579358059 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78004250 con 0x563f9c0d3390 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc837fe640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 0x7efc6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc80ff9640 1 -- 172.21.15.2:0/1579358059 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc780043f0 con 0x563f9c0d3390 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc80ff9640 1 -- 172.21.15.2:0/1579358059 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7801a940 con 0x563f9c0d3390 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc837fe640 1 -- 172.21.15.2:0/3749849345 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7efc74106d30 con 0x7efc841045e0 2024-08-31T04:34:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 0x7efc6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc92b05740 1 -- 172.21.15.2:0/1579358059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 msgr2=0x563f9c499d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc78010bc0 tx=0x7efc78005f90 comp rx=0 tx=0).stop 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.801+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 0x7efc6c0b71b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d20 tx=0x7efc7c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 -- 172.21.15.2:0/1579358059 shutdown_connections 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c499d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0cb1b0 0x563f9c499850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 --2- 172.21.15.2:0/1579358059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c499310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 -- 172.21.15.2:0/1579358059 >> 172.21.15.2:0/1579358059 conn(0x563f9c0e8460 msgr2=0x563f9c497200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 -- 172.21.15.2:0/1579358059 shutdown_connections 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 -- 172.21.15.2:0/1579358059 wait complete. 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 -- start start 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 Processor -- start 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.802+0000 7efc92b05740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 0x563f9c4b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563f9c262700 con 0x563f9c0cb1b0 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563f9c386750 con 0x563f9c0f4070 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563f9c4a7af0 con 0x563f9c0d3390 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc92b05740 10 client.0 _ll_register_callbacks cb 0x563f9c3b5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39418/0 (socket says 172.21.15.2:39418) 2024-08-31T04:34:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 -- 172.21.15.2:0/449142149 learned_addr learned my addr 172.21.15.2:0/449142149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc89b2b640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 -- 172.21.15.2:0/449142149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 msgr2=0x563f9c4a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 -- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 msgr2=0x563f9c4b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 0x563f9c4b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 0x563f9c4b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 -- 172.21.15.2:0/449142149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9c3bf900 con 0x563f9c0cb1b0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 0x563f9c4b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc8a32c640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efc74042000 tx=0x7efc7402ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d0685213a2d4fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.803+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc740cc720 con 0x563f9c0cb1b0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7efc740d6050 con 0x563f9c0cb1b0 2024-08-31T04:34:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc780043f0 con 0x563f9c0cb1b0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efc740098d0 con 0x563f9c0cb1b0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 10 client.16905 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f9c4b3830 con 0x563f9c0cb1b0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc780043f0 con 0x563f9c0cb1b0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efc740d1470 con 0x563f9c0cb1b0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 10 client.16905 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 10 client.16905 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 20 client.16905 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.804+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c0b29f0 0x563f9c4b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.805+0000 7efc92b05740 4 client.16905 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.805+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f9c4125d0 con 0x563f9c0b29f0 2024-08-31T04:34:12.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.805+0000 7efc89b2b640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c0b29f0 0x563f9c4b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.805+0000 7efc89b2b640 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c0b29f0 0x563f9c4b6c40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=614900a67a70ce04 server_cookie=38ca83948bdfc3fa in_seq=0 out_seq=0 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.805+0000 7efc69ffb640 10 client.16905 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc69ffb640 1 -- 172.21.15.2:0/449142149 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f9c4125d0 con 0x563f9c0b29f0 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc69ffb640 10 client.16905 handle_command_reply: tid=0 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 client.16905 shutdown 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 msgr2=0x563f9c4a4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efc74042000 tx=0x7efc7402ffd0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 shutdown_connections 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0f4070 0x563f9c4b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c0b29f0 0x563f9c4b6c40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc69ffb640 0 client.16905 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:12.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 --2- 172.21.15.2:0/449142149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4a4aa0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.806+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 >> 172.21.15.2:0/449142149 conn(0x563f9c0e8460 msgr2=0x563f9c49c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.807+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 shutdown_connections 2024-08-31T04:34:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.807+0000 7efc92b05740 1 -- 172.21.15.2:0/449142149 wait complete. 2024-08-31T04:34:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.807+0000 7efc92b05740 20 client.16905 trim_cache size 0 max 16384 2024-08-31T04:34:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:12 smithi064 ceph-mon[22007]: pgmap v607: 129 pgs: 129 active+clean; 524 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-08-31T04:34:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:12 smithi064 ceph-mon[22007]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T04:34:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:12 smithi132 ceph-mon[22335]: pgmap v607: 129 pgs: 129 active+clean; 524 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-08-31T04:34:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:12 smithi132 ceph-mon[22335]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.820+0000 7efc92b05740 1 Processor -- start 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.820+0000 7efc92b05740 1 -- start start 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0cb1b0 0x563f9c49ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc841b16c0 con 0x563f9c0f4070 2024-08-31T04:34:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc841aef90 con 0x563f9c0cb1b0 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc92b05740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efc841acde0 con 0x563f9c0d3390 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39420/0 (socket says 172.21.15.2:39420) 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 -- 172.21.15.2:0/3718349598 learned_addr learned my addr 172.21.15.2:0/3718349598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8a32c640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0cb1b0 0x563f9c49ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc89b2b640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 -- 172.21.15.2:0/3718349598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 msgr2=0x563f9c4a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 -- 172.21.15.2:0/3718349598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0cb1b0 msgr2=0x563f9c49ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0cb1b0 0x563f9c49ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc8ab2d640 1 -- 172.21.15.2:0/3718349598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9c4a5d60 con 0x563f9c0f4070 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.821+0000 7efc89b2b640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.822+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0042a0 tx=0x7efc7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e918bda90cd499 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.822+0000 7efc6bfff640 1 -- 172.21.15.2:0/3718349598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0042d0 con 0x563f9c0f4070 2024-08-31T04:34:12.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.822+0000 7efc6bfff640 1 -- 172.21.15.2:0/3718349598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc7c004470 con 0x563f9c0f4070 2024-08-31T04:34:12.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.822+0000 7efc6bfff640 1 -- 172.21.15.2:0/3718349598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c028580 con 0x563f9c0f4070 2024-08-31T04:34:12.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 -- 172.21.15.2:0/3718349598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 msgr2=0x563f9c4b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0042a0 tx=0x7efc7c017000 comp rx=0 tx=0).stop 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 -- 172.21.15.2:0/3718349598 shutdown_connections 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0f4070 0x563f9c4b0d10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0d3390 0x563f9c4a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 --2- 172.21.15.2:0/3718349598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0cb1b0 0x563f9c49ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 -- 172.21.15.2:0/3718349598 >> 172.21.15.2:0/3718349598 conn(0x563f9c0e8460 msgr2=0x563f9c4a5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 -- 172.21.15.2:0/3718349598 shutdown_connections 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.823+0000 7efc92b05740 1 -- 172.21.15.2:0/3718349598 wait complete. 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 -- start start 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 Processor -- start 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c4ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0f4070 0x563f9c4ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc841ad450 con 0x563f9c0cb1b0 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc841ae8c0 con 0x563f9c0d3390 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efc841adb20 con 0x563f9c0f4070 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc8a32c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39432/0 (socket says 172.21.15.2:39432) 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc92b05740 10 client.0 _ll_register_callbacks cb 0x7efc74009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc8a32c640 1 -- 172.21.15.2:0/708109806 learned_addr learned my addr 172.21.15.2:0/708109806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc8ab2d640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0f4070 0x563f9c4ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.824+0000 7efc89b2b640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c4ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 -- 172.21.15.2:0/708109806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0f4070 msgr2=0x563f9c4ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0f4070 0x563f9c4ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 -- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 msgr2=0x563f9c4ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c4ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 -- 172.21.15.2:0/708109806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9c5207e0 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc8a32c640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc7402f550 tx=0x7efc740319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eac107cea2e22d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc740e7030 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7efc740d1470 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc7c004470 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efc740f3070 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc92b05740 10 client.16911 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f9c521a60 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.825+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc7c004470 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efc740cc210 con 0x563f9c0cb1b0 2024-08-31T04:34:12.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 10 client.16911 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 10 client.16911 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 20 client.16911 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c087da0 0x563f9c5240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 4 client.16911 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f9c40e070 con 0x563f9c087da0 2024-08-31T04:34:12.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc89b2b640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c087da0 0x563f9c5240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:12.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc89b2b640 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c087da0 0x563f9c5240b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a417c8d19aac5fd server_cookie=5ec5d5412151913f in_seq=0 out_seq=0 2024-08-31T04:34:12.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.826+0000 7efc69ffb640 10 client.16911 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:12.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc69ffb640 1 -- 172.21.15.2:0/708109806 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f9c40e070 con 0x563f9c087da0 2024-08-31T04:34:12.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc69ffb640 10 client.16911 handle_command_reply: tid=0 2024-08-31T04:34:12.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 client.16911 shutdown 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 msgr2=0x563f9c4aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc7402f550 tx=0x7efc740319a0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 shutdown_connections 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563f9c0f4070 0x563f9c4ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563f9c0d3390 0x563f9c4ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563f9c087da0 0x563f9c5240b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 --2- 172.21.15.2:0/708109806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f9c0cb1b0 0x563f9c4aaf60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 >> 172.21.15.2:0/708109806 conn(0x563f9c0e8460 msgr2=0x563f9c49aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc69ffb640 0 client.16911 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 shutdown_connections 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 1 -- 172.21.15.2:0/708109806 wait complete. 2024-08-31T04:34:12.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.827+0000 7efc92b05740 20 client.16911 trim_cache size 0 max 16384 2024-08-31T04:34:12.834 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:12.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 msgr2=0x7efc6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 0x7efc6c0b71b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d20 tx=0x7efc7c005f90 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 msgr2=0x7efc8419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc74033040 tx=0x7efc740316f0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 shutdown_connections 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7efc6c0b4ca0 0x7efc6c0b71b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc8410db90 0x7efc8419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc84105010 0x7efc8419a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 --2- 172.21.15.2:0/3749849345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc841045e0 0x7efc8419a2e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 >> 172.21.15.2:0/3749849345 conn(0x7efc840794d0 msgr2=0x7efc84106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 shutdown_connections 2024-08-31T04:34:12.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:12.828+0000 7efc8c590640 1 -- 172.21.15.2:0/3749849345 wait complete. 2024-08-31T04:34:13.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:34:13.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 898414 11.03 MB/sec execute 333 sec latency 33.389 ms 2024-08-31T04:34:13.917 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 -- 172.21.15.2:0/3466243444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610102800 msgr2=0x7f6610102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 --2- 172.21.15.2:0/3466243444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610102800 0x7f6610102c10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6600009900 tx=0x7f660002a410 comp rx=0 tx=0).stop 2024-08-31T04:34:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 -- 172.21.15.2:0/3466243444 shutdown_connections 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 --2- 172.21.15.2:0/3466243444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610108a90 0x7f661010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 --2- 172.21.15.2:0/3466243444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f6610108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 --2- 172.21.15.2:0/3466243444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610102800 0x7f6610102c10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 -- 172.21.15.2:0/3466243444 >> 172.21.15.2:0/3466243444 conn(0x7f66100794d0 msgr2=0x7f66100798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 -- 172.21.15.2:0/3466243444 shutdown_connections 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.417+0000 7f661486f640 1 -- 172.21.15.2:0/3466243444 wait complete. 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 Processor -- start 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 -- start start 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 0x7f661019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f661019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 0x7f661019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66101126f0 con 0x7f6610108a90 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6610112570 con 0x7f6610102800 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f661486f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6610112870 con 0x7f6610108140 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.418+0000 7f660e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 0x7f661019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f6607fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f661019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 0x7f661019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 0x7f661019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43804/0 (socket says 172.21.15.2:43804) 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660e59c640 1 -- 172.21.15.2:0/3862960105 learned_addr learned my addr 172.21.15.2:0/3862960105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 -- 172.21.15.2:0/3862960105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 msgr2=0x7f661019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f661019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 -- 172.21.15.2:0/3862960105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 msgr2=0x7f661019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 0x7f661019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 -- 172.21.15.2:0/3862960105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66101a6300 con 0x7f6610108a90 2024-08-31T04:34:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f6607fff640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f661019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f660ed9d640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 0x7f661019bb00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6608009fd0 tx=0x7f660800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f66077fe640 1 -- 172.21.15.2:0/3862960105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660800cd60 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f66077fe640 1 -- 172.21.15.2:0/3862960105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6608005020 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66101a65f0 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f66077fe640 1 -- 172.21.15.2:0/3862960105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608010690 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.419+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66101a6ae0 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.422+0000 7f661ade4740 1 Processor -- start 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.422+0000 7f66077fe640 1 -- 172.21.15.2:0/3862960105 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f66080054d0 con 0x7f6610108a90 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.422+0000 7f661ade4740 1 -- start start 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d308420070 0x55d3087c5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 0x55d3087c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d30873c680 con 0x55d3083f71b0 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d30872bc10 con 0x55d3083ff390 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f661ade4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d30872fbc0 con 0x55d308420070 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39458/0 (socket says 172.21.15.2:39458) 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 -- 172.21.15.2:0/4005636968 learned_addr learned my addr 172.21.15.2:0/4005636968 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f6607fff640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 0x55d3087c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f6607fff640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d308420070 0x55d3087c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f66077fe640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 0x7f65fc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 -- 172.21.15.2:0/4005636968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d308420070 msgr2=0x55d3087c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d308420070 0x55d3087c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 -- 172.21.15.2:0/4005636968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 msgr2=0x55d3087c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 0x55d3087c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660e59c640 1 -- 172.21.15.2:0/4005636968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d30848b650 con 0x55d3083f71b0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f6607fff640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 0x55d3087c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f660ed9d640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 0x7f65fc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.423+0000 7f66077fe640 1 -- 172.21.15.2:0/3862960105 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f66080e6020 con 0x7f6610108a90 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.424+0000 7f660e59c640 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6600000c00 tx=0x7f6600031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135b03352af361d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.424+0000 7f6604ff9640 1 -- 172.21.15.2:0/4005636968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600040070 con 0x55d3083f71b0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.424+0000 7f660ed9d640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 0x7f65fc0b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66080a9510 tx=0x7f66080784a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.424+0000 7f6604ff9640 1 -- 172.21.15.2:0/4005636968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66000316a0 con 0x55d3083f71b0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.424+0000 7f6604ff9640 1 -- 172.21.15.2:0/4005636968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600035040 con 0x55d3083f71b0 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- 172.21.15.2:0/4005636968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 msgr2=0x55d3087c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6600000c00 tx=0x7f6600031cd0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- 172.21.15.2:0/4005636968 shutdown_connections 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083f71b0 0x55d3087c5850 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083ff390 0x55d3087c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 --2- 172.21.15.2:0/4005636968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d308420070 0x55d3087c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- 172.21.15.2:0/4005636968 >> 172.21.15.2:0/4005636968 conn(0x55d308414460 msgr2=0x55d3087c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- 172.21.15.2:0/4005636968 shutdown_connections 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- 172.21.15.2:0/4005636968 wait complete. 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 -- start start 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.425+0000 7f661ade4740 1 Processor -- start 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083ff390 0x55d3087d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d308420070 0x55d3087dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d30858e700 con 0x55d308420070 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d3086b2750 con 0x55d3083f71b0 2024-08-31T04:34:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d3087d3a90 con 0x55d3083ff390 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43828/0 (socket says 172.21.15.2:43828) 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 -- 172.21.15.2:0/3773415307 learned_addr learned my addr 172.21.15.2:0/3773415307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f661ade4740 10 client.0 _ll_register_callbacks cb 0x55d3086e1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d308420070 0x55d3087dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f660e59c640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083ff390 0x55d3087d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 -- 172.21.15.2:0/3773415307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083ff390 msgr2=0x55d3087d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083ff390 0x55d3087d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 -- 172.21.15.2:0/3773415307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d308420070 msgr2=0x55d3087dcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d308420070 0x55d3087dcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.426+0000 7f6607fff640 1 -- 172.21.15.2:0/3773415307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3086eb900 con 0x55d3083f71b0 2024-08-31T04:34:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f6607fff640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65f800f990 tx=0x7f65f8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=667885c2cb4ae313 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f800da10 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66000316a0 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f65f8019030 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f65f802b050 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f661ade4740 10 client.26642 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d3087df8b0 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66000316a0 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.427+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f65f80047a0 con 0x55d3083f71b0 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 10 client.26642 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 10 client.26642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 20 client.26642 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083de9f0 0x55d3087e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 4 client.26642 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d30873e5d0 con 0x55d3083de9f0 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f660e59c640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083de9f0 0x55d3087e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f660e59c640 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083de9f0 0x55d3087e2d10 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=115402d87fbdef82 server_cookie=7add04591d1ed4a5 in_seq=0 out_seq=0 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.428+0000 7f65f5ffb640 10 client.26642 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f65f5ffb640 1 -- 172.21.15.2:0/3773415307 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d30873e5d0 con 0x55d3083de9f0 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f65f5ffb640 10 client.26642 handle_command_reply: tid=0 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 client.26642 shutdown 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 msgr2=0x55d3087d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65f800f990 tx=0x7f65f8004730 comp rx=0 tx=0).stop 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 shutdown_connections 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083de9f0 0x55d3087e2d10 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d308420070 0x55d3087dcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083ff390 0x55d3087d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 --2- 172.21.15.2:0/3773415307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d3083f71b0 0x55d3087d0a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f65f5ffb640 0 client.26642 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 >> 172.21.15.2:0/3773415307 conn(0x55d308414460 msgr2=0x55d3087c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 shutdown_connections 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 1 -- 172.21.15.2:0/3773415307 wait complete. 2024-08-31T04:34:14.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.431+0000 7f661ade4740 20 client.26642 trim_cache size 0 max 16384 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 Processor -- start 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 -- start start 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66101b38a0 con 0x55d3083ff390 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66101b1170 con 0x55d308420070 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f661ade4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f66101aefc0 con 0x55d3083f71b0 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39486/0 (socket says 172.21.15.2:39486) 2024-08-31T04:34:14.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 -- 172.21.15.2:0/3194006947 learned_addr learned my addr 172.21.15.2:0/3194006947 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f6607fff640 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f6607fff640 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 -- 172.21.15.2:0/3194006947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 msgr2=0x55d3087c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 -- 172.21.15.2:0/3194006947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 msgr2=0x55d3087ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.445+0000 7f660e59c640 1 -- 172.21.15.2:0/3194006947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3087be940 con 0x55d3083ff390 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.446+0000 7f660e59c640 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6600031440 tx=0x7f6600005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f051b2a747a4e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.446+0000 7f65f7fff640 1 -- 172.21.15.2:0/3194006947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600035040 con 0x55d3083ff390 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.446+0000 7f65f7fff640 1 -- 172.21.15.2:0/3194006947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6600005480 con 0x55d3083ff390 2024-08-31T04:34:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.446+0000 7f65f7fff640 1 -- 172.21.15.2:0/3194006947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600040040 con 0x55d3083ff390 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- 172.21.15.2:0/3194006947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 msgr2=0x55d3087cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6600031440 tx=0x7f6600005890 comp rx=0 tx=0).stop 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- 172.21.15.2:0/3194006947 shutdown_connections 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087cdc40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 --2- 172.21.15.2:0/3194006947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- 172.21.15.2:0/3194006947 >> 172.21.15.2:0/3194006947 conn(0x55d308414460 msgr2=0x55d3087c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- 172.21.15.2:0/3194006947 shutdown_connections 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- 172.21.15.2:0/3194006947 wait complete. 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 -- start start 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.447+0000 7f661ade4740 1 Processor -- start 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66101af630 con 0x55d3083ff390 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66101b0aa0 con 0x55d308420070 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f66101afd00 con 0x55d3083f71b0 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 10 client.0 _ll_register_callbacks cb 0x7f65f80118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39492/0 (socket says 172.21.15.2:39492) 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 -- 172.21.15.2:0/2178178608 learned_addr learned my addr 172.21.15.2:0/2178178608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f6607fff640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f6607fff640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 -- 172.21.15.2:0/2178178608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 msgr2=0x55d3087d93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087d93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 -- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 msgr2=0x55d3087d5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087d5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 -- 172.21.15.2:0/2178178608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3087d64e0 con 0x55d3083ff390 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f6607fff640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087d5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f660e59c640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6600009800 tx=0x7f6600031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bf834d4b8da652 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f65f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660005d020 con 0x55d3083ff390 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f66000317a0 con 0x55d3083ff390 2024-08-31T04:34:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.448+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6600005480 con 0x55d3083ff390 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6600068050 con 0x55d3083ff390 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 10 client.16929 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d30884e5d0 con 0x55d3083ff390 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6600005480 con 0x55d3083ff390 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6600056450 con 0x55d3083ff390 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 10 client.16929 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 20 client.16929 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083b3da0 0x55d308850880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 4 client.16929 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d30873a070 con 0x55d3083b3da0 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.449+0000 7f6607fff640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083b3da0 0x55d308850880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.450+0000 7f6607fff640 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083b3da0 0x55d308850880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=177c88cf84021439 server_cookie=dee0932058379e00 in_seq=0 out_seq=0 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.450+0000 7f65f5ffb640 10 client.16929 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f65f5ffb640 1 -- 172.21.15.2:0/2178178608 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d30873a070 con 0x55d3083b3da0 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f65f5ffb640 10 client.16929 handle_command_reply: tid=0 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 client.16929 shutdown 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 msgr2=0x55d3087d58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6600009800 tx=0x7f6600031e40 comp rx=0 tx=0).stop 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 shutdown_connections 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d3083b3da0 0x55d308850880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3083ff390 0x55d3087d58b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d308420070 0x55d3087d5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f65f5ffb640 0 client.16929 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 --2- 172.21.15.2:0/2178178608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d3083f71b0 0x55d3087d93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 >> 172.21.15.2:0/2178178608 conn(0x55d308414460 msgr2=0x55d3087c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 shutdown_connections 2024-08-31T04:34:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 1 -- 172.21.15.2:0/2178178608 wait complete. 2024-08-31T04:34:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.451+0000 7f661ade4740 20 client.16929 trim_cache size 0 max 16384 2024-08-31T04:34:14.458 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 msgr2=0x7f65fc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 0x7f65fc0b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66080a9510 tx=0x7f66080784a0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 msgr2=0x7f661019bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 0x7f661019bb00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6608009fd0 tx=0x7f660800ee50 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 shutdown_connections 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65fc0b4ca0 0x7f65fc0b71b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6610108a90 0x7f661019bb00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6610108140 0x7f661019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 --2- 172.21.15.2:0/3862960105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6610102800 0x7f661019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 >> 172.21.15.2:0/3862960105 conn(0x7f66100794d0 msgr2=0x7f6610101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 shutdown_connections 2024-08-31T04:34:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:14.452+0000 7f661486f640 1 -- 172.21.15.2:0/3862960105 wait complete. 2024-08-31T04:34:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:14 smithi002 ceph-mon[18656]: pgmap v609: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 227 op/s 2024-08-31T04:34:14.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 899974 11.01 MB/sec execute 334 sec latency 31.202 ms 2024-08-31T04:34:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:14 smithi064 ceph-mon[22007]: pgmap v609: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 227 op/s 2024-08-31T04:34:14.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:14 smithi132 ceph-mon[22335]: pgmap v609: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 227 op/s 2024-08-31T04:34:15.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 901903 11.02 MB/sec execute 335 sec latency 15.694 ms 2024-08-31T04:34:16.204 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:34:16.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:34:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:16.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:16 smithi002 ceph-mon[18656]: pgmap v610: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-08-31T04:34:16.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 903434 11.01 MB/sec execute 336 sec latency 33.731 ms 2024-08-31T04:34:16.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:16 smithi064 ceph-mon[22007]: pgmap v610: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-08-31T04:34:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:16 smithi132 ceph-mon[22335]: pgmap v610: 129 pgs: 129 active+clean; 527 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-08-31T04:34:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 -- 172.21.15.2:0/1092694286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 msgr2=0x7f160c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1092694286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c102c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009900 tx=0x7f15fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 -- 172.21.15.2:0/1092694286 shutdown_connections 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1092694286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108ad0 0x7f160c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1092694286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108180 0x7f160c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1092694286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c102c50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 -- 172.21.15.2:0/1092694286 >> 172.21.15.2:0/1092694286 conn(0x7f160c0794f0 msgr2=0x7f160c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 -- 172.21.15.2:0/1092694286 shutdown_connections 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.038+0000 7f1611eb1640 1 -- 172.21.15.2:0/1092694286 wait complete. 2024-08-31T04:34:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.039+0000 7f1611eb1640 1 Processor -- start 2024-08-31T04:34:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.039+0000 7f1611eb1640 1 -- start start 2024-08-31T04:34:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 0x7f160c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f160c112780 con 0x7f160c102840 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f160c112600 con 0x7f160c108ad0 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f1611eb1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f160c112900 con 0x7f160c108180 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:42670/0 (socket says 172.21.15.2:42670) 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 -- 172.21.15.2:0/1550576066 learned_addr learned my addr 172.21.15.2:0/1550576066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160b7fe640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160affd640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 0x7f160c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 -- 172.21.15.2:0/1550576066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 msgr2=0x7f160c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 0x7f160c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 -- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 msgr2=0x7f160c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.040+0000 7f160bfff640 1 -- 172.21.15.2:0/1550576066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c1a01f0 con 0x7f160c108ad0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f160affd640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 0x7f160c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f160bfff640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1604009fd0 tx=0x7f160400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f1608ff9640 1 -- 172.21.15.2:0/1550576066 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604017070 con 0x7f160c108ad0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f1608ff9640 1 -- 172.21.15.2:0/1550576066 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1604003e20 con 0x7f160c108ad0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c1a04e0 con 0x7f160c108ad0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1a6c40 con 0x7f160c108ad0 2024-08-31T04:34:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.041+0000 7f1608ff9640 1 -- 172.21.15.2:0/1550576066 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604010460 con 0x7f160c108ad0 2024-08-31T04:34:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.044+0000 7f1608ff9640 1 -- 172.21.15.2:0/1550576066 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1604010720 con 0x7f160c108ad0 2024-08-31T04:34:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.044+0000 7f1618426740 1 Processor -- start 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 -- start start 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc095780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc095cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ecc00b5f0 con 0x564ecbcc6490 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ecbffab80 con 0x564ecbcce670 2024-08-31T04:34:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1618426740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564ecbffeb30 con 0x564ecbcef350 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc095cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:42672/0 (socket says 172.21.15.2:42672) 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 -- 172.21.15.2:0/2266201793 learned_addr learned my addr 172.21.15.2:0/2266201793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc095780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f1608ff9640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 0x7f15f40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 -- 172.21.15.2:0/2266201793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 msgr2=0x564ecc095780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc095780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 -- 172.21.15.2:0/2266201793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 msgr2=0x564ecc095cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc095cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.045+0000 7f160affd640 1 -- 172.21.15.2:0/2266201793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecbd5a930 con 0x564ecbcce670 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f160bfff640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 0x7f15f40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f1608ff9640 1 -- 172.21.15.2:0/1550576066 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f16040e4d90 con 0x7f160c108ad0 2024-08-31T04:34:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f160affd640 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16000148d0 tx=0x7f1600009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef17036ae36a8550 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f15f1ffb640 1 -- 172.21.15.2:0/2266201793 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600005020 con 0x564ecbcce670 2024-08-31T04:34:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f15f1ffb640 1 -- 172.21.15.2:0/2266201793 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16000047a0 con 0x564ecbcce670 2024-08-31T04:34:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.046+0000 7f15f1ffb640 1 -- 172.21.15.2:0/2266201793 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000f9a0 con 0x564ecbcce670 2024-08-31T04:34:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 -- 172.21.15.2:0/2266201793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 msgr2=0x564ecc096200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f160bfff640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 0x7f15f40b7230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16040a8440 tx=0x7f1604017000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16000148d0 tx=0x7f1600009570 comp rx=0 tx=0).stop 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 -- 172.21.15.2:0/2266201793 shutdown_connections 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc095cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc096200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 --2- 172.21.15.2:0/2266201793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc095780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.047+0000 7f1618426740 1 -- 172.21.15.2:0/2266201793 >> 172.21.15.2:0/2266201793 conn(0x564ecbce3740 msgr2=0x564ecc093670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.048+0000 7f1618426740 1 -- 172.21.15.2:0/2266201793 shutdown_connections 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.048+0000 7f1618426740 1 -- 172.21.15.2:0/2266201793 wait complete. 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.048+0000 7f1618426740 1 -- start start 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.049+0000 7f1618426740 1 Processor -- start 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcc6490 0x564ecc0a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcce670 0x564ecc0a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ecbe5d890 con 0x564ecbcef350 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ecbf81790 con 0x564ecbcc6490 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564ecc0a3f60 con 0x564ecbcce670 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f1618426740 10 client.0 _ll_register_callbacks cb 0x564ecbd06ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcce670 0x564ecc0a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39878/0 (socket says 172.21.15.2:39878) 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.050+0000 7f160affd640 1 -- 172.21.15.2:0/2964069650 learned_addr learned my addr 172.21.15.2:0/2964069650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcc6490 0x564ecc0a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 -- 172.21.15.2:0/2964069650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcce670 msgr2=0x564ecc0a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcce670 0x564ecc0a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 -- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcc6490 msgr2=0x564ecc0a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcc6490 0x564ecc0a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 -- 172.21.15.2:0/2964069650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecbfb8f30 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f160affd640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1600006010 tx=0x7f1600009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e5535a95f53a20 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f15eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.051+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600004020 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f16000041c0 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16000047a0 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16000043c0 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 10 client.16941 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ecc0afd90 con 0x564ecbcef350 2024-08-31T04:34:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16000047a0 con 0x564ecbcef350 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f160000f960 con 0x564ecbcef350 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 10 client.16941 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 20 client.16941 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbcadcd0 0x564ecc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 4 client.16941 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.052+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ecc00d540 con 0x564ecbcadcd0 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.053+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbcadcd0 0x564ecc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.053+0000 7f15eaffd640 10 client.16941 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.053+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbcadcd0 0x564ecc0b35e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=370352369a0862fb server_cookie=f770ad292f321a72 in_seq=0 out_seq=0 2024-08-31T04:34:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.055+0000 7f15eaffd640 1 -- 172.21.15.2:0/2964069650 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ecc00d540 con 0x564ecbcadcd0 2024-08-31T04:34:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.055+0000 7f15eaffd640 10 client.16941 handle_command_reply: tid=0 2024-08-31T04:34:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.055+0000 7f1618426740 1 client.16941 shutdown 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 msgr2=0x564ecc0ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1600006010 tx=0x7f1600009470 comp rx=0 tx=0).stop 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 shutdown_connections 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbcadcd0 0x564ecc0b35e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcef350 0x564ecc0ad2b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcce670 0x564ecc0a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 --2- 172.21.15.2:0/2964069650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcc6490 0x564ecc0a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f15eaffd640 0 client.16941 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 >> 172.21.15.2:0/2964069650 conn(0x564ecbce3740 msgr2=0x564ecc098910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 shutdown_connections 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 1 -- 172.21.15.2:0/2964069650 wait complete. 2024-08-31T04:34:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.056+0000 7f1618426740 20 client.16941 trim_cache size 0 max 16384 2024-08-31T04:34:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.077+0000 7f1618426740 1 Processor -- start 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.077+0000 7f1618426740 1 -- start start 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.077+0000 7f1618426740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.077+0000 7f1618426740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc09e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f1618426740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc09e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f1618426740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8016fd0 con 0x564ecbcc6490 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f1618426740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80148a0 con 0x564ecbcce670 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f1618426740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80126f0 con 0x564ecbcef350 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc09e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39882/0 (socket says 172.21.15.2:39882) 2024-08-31T04:34:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 -- 172.21.15.2:0/3403999586 learned_addr learned my addr 172.21.15.2:0/3403999586 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc09e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 -- 172.21.15.2:0/3403999586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 msgr2=0x564ecc09e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc09e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 -- 172.21.15.2:0/3403999586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 msgr2=0x564ecc09e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc09e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 -- 172.21.15.2:0/3403999586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecc097a70 con 0x564ecbcc6490 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160b7fe640 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc09e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.078+0000 7f160affd640 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1600004bd0 tx=0x7f1600004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c068376af652b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.079+0000 7f15f17fa640 1 -- 172.21.15.2:0/3403999586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000036a0 con 0x564ecbcc6490 2024-08-31T04:34:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.079+0000 7f15f17fa640 1 -- 172.21.15.2:0/3403999586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1600023020 con 0x564ecbcc6490 2024-08-31T04:34:17.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.079+0000 7f15f17fa640 1 -- 172.21.15.2:0/3403999586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000051f0 con 0x564ecbcc6490 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.079+0000 7f1618426740 1 -- 172.21.15.2:0/3403999586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 msgr2=0x564ecc0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.079+0000 7f1618426740 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1600004bd0 tx=0x7f1600004b60 comp rx=0 tx=0).stop 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 -- 172.21.15.2:0/3403999586 shutdown_connections 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc09e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc09e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 --2- 172.21.15.2:0/3403999586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0ad1b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 -- 172.21.15.2:0/3403999586 >> 172.21.15.2:0/3403999586 conn(0x564ecbce3740 msgr2=0x564ecc093640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 -- 172.21.15.2:0/3403999586 shutdown_connections 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 -- 172.21.15.2:0/3403999586 wait complete. 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 -- start start 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.080+0000 7f1618426740 1 Processor -- start 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc0a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8012d60 con 0x564ecbcc6490 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80141d0 con 0x564ecbcce670 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8013430 con 0x564ecbcef350 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f1618426740 10 client.0 _ll_register_callbacks cb 0x7f1600005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39894/0 (socket says 172.21.15.2:39894) 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 -- 172.21.15.2:0/2953297893 learned_addr learned my addr 172.21.15.2:0/2953297893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc0a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 -- 172.21.15.2:0/2953297893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 msgr2=0x564ecc0a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc0a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 -- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 msgr2=0x564ecc0a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc0a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 -- 172.21.15.2:0/2953297893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecc0a5c00 con 0x564ecbcc6490 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc0a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f160affd640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f16000045d0 tx=0x7f1600004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9c00ca6d83b156 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.081+0000 7f15eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600040030 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f160000f730 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1600023020 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1600009450 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 10 client.16947 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ecc11df60 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1600023020 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1600029040 con 0x564ecbcc6490 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 10 client.16947 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.082+0000 7f1618426740 20 client.16947 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbc83080 0x564ecc120400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f1618426740 4 client.16947 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:34:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564ecc008fe0 con 0x564ecbc83080 2024-08-31T04:34:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbc83080 0x564ecc120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f15eaffd640 10 client.16947 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.083+0000 7f160b7fe640 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbc83080 0x564ecc120400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1703f4e12d7486f2 server_cookie=5a6ef3f36ae9823f in_seq=0 out_seq=0 2024-08-31T04:34:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f15eaffd640 1 -- 172.21.15.2:0/2953297893 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564ecc008fe0 con 0x564ecbc83080 2024-08-31T04:34:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f15eaffd640 10 client.16947 handle_command_reply: tid=0 2024-08-31T04:34:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 client.16947 shutdown 2024-08-31T04:34:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 msgr2=0x564ecc0a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f16000045d0 tx=0x7f1600004560 comp rx=0 tx=0).stop 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 shutdown_connections 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x564ecbc83080 0x564ecc120400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564ecbcef350 0x564ecc0a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ecbcce670 0x564ecc0a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 --2- 172.21.15.2:0/2953297893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ecbcc6490 0x564ecc0a9a40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 >> 172.21.15.2:0/2953297893 conn(0x564ecbce3740 msgr2=0x564ecc097170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f15eaffd640 0 client.16947 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 shutdown_connections 2024-08-31T04:34:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 1 -- 172.21.15.2:0/2953297893 wait complete. 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.085+0000 7f1618426740 20 client.16947 trim_cache size 0 max 16384 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491", 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:34:17.093 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 msgr2=0x7f15f40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 0x7f15f40b7230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16040a8440 tx=0x7f1604017000 comp rx=0 tx=0).stop 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 msgr2=0x7f160c19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1604009fd0 tx=0x7f160400b260 comp rx=0 tx=0).stop 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 shutdown_connections 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f160c108ad0 0x7f160c19fac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f160c108180 0x7f160c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f15f40b4d20 0x7f15f40b7230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 --2- 172.21.15.2:0/1550576066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f160c102840 0x7f160c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 >> 172.21.15.2:0/1550576066 conn(0x7f160c0794f0 msgr2=0x7f160c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 shutdown_connections 2024-08-31T04:34:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:17.086+0000 7f1611eb1640 1 -- 172.21.15.2:0/1550576066 wait complete. 2024-08-31T04:34:17.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 905324 11.01 MB/sec execute 337 sec latency 81.483 ms 2024-08-31T04:34:17.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:34:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:18 smithi002 ceph-mon[18656]: pgmap v611: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:34:18.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:34:18.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:34:18.620 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:34:18.620 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.620 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.620 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:18 smithi132 ceph-mon[22335]: pgmap v611: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:34:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 -- 172.21.15.2:0/3271380298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428101b80 msgr2=0x7f0428101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 --2- 172.21.15.2:0/3271380298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428101b80 0x7f0428101f90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0410009900 tx=0x7f041002a410 comp rx=0 tx=0).stop 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 -- 172.21.15.2:0/3271380298 shutdown_connections 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 --2- 172.21.15.2:0/3271380298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428101b80 0x7f0428101f90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 --2- 172.21.15.2:0/3271380298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04281024d0 0x7f0428110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 --2- 172.21.15.2:0/3271380298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0428108490 0x7f04281088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 -- 172.21.15.2:0/3271380298 >> 172.21.15.2:0/3271380298 conn(0x7f0428077a00 msgr2=0x7f0428077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 -- 172.21.15.2:0/3271380298 shutdown_connections 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.621+0000 7f042dfb0640 1 -- 172.21.15.2:0/3271380298 wait complete. 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 Processor -- start 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 -- start start 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 0x7f042819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04281024d0 0x7f042819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0428113840 con 0x7f0428108490 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04281136c0 con 0x7f0428101b80 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.622+0000 7f042dfb0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04281139c0 con 0x7f04281024d0 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39918/0 (socket says 172.21.15.2:39918) 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 -- 172.21.15.2:0/2202265850 learned_addr learned my addr 172.21.15.2:0/2202265850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f04277fe640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 0x7f042819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04281024d0 0x7f042819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 -- 172.21.15.2:0/2202265850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04281024d0 msgr2=0x7f042819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04281024d0 0x7f042819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 -- 172.21.15.2:0/2202265850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 msgr2=0x7f042819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 0x7f042819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 -- 172.21.15.2:0/2202265850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04281a0180 con 0x7f0428108490 2024-08-31T04:34:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f04277fe640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 0x7f042819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0427fff640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f042000eb10 tx=0x7f042000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0424ff9640 1 -- 172.21.15.2:0/2202265850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420004b20 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0424ff9640 1 -- 172.21.15.2:0/2202265850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0420004cc0 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04281a0470 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f0424ff9640 1 -- 172.21.15.2:0/2202265850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420010670 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.623+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04281a6bd0 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 Processor -- start 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0424ff9640 1 -- 172.21.15.2:0/2202265850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0420010830 con 0x7f0428108490 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 -- start start 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 0x55e78692b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e78692b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786565390 0x55e78692bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e7868a2630 con 0x55e786586070 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e786891bc0 con 0x55e78655d1b0 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.626+0000 7f0434525740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e786895b70 con 0x55e786565390 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 0x55e78692b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 0x55e78692b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39928/0 (socket says 172.21.15.2:39928) 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0426ffd640 1 -- 172.21.15.2:0/3998041949 learned_addr learned my addr 172.21.15.2:0/3998041949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e78692b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0426ffd640 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786565390 0x55e78692bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 -- 172.21.15.2:0/3998041949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786565390 msgr2=0x55e78692bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786565390 0x55e78692bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 -- 172.21.15.2:0/3998041949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 msgr2=0x55e78692b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 0x55e78692b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 -- 172.21.15.2:0/3998041949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7865f1650 con 0x55e78655d1b0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0424ff9640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 0x7f04140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 0x7f04140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f04277fe640 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e78692b800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0418009fd0 tx=0x7f04180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8955d0809cb6af6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f0424ff9640 1 -- 172.21.15.2:0/2202265850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f04200e5f60 con 0x7f0428108490 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.627+0000 7f041dffb640 1 -- 172.21.15.2:0/3998041949 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418004310 con 0x55e78655d1b0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f041dffb640 1 -- 172.21.15.2:0/3998041949 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04180044b0 con 0x55e78655d1b0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f041dffb640 1 -- 172.21.15.2:0/3998041949 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04180035f0 con 0x55e78655d1b0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 -- 172.21.15.2:0/3998041949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 msgr2=0x55e78692b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 0x7f04140b71b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f04100096c0 tx=0x7f0410000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e78692b800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0418009fd0 tx=0x7f04180118d0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 -- 172.21.15.2:0/3998041949 shutdown_connections 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786565390 0x55e78692bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e78692b800 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 --2- 172.21.15.2:0/3998041949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786586070 0x55e78692b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 -- 172.21.15.2:0/3998041949 >> 172.21.15.2:0/3998041949 conn(0x55e78657a460 msgr2=0x55e7869291b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 -- 172.21.15.2:0/3998041949 shutdown_connections 2024-08-31T04:34:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.628+0000 7f0434525740 1 -- 172.21.15.2:0/3998041949 wait complete. 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 -- start start 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 Processor -- start 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e7869369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e786942df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e7866f4700 con 0x55e786565390 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e786818700 con 0x55e78655d1b0 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e786939aa0 con 0x55e786586070 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.629+0000 7f0434525740 10 client.0 _ll_register_callbacks cb 0x55e786847dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39942/0 (socket says 172.21.15.2:39942) 2024-08-31T04:34:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0426ffd640 1 -- 172.21.15.2:0/2149593154 learned_addr learned my addr 172.21.15.2:0/2149593154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e7869369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0427fff640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e786942df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 -- 172.21.15.2:0/2149593154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 msgr2=0x55e786942df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e786942df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 -- 172.21.15.2:0/2149593154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 msgr2=0x55e786936ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 -- 172.21.15.2:0/2149593154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7868518b0 con 0x55e78655d1b0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f04277fe640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e7869369b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041801b040 tx=0x7f04180048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1220ae8bf6c46cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418029070 con 0x55e78655d1b0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f0418003a00 con 0x55e78655d1b0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.630+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04180044b0 con 0x55e78655d1b0 2024-08-31T04:34:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0418035050 con 0x55e78655d1b0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 10 client.26678 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e7869457e0 con 0x55e78655d1b0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04180044b0 con 0x55e78655d1b0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f041800f480 con 0x55e78655d1b0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 10 client.26678 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 10 client.26678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 20 client.26678 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e7865449f0 0x55e786948b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 4 client.26678 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7868a4580 con 0x55e7865449f0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.631+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e7865449f0 0x55e786948b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.632+0000 7f0406ffd640 10 client.26678 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.632+0000 7f0426ffd640 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e7865449f0 0x55e786948b40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69907b5b72e52f7a server_cookie=6cc938cdea3d8d61 in_seq=0 out_seq=0 2024-08-31T04:34:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.632+0000 7f0406ffd640 1 -- 172.21.15.2:0/2149593154 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7868a4580 con 0x55e7865449f0 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.632+0000 7f0406ffd640 10 client.26678 handle_command_reply: tid=0 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.632+0000 7f0434525740 1 client.26678 shutdown 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 msgr2=0x55e7869369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e7869369b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041801b040 tx=0x7f04180048f0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 shutdown_connections 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e7865449f0 0x55e786948b40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786936ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e786942df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0406ffd640 0 client.26678 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 --2- 172.21.15.2:0/2149593154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e7869369b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 >> 172.21.15.2:0/2149593154 conn(0x55e78657a460 msgr2=0x55e78692e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 shutdown_connections 2024-08-31T04:34:18.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 1 -- 172.21.15.2:0/2149593154 wait complete. 2024-08-31T04:34:18.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.633+0000 7f0434525740 20 client.26678 trim_cache size 0 max 16384 2024-08-31T04:34:18.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.652+0000 7f0434525740 1 Processor -- start 2024-08-31T04:34:18.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.652+0000 7f0434525740 1 -- start start 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e786929220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786942cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b3760 con 0x55e786565390 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b1030 con 0x55e78655d1b0 2024-08-31T04:34:18.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.653+0000 7f0434525740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04281aee80 con 0x55e786586070 2024-08-31T04:34:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43322/0 (socket says 172.21.15.2:43322) 2024-08-31T04:34:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 -- 172.21.15.2:0/43139104 learned_addr learned my addr 172.21.15.2:0/43139104 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0426ffd640 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786942cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 -- 172.21.15.2:0/43139104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 msgr2=0x55e786929220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e786929220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 -- 172.21.15.2:0/43139104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 msgr2=0x55e786942cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786942cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 -- 172.21.15.2:0/43139104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78692d5b0 con 0x55e786586070 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.654+0000 7f0427fff640 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04200a8260 tx=0x7f04200cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c84cebdd42fade3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.655+0000 7f041d7fa640 1 -- 172.21.15.2:0/43139104 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04200ac8e0 con 0x55e786586070 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.656+0000 7f041d7fa640 1 -- 172.21.15.2:0/43139104 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04200ac1e0 con 0x55e786586070 2024-08-31T04:34:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.656+0000 7f041d7fa640 1 -- 172.21.15.2:0/43139104 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420005000 con 0x55e786586070 2024-08-31T04:34:18.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- 172.21.15.2:0/43139104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 msgr2=0x55e78692e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04200a8260 tx=0x7f04200cf040 comp rx=0 tx=0).stop 2024-08-31T04:34:18.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- 172.21.15.2:0/43139104 shutdown_connections 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e786565390 0x55e786942cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e78692e3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 --2- 172.21.15.2:0/43139104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e78655d1b0 0x55e786929220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- 172.21.15.2:0/43139104 >> 172.21.15.2:0/43139104 conn(0x55e78657a460 msgr2=0x55e786928b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- 172.21.15.2:0/43139104 shutdown_connections 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- 172.21.15.2:0/43139104 wait complete. 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.657+0000 7f0434525740 1 -- start start 2024-08-31T04:34:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.658+0000 7f0434525740 1 Processor -- start 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 0x55e78693f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e7869ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04281af4f0 con 0x55e78655d1b0 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b0960 con 0x55e786565390 2024-08-31T04:34:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04281afbc0 con 0x55e786586070 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0434525740 10 client.0 _ll_register_callbacks cb 0x7f0418005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f04277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f04277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39956/0 (socket says 172.21.15.2:39956) 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f04277fe640 1 -- 172.21.15.2:0/1716050834 learned_addr learned my addr 172.21.15.2:0/1716050834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0426ffd640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 0x55e78693f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.659+0000 7f0427fff640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e7869ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 -- 172.21.15.2:0/1716050834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 msgr2=0x55e7869ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e7869ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 -- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 msgr2=0x55e78693f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 0x55e78693f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 -- 172.21.15.2:0/1716050834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e78693f8d0 con 0x55e78655d1b0 2024-08-31T04:34:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f0427fff640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e7869ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f0426ffd640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 0x55e78693f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f04277fe640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0418011910 tx=0x7f0418004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776f2173643f88a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.660+0000 7f0406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418029070 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f041800f480 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04200ac1e0 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f041800fa70 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0434525740 10 client.16965 fetch_fsmap learned FSMap version 30 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.661+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e7869af3b0 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04200ac1e0 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0418040ba0 con 0x55e78655d1b0 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 10 client.16965 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:34:18.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 20 client.16965 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e786519da0 0x55e7869b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 4 client.16965 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e7868a0020 con 0x55e786519da0 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.662+0000 7f0426ffd640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e786519da0 0x55e7869b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0406ffd640 10 client.16965 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0426ffd640 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e786519da0 0x55e7869b1b90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce51924be1749217 server_cookie=47fbc3ed240a39f1 in_seq=0 out_seq=0 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0406ffd640 1 -- 172.21.15.2:0/1716050834 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55e7868a0020 con 0x55e786519da0 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0406ffd640 10 client.16965 handle_command_reply: tid=0 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 client.16965 shutdown 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 msgr2=0x55e78693ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0418011910 tx=0x7f0418004980 comp rx=0 tx=0).stop 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 shutdown_connections 2024-08-31T04:34:18.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55e786519da0 0x55e7869b1b90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e786586070 0x55e7869ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e786565390 0x55e78693f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.663+0000 7f0434525740 1 --2- 172.21.15.2:0/1716050834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e78655d1b0 0x55e78693ed50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 >> 172.21.15.2:0/1716050834 conn(0x55e78657a460 msgr2=0x55e78692e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f0406ffd640 0 client.16965 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 shutdown_connections 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f0434525740 1 -- 172.21.15.2:0/1716050834 wait complete. 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f0434525740 20 client.16965 trim_cache size 0 max 16384 2024-08-31T04:34:18.668 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491", 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:34:18.669 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.670 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:34:18.672 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:18.677 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:34:18.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 msgr2=0x7f04140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 0x7f04140b71b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f04100096c0 tx=0x7f0410000bc0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 msgr2=0x7f042819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:18.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.664+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f042000eb10 tx=0x7f042000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 shutdown_connections 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f04140b4ca0 0x7f04140b71b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0428108490 0x7f042819fa50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04281024d0 0x7f042819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 --2- 172.21.15.2:0/2202265850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0428101b80 0x7f042819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 >> 172.21.15.2:0/2202265850 conn(0x7f0428077a00 msgr2=0x7f0428106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 shutdown_connections 2024-08-31T04:34:18.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:18.665+0000 7f042dfb0640 1 -- 172.21.15.2:0/2202265850 wait complete. 2024-08-31T04:34:18.684 INFO:tasks.workunit.client.0.smithi002.stdout: 1 906098 10.98 MB/sec execute 338 sec latency 106.378 ms 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:34:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:18 smithi064 ceph-mon[22007]: pgmap v611: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 211 op/s 2024-08-31T04:34:19.381 INFO:tasks.cephfs.filesystem:scrub status for tag:3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491 - {'path': '/', 'tag': '3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491', 'options': 'recursive,force'} 2024-08-31T04:34:19.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 908477 10.99 MB/sec execute 339 sec latency 139.691 ms 2024-08-31T04:34:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:20 smithi002 ceph-mon[18656]: pgmap v612: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-08-31T04:34:20.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 909571 10.97 MB/sec execute 340 sec latency 31.288 ms 2024-08-31T04:34:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:20 smithi064 ceph-mon[22007]: pgmap v612: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-08-31T04:34:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:20 smithi132 ceph-mon[22335]: pgmap v612: 129 pgs: 129 active+clean; 537 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-08-31T04:34:21.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 912060 10.98 MB/sec execute 341 sec latency 17.193 ms 2024-08-31T04:34:22.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:22 smithi064 ceph-mon[22007]: pgmap v613: 129 pgs: 129 active+clean; 539 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 191 op/s 2024-08-31T04:34:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:22 smithi002 ceph-mon[18656]: pgmap v613: 129 pgs: 129 active+clean; 539 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 191 op/s 2024-08-31T04:34:22.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 913104 10.97 MB/sec execute 342 sec latency 104.015 ms 2024-08-31T04:34:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:22 smithi132 ceph-mon[22335]: pgmap v613: 129 pgs: 129 active+clean; 539 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 191 op/s 2024-08-31T04:34:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:23 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:34:23.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:23 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:34:23.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 915361 10.97 MB/sec execute 343 sec latency 18.482 ms 2024-08-31T04:34:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:23 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:34:23.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:23 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:34:23.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:23 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:34:23.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:23 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:34:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:24 smithi002 ceph-mon[18656]: pgmap v614: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T04:34:24.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 916540 10.96 MB/sec execute 344 sec latency 33.217 ms 2024-08-31T04:34:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:24 smithi064 ceph-mon[22007]: pgmap v614: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T04:34:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:24 smithi132 ceph-mon[22335]: pgmap v614: 129 pgs: 129 active+clean; 545 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T04:34:25.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 917591 10.99 MB/sec execute 345 sec latency 84.438 ms 2024-08-31T04:34:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:26 smithi002 ceph-mon[18656]: pgmap v615: 129 pgs: 129 active+clean; 549 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 221 op/s 2024-08-31T04:34:26.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 920246 11.00 MB/sec execute 346 sec latency 15.969 ms 2024-08-31T04:34:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:26 smithi064 ceph-mon[22007]: pgmap v615: 129 pgs: 129 active+clean; 549 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 221 op/s 2024-08-31T04:34:26.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:26 smithi132 ceph-mon[22335]: pgmap v615: 129 pgs: 129 active+clean; 549 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 221 op/s 2024-08-31T04:34:27.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 921735 10.99 MB/sec execute 347 sec latency 63.511 ms 2024-08-31T04:34:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:28 smithi002 ceph-mon[18656]: pgmap v616: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 245 op/s 2024-08-31T04:34:28.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 923861 11.00 MB/sec execute 348 sec latency 48.160 ms 2024-08-31T04:34:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:28 smithi064 ceph-mon[22007]: pgmap v616: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 245 op/s 2024-08-31T04:34:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:28 smithi132 ceph-mon[22335]: pgmap v616: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 245 op/s 2024-08-31T04:34:29.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 925485 10.98 MB/sec execute 349 sec latency 24.458 ms 2024-08-31T04:34:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:30 smithi002 ceph-mon[18656]: pgmap v617: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 175 op/s 2024-08-31T04:34:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:30 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:34:30.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 927744 10.99 MB/sec execute 350 sec latency 36.682 ms 2024-08-31T04:34:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:30 smithi064 ceph-mon[22007]: pgmap v617: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 175 op/s 2024-08-31T04:34:30.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:30 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:34:30.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:30 smithi132 ceph-mon[22335]: pgmap v617: 129 pgs: 129 active+clean; 551 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 175 op/s 2024-08-31T04:34:30.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:30 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:34:31.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 929931 10.98 MB/sec execute 351 sec latency 29.420 ms 2024-08-31T04:34:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:32 smithi002 ceph-mon[18656]: pgmap v618: 129 pgs: 129 active+clean; 557 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-08-31T04:34:32.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 931684 10.99 MB/sec execute 352 sec latency 74.215 ms 2024-08-31T04:34:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:32 smithi064 ceph-mon[22007]: pgmap v618: 129 pgs: 129 active+clean; 557 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-08-31T04:34:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:32 smithi132 ceph-mon[22335]: pgmap v618: 129 pgs: 129 active+clean; 557 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-08-31T04:34:33.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 934089 10.99 MB/sec execute 353 sec latency 16.848 ms 2024-08-31T04:34:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:34 smithi002 ceph-mon[18656]: pgmap v619: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 243 op/s 2024-08-31T04:34:34.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 935857 10.99 MB/sec execute 354 sec latency 27.408 ms 2024-08-31T04:34:34.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:34 smithi064 ceph-mon[22007]: pgmap v619: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 243 op/s 2024-08-31T04:34:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:34 smithi132 ceph-mon[22335]: pgmap v619: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 243 op/s 2024-08-31T04:34:35.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 938076 11.00 MB/sec execute 355 sec latency 129.559 ms 2024-08-31T04:34:36.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:36 smithi002 ceph-mon[18656]: pgmap v620: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 182 op/s 2024-08-31T04:34:36.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 939716 10.98 MB/sec execute 356 sec latency 28.063 ms 2024-08-31T04:34:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:36 smithi064 ceph-mon[22007]: pgmap v620: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 182 op/s 2024-08-31T04:34:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:36 smithi132 ceph-mon[22335]: pgmap v620: 129 pgs: 129 active+clean; 563 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 182 op/s 2024-08-31T04:34:37.685 INFO:tasks.workunit.client.0.smithi002.stdout: 1 941923 10.99 MB/sec execute 357 sec latency 55.300 ms 2024-08-31T04:34:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:38 smithi002 ceph-mon[18656]: pgmap v621: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 220 op/s 2024-08-31T04:34:38.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 943424 10.98 MB/sec execute 358 sec latency 30.578 ms 2024-08-31T04:34:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:38 smithi064 ceph-mon[22007]: pgmap v621: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 220 op/s 2024-08-31T04:34:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:38 smithi132 ceph-mon[22335]: pgmap v621: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 220 op/s 2024-08-31T04:34:39.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 945698 10.98 MB/sec execute 359 sec latency 14.660 ms 2024-08-31T04:34:40.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:40 smithi002 ceph-mon[18656]: pgmap v622: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:34:40.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 948312 10.99 MB/sec execute 360 sec latency 27.493 ms 2024-08-31T04:34:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:40 smithi064 ceph-mon[22007]: pgmap v622: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:34:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:40 smithi132 ceph-mon[22335]: pgmap v622: 129 pgs: 129 active+clean; 574 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:34:41.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 949816 10.98 MB/sec execute 361 sec latency 28.801 ms 2024-08-31T04:34:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:42 smithi002 ceph-mon[18656]: pgmap v623: 129 pgs: 129 active+clean; 575 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T04:34:42.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 952161 10.99 MB/sec execute 362 sec latency 40.777 ms 2024-08-31T04:34:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:42 smithi064 ceph-mon[22007]: pgmap v623: 129 pgs: 129 active+clean; 575 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T04:34:42.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:42 smithi132 ceph-mon[22335]: pgmap v623: 129 pgs: 129 active+clean; 575 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T04:34:43.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 953631 10.98 MB/sec execute 363 sec latency 47.385 ms 2024-08-31T04:34:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:44 smithi002 ceph-mon[18656]: pgmap v624: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:34:44.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 956080 10.99 MB/sec execute 364 sec latency 17.801 ms 2024-08-31T04:34:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:44 smithi064 ceph-mon[22007]: pgmap v624: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:34:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:44 smithi132 ceph-mon[22335]: pgmap v624: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:34:45.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 958224 10.98 MB/sec execute 365 sec latency 19.084 ms 2024-08-31T04:34:46.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:46 smithi002 ceph-mon[18656]: pgmap v625: 129 pgs: 129 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 190 op/s 2024-08-31T04:34:46.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 960086 10.98 MB/sec execute 366 sec latency 27.355 ms 2024-08-31T04:34:46.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:46 smithi064 ceph-mon[22007]: pgmap v625: 129 pgs: 129 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 190 op/s 2024-08-31T04:34:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:46 smithi132 ceph-mon[22335]: pgmap v625: 129 pgs: 129 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 190 op/s 2024-08-31T04:34:47.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 962302 10.99 MB/sec execute 367 sec latency 53.135 ms 2024-08-31T04:34:48.618 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:48 smithi132 ceph-mon[22335]: pgmap v626: 129 pgs: 129 active+clean; 545 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:34:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:48 smithi002 ceph-mon[18656]: pgmap v626: 129 pgs: 129 active+clean; 545 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:34:48.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 963904 10.98 MB/sec execute 368 sec latency 36.078 ms 2024-08-31T04:34:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:48 smithi064 ceph-mon[22007]: pgmap v626: 129 pgs: 129 active+clean; 545 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:34:49.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:34:49.653 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:49.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 966351 10.99 MB/sec execute 369 sec latency 20.094 ms 2024-08-31T04:34:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 -- 172.21.15.2:0/3861919745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc106970 msgr2=0x7f93dc110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/3861919745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc106970 0x7f93dc110400 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009cd0 tx=0x7f93d402a8e0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 -- 172.21.15.2:0/3861919745 shutdown_connections 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/3861919745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/3861919745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc106970 0x7f93dc110400 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/3861919745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc101dd0 0x7f93dc1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.201+0000 7f93e1e3b640 1 -- 172.21.15.2:0/3861919745 >> 172.21.15.2:0/3861919745 conn(0x7f93dc077a00 msgr2=0x7f93dc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.202+0000 7f93e1e3b640 1 -- 172.21.15.2:0/3861919745 shutdown_connections 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.202+0000 7f93e1e3b640 1 -- 172.21.15.2:0/3861919745 wait complete. 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.202+0000 7f93e1e3b640 1 Processor -- start 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.202+0000 7f93e1e3b640 1 -- start start 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc101dd0 0x7f93dc102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 0x7f93dc1037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc113860 con 0x7f93dc106020 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1136e0 con 0x7f93dc101dd0 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93e1e3b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1139e0 con 0x7f93dc106970 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37858/0 (socket says 172.21.15.2:37858) 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 -- 172.21.15.2:0/407300929 learned_addr learned my addr 172.21.15.2:0/407300929 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93db7fe640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc101dd0 0x7f93dc102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93dbfff640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 0x7f93dc1037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 -- 172.21.15.2:0/407300929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 msgr2=0x7f93dc1037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 0x7f93dc1037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 -- 172.21.15.2:0/407300929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc101dd0 msgr2=0x7f93dc102d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc101dd0 0x7f93dc102d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 -- 172.21.15.2:0/407300929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc1a8490 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93dbfff640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 0x7f93dc1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93daffd640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e970 tx=0x7f93d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.203+0000 7f93d8ff9640 1 -- 172.21.15.2:0/407300929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d000cd80 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.204+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc1a8780 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.204+0000 7f93d8ff9640 1 -- 172.21.15.2:0/407300929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93d00035f0 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.204+0000 7f93d8ff9640 1 -- 172.21.15.2:0/407300929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0010690 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.204+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a8d10 con 0x7f93dc106020 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.206+0000 7f93e83b0740 1 Processor -- start 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.206+0000 7f93e83b0740 1 -- start start 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.206+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa026c070 0x556fa06112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 0x556fa0611d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93e83b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fa0588630 con 0x556fa02431b0 2024-08-31T04:34:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93e83b0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556fa0577bc0 con 0x556fa024b390 2024-08-31T04:34:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93e83b0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556fa057bb70 con 0x556fa026c070 2024-08-31T04:34:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93d8ff9640 1 -- 172.21.15.2:0/407300929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f93d00108f0 con 0x7f93dc106020 2024-08-31T04:34:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37872/0 (socket says 172.21.15.2:37872) 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 -- 172.21.15.2:0/1576929713 learned_addr learned my addr 172.21.15.2:0/1576929713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93daffd640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 0x556fa0611d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93dbfff640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa026c070 0x556fa06112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 -- 172.21.15.2:0/1576929713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa026c070 msgr2=0x556fa06112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa026c070 0x556fa06112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 -- 172.21.15.2:0/1576929713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 msgr2=0x556fa0611d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 0x556fa0611d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 -- 172.21.15.2:0/1576929713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa02d7650 con 0x556fa02431b0 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93daffd640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 0x556fa0611d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.207+0000 7f93db7fe640 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009c60 tx=0x7f93cc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e224c4a431f1f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93c1ffb640 1 -- 172.21.15.2:0/1576929713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc004220 con 0x556fa02431b0 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93d8ff9640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 0x7f93c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93c1ffb640 1 -- 172.21.15.2:0/1576929713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc0043c0 con 0x556fa02431b0 2024-08-31T04:34:50.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93c1ffb640 1 -- 172.21.15.2:0/1576929713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0197a0 con 0x556fa02431b0 2024-08-31T04:34:50.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93dbfff640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 0x7f93c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93d8ff9640 1 -- 172.21.15.2:0/407300929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f93d00e5d40 con 0x7f93dc106020 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93dbfff640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 0x7f93c40b71b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f93d40094e0 tx=0x7f93d4009470 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.208+0000 7f93e83b0740 1 -- 172.21.15.2:0/1576929713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 msgr2=0x556fa0611800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009c60 tx=0x7f93cc011810 comp rx=0 tx=0).stop 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 -- 172.21.15.2:0/1576929713 shutdown_connections 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0611800 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa024b390 0x556fa0611d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 --2- 172.21.15.2:0/1576929713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa026c070 0x556fa06112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 -- 172.21.15.2:0/1576929713 >> 172.21.15.2:0/1576929713 conn(0x556fa0260460 msgr2=0x556fa060f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 -- 172.21.15.2:0/1576929713 shutdown_connections 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 -- 172.21.15.2:0/1576929713 wait complete. 2024-08-31T04:34:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 -- start start 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.209+0000 7f93e83b0740 1 Processor -- start 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa061cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fa03da700 con 0x556fa026c070 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556fa04fe700 con 0x556fa02431b0 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556fa061faa0 con 0x556fa024b390 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93e83b0740 10 client.0 _ll_register_callbacks cb 0x556fa052ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:39316/0 (socket says 172.21.15.2:39316) 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37878/0 (socket says 172.21.15.2:37878) 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 -- 172.21.15.2:0/407749519 learned_addr learned my addr 172.21.15.2:0/407749519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93daffd640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa061cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 -- 172.21.15.2:0/407749519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 msgr2=0x556fa061cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa061cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 -- 172.21.15.2:0/407749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 msgr2=0x556fa0628df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93db7fe640 1 -- 172.21.15.2:0/407749519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa05378b0 con 0x556fa02431b0 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93dbfff640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.210+0000 7f93daffd640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa061cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93db7fe640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93cc003e80 tx=0x7f93cc003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda5784d7e684537 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc028070 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc0043c0 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f93cc005250 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93cc003c30 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 10 client.26693 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556fa062b870 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc0043c0 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f93cc004c90 con 0x556fa02431b0 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 10 client.26693 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 10 client.26693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.211+0000 7f93e83b0740 20 client.26693 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa022a9f0 0x556fa062ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93e83b0740 4 client.26693 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fa058a580 con 0x556fa022a9f0 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93daffd640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa022a9f0 0x556fa062ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93baffd640 10 client.26693 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.212+0000 7f93daffd640 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa022a9f0 0x556fa062ec90 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69185f4dda03258 server_cookie=524ac7ae8dcd5ef3 in_seq=0 out_seq=0 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93baffd640 1 -- 172.21.15.2:0/407749519 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556fa058a580 con 0x556fa022a9f0 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93baffd640 10 client.26693 handle_command_reply: tid=0 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 client.26693 shutdown 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 msgr2=0x556fa061ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93cc003e80 tx=0x7f93cc003820 comp rx=0 tx=0).stop 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 shutdown_connections 2024-08-31T04:34:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa022a9f0 0x556fa062ec90 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa026c070 0x556fa0628df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa061cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 --2- 172.21.15.2:0/407749519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa02431b0 0x556fa061ca30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93baffd640 0 client.26693 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.213+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 >> 172.21.15.2:0/407749519 conn(0x556fa0260460 msgr2=0x556fa0614450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.214+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 shutdown_connections 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.214+0000 7f93e83b0740 1 -- 172.21.15.2:0/407749519 wait complete. 2024-08-31T04:34:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.214+0000 7f93e83b0740 20 client.26693 trim_cache size 0 max 16384 2024-08-31T04:34:50.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 Processor -- start 2024-08-31T04:34:50.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 -- start start 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa02431b0 0x556fa0612a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa061a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b5ae0 con 0x556fa024b390 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b3380 con 0x556fa026c070 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93e83b0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b11d0 con 0x556fa02431b0 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37890/0 (socket says 172.21.15.2:37890) 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa061a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 -- 172.21.15.2:0/2092447276 learned_addr learned my addr 172.21.15.2:0/2092447276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93db7fe640 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa02431b0 0x556fa0612a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 -- 172.21.15.2:0/2092447276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa02431b0 msgr2=0x556fa0612a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa02431b0 0x556fa0612a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 -- 172.21.15.2:0/2092447276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 msgr2=0x556fa061a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa061a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93daffd640 1 -- 172.21.15.2:0/2092447276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa060a550 con 0x556fa024b390 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.232+0000 7f93dbfff640 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa061a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.233+0000 7f93daffd640 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f93d00abf50 tx=0x7f93d00ab9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71a996bea365c69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.233+0000 7f93c17fa640 1 -- 172.21.15.2:0/2092447276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d00e7040 con 0x556fa024b390 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.233+0000 7f93c17fa640 1 -- 172.21.15.2:0/2092447276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93d00b0830 con 0x556fa024b390 2024-08-31T04:34:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.233+0000 7f93c17fa640 1 -- 172.21.15.2:0/2092447276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d00ac220 con 0x556fa024b390 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- 172.21.15.2:0/2092447276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 msgr2=0x556fa0619c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f93d00abf50 tx=0x7f93d00ab9d0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- 172.21.15.2:0/2092447276 shutdown_connections 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa024b390 0x556fa0619c20 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa061a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 --2- 172.21.15.2:0/2092447276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa02431b0 0x556fa0612a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- 172.21.15.2:0/2092447276 >> 172.21.15.2:0/2092447276 conn(0x556fa0260460 msgr2=0x556fa06122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- 172.21.15.2:0/2092447276 shutdown_connections 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- 172.21.15.2:0/2092447276 wait complete. 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.234+0000 7f93e83b0740 1 -- start start 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 Processor -- start 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa0622df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa06904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b1840 con 0x556fa02431b0 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b2cb0 con 0x556fa026c070 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b1f10 con 0x556fa024b390 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93e83b0740 10 client.0 _ll_register_callbacks cb 0x7f93cc009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37894/0 (socket says 172.21.15.2:37894) 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93db7fe640 1 -- 172.21.15.2:0/3536667152 learned_addr learned my addr 172.21.15.2:0/3536667152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93dbfff640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa06904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93daffd640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa0622df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93db7fe640 1 -- 172.21.15.2:0/3536667152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 msgr2=0x556fa0622df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.235+0000 7f93db7fe640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa0622df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93db7fe640 1 -- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 msgr2=0x556fa06904f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93db7fe640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa06904f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93db7fe640 1 -- 172.21.15.2:0/3536667152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa0690b60 con 0x556fa02431b0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93dbfff640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa06904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93daffd640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa0622df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93db7fe640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f93cc019520 tx=0x7f93cc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87bcd55cddf7959 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93baffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc03d060 con 0x556fa02431b0 2024-08-31T04:34:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f93cc005450 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d00b0830 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93cc028070 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93e83b0740 10 client.16983 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556fa0699050 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.236+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93d00b0830 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f93cc0388d0 con 0x556fa02431b0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 10 client.16983 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 20 client.16983 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa01ffda0 0x556fa069b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 4 client.16983 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556fa0586020 con 0x556fa01ffda0 2024-08-31T04:34:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93daffd640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa01ffda0 0x556fa069b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93daffd640 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa01ffda0 0x556fa069b7e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8b5b979c27383dd server_cookie=ece7866374b58867 in_seq=0 out_seq=0 2024-08-31T04:34:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.237+0000 7f93baffd640 10 client.16983 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93baffd640 1 -- 172.21.15.2:0/3536667152 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x556fa0586020 con 0x556fa01ffda0 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93baffd640 10 client.16983 handle_command_reply: tid=0 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 client.16983 shutdown 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 msgr2=0x556fa0622850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f93cc019520 tx=0x7f93cc009ed0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 shutdown_connections 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x556fa01ffda0 0x556fa069b7e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556fa026c070 0x556fa06904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556fa024b390 0x556fa0622df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 --2- 172.21.15.2:0/3536667152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fa02431b0 0x556fa0622850 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93baffd640 0 client.16983 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.238+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 >> 172.21.15.2:0/3536667152 conn(0x556fa0260460 msgr2=0x556fa0612cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 shutdown_connections 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e83b0740 1 -- 172.21.15.2:0/3536667152 wait complete. 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e83b0740 20 client.16983 trim_cache size 0 max 16384 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:34:50.245 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.248 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:34:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.252 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:34:50.253 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:34:50.256 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 msgr2=0x7f93c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 0x7f93c40b71b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f93d40094e0 tx=0x7f93d4009470 comp rx=0 tx=0).stop 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 msgr2=0x7f93dc1032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e970 tx=0x7f93d000ee30 comp rx=0 tx=0).stop 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 shutdown_connections 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f93c40b4ca0 0x7f93c40b71b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93dc106020 0x7f93dc1032b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93dc106970 0x7f93dc1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 --2- 172.21.15.2:0/407300929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93dc101dd0 0x7f93dc102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:50.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 >> 172.21.15.2:0/407300929 conn(0x7f93dc077a00 msgr2=0x7f93dc107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:50.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 shutdown_connections 2024-08-31T04:34:50.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:50.239+0000 7f93e1e3b640 1 -- 172.21.15.2:0/407300929 wait complete. 2024-08-31T04:34:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:50 smithi002 ceph-mon[18656]: pgmap v627: 129 pgs: 129 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 177 op/s 2024-08-31T04:34:50.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 967788 10.98 MB/sec execute 370 sec latency 69.416 ms 2024-08-31T04:34:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:50 smithi132 ceph-mon[22335]: pgmap v627: 129 pgs: 129 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 177 op/s 2024-08-31T04:34:50.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:50 smithi064 ceph-mon[22007]: pgmap v627: 129 pgs: 129 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 177 op/s 2024-08-31T04:34:51.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:34:51.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:34:51.389 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:51.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 969930 10.99 MB/sec execute 371 sec latency 27.090 ms 2024-08-31T04:34:51.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 -- 172.21.15.2:0/4262310616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990102880 msgr2=0x7f2990102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 --2- 172.21.15.2:0/4262310616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990102880 0x7f2990102c90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2980009900 tx=0x7f298002a410 comp rx=0 tx=0).stop 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 -- 172.21.15.2:0/4262310616 shutdown_connections 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 --2- 172.21.15.2:0/4262310616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990108ac0 0x7f299010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 --2- 172.21.15.2:0/4262310616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108170 0x7f2990108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 --2- 172.21.15.2:0/4262310616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990102880 0x7f2990102c90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 -- 172.21.15.2:0/4262310616 >> 172.21.15.2:0/4262310616 conn(0x7f2990079530 msgr2=0x7f2990079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 -- 172.21.15.2:0/4262310616 shutdown_connections 2024-08-31T04:34:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.880+0000 7f299494f640 1 -- 172.21.15.2:0/4262310616 wait complete. 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 Processor -- start 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 -- start start 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 0x7f299019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 0x7f299019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2990112790 con 0x7f2990108170 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2990112610 con 0x7f2990108ac0 2024-08-31T04:34:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.881+0000 7f299494f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2990112910 con 0x7f2990102880 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f2985d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 0x7f299019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:39346/0 (socket says 172.21.15.2:39346) 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f2985d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 0x7f299019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37906/0 (socket says 172.21.15.2:37906) 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 -- 172.21.15.2:0/2468555175 learned_addr learned my addr 172.21.15.2:0/2468555175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298e59c640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 0x7f299019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 -- 172.21.15.2:0/2468555175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 msgr2=0x7f299019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 0x7f299019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 -- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 msgr2=0x7f299019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 0x7f299019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 -- 172.21.15.2:0/2468555175 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29901a2480 con 0x7f2990108ac0 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298e59c640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 0x7f299019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:51.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f298ed9d640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f298800eb10 tx=0x7f298800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988004b20 con 0x7f2990108ac0 2024-08-31T04:34:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29901a2770 con 0x7f2990108ac0 2024-08-31T04:34:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2988004cc0 con 0x7f2990108ac0 2024-08-31T04:34:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988010690 con 0x7f2990108ac0 2024-08-31T04:34:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.882+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29901a8ed0 con 0x7f2990108ac0 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.883+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2990102c90 con 0x7f2990108ac0 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.885+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2988005000 con 0x7f2990108ac0 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.886+0000 7f2987fff640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 0x7f297c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.886+0000 7f298e59c640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 0x7f297c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.887+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f29880e6100 con 0x7f2990108ac0 2024-08-31T04:34:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.887+0000 7f298e59c640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 0x7f297c0b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2980031440 tx=0x7f2980009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:51.889+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2988056130 con 0x7f2990108ac0 2024-08-31T04:34:52.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.135+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f299019d640 con 0x7f2990108ac0 2024-08-31T04:34:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.136+0000 7f2987fff640 1 -- 172.21.15.2:0/2468555175 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11898 (secure 0 0 0) 0x7f299019d640 con 0x7f2990108ac0 2024-08-31T04:34:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:34:52.138 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-08-31T04:34:29:339032+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:34:28.729383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:34:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 msgr2=0x7f297c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 0x7f297c0b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2980031440 tx=0x7f2980009680 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 msgr2=0x7f29901a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f298800eb10 tx=0x7f298800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 shutdown_connections 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f297c0b4ca0 0x7f297c0b71b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2990108170 0x7f299019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2990108ac0 0x7f29901a1d50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 --2- 172.21.15.2:0/2468555175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990102880 0x7f299019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 >> 172.21.15.2:0/2468555175 conn(0x7f2990079530 msgr2=0x7f299006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 shutdown_connections 2024-08-31T04:34:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:52.139+0000 7f299494f640 1 -- 172.21.15.2:0/2468555175 wait complete. 2024-08-31T04:34:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:52 smithi002 ceph-mon[18656]: pgmap v628: 129 pgs: 129 active+clean; 553 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:34:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:52 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2468555175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:52.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:52 smithi064 ceph-mon[22007]: pgmap v628: 129 pgs: 129 active+clean; 553 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:34:52.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:52 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2468555175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:52.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 971359 10.97 MB/sec execute 372 sec latency 70.585 ms 2024-08-31T04:34:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:52 smithi132 ceph-mon[22335]: pgmap v628: 129 pgs: 129 active+clean; 553 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:34:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:52 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2468555175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:34:53.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:34:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:53.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 973542 10.98 MB/sec execute 373 sec latency 43.905 ms 2024-08-31T04:34:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 -- 172.21.15.2:0/2147529618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109bb0 msgr2=0x7f6670110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 --2- 172.21.15.2:0/2147529618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109bb0 0x7f6670110400 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6668009900 tx=0x7f666802a410 comp rx=0 tx=0).stop 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 -- 172.21.15.2:0/2147529618 shutdown_connections 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 --2- 172.21.15.2:0/2147529618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109bb0 0x7f6670110400 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 --2- 172.21.15.2:0/2147529618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670109260 0x7f6670109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 --2- 172.21.15.2:0/2147529618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f667006bb30 0x7f667006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 -- 172.21.15.2:0/2147529618 >> 172.21.15.2:0/2147529618 conn(0x7f6670079780 msgr2=0x7f6670079b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 -- 172.21.15.2:0/2147529618 shutdown_connections 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.967+0000 7f6676eee640 1 -- 172.21.15.2:0/2147529618 wait complete. 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 Processor -- start 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 -- start start 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 0x7f6670102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6670109bb0 0x7f66701031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6670113850 con 0x7f6670109260 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66701136d0 con 0x7f667006bb30 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.968+0000 7f6676eee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f66701139d0 con 0x7f6670109bb0 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 0x7f6670102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37918/0 (socket says 172.21.15.2:37918) 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666ffff640 1 -- 172.21.15.2:0/807912142 learned_addr learned my addr 172.21.15.2:0/807912142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f667548b640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6670109bb0 0x7f66701031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 -- 172.21.15.2:0/807912142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6670109bb0 msgr2=0x7f66701031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6670109bb0 0x7f66701031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 -- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 msgr2=0x7f6670102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 -- 172.21.15.2:0/807912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66701a84a0 con 0x7f667006bb30 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666ffff640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6674c8a640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 0x7f6670102760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6658005fd0 tx=0x7f665800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666dffb640 1 -- 172.21.15.2:0/807912142 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658009c30 con 0x7f667006bb30 2024-08-31T04:34:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66701a8790 con 0x7f667006bb30 2024-08-31T04:34:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666dffb640 1 -- 172.21.15.2:0/807912142 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6658009dd0 con 0x7f667006bb30 2024-08-31T04:34:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.969+0000 7f666dffb640 1 -- 172.21.15.2:0/807912142 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658010460 con 0x7f667006bb30 2024-08-31T04:34:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.970+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66701a8d20 con 0x7f667006bb30 2024-08-31T04:34:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.972+0000 7f666dffb640 1 -- 172.21.15.2:0/807912142 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6658003e80 con 0x7f667006bb30 2024-08-31T04:34:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 Processor -- start 2024-08-31T04:34:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 -- start start 2024-08-31T04:34:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f666dffb640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 0x7f665c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667548b640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 0x7f665c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f666dffb640 1 -- 172.21.15.2:0/807912142 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f66580e5920 con 0x7f667006bb30 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50e6070 0x55a2f548b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50c5390 0x55a2f548bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5402680 con 0x55a2f50c5390 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a2f53f1c10 con 0x55a2f50bd1b0 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667d463740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a2f53f5bc0 con 0x55a2f50e6070 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f666ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f666ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:39368/0 (socket says 172.21.15.2:39368) 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f666ffff640 1 -- 172.21.15.2:0/1010966859 learned_addr learned my addr 172.21.15.2:0/1010966859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f667548b640 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50c5390 0x55a2f548bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.973+0000 7f6674c8a640 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50e6070 0x55a2f548b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f667548b640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 0x7f665c0b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6668006010 tx=0x7f6668032b80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 -- 172.21.15.2:0/1010966859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50e6070 msgr2=0x55a2f548b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50e6070 0x55a2f548b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 -- 172.21.15.2:0/1010966859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50c5390 msgr2=0x55a2f548bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50c5390 0x55a2f548bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 -- 172.21.15.2:0/1010966859 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f5151650 con 0x55a2f50bd1b0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f666ffff640 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6660011870 tx=0x7f6660011d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df781b498eb2371b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f6666ffd640 1 -- 172.21.15.2:0/1010966859 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66600112f0 con 0x55a2f50bd1b0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f6666ffd640 1 -- 172.21.15.2:0/1010966859 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6660003e20 con 0x55a2f50bd1b0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.974+0000 7f6666ffd640 1 -- 172.21.15.2:0/1010966859 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660004490 con 0x55a2f50bd1b0 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 -- 172.21.15.2:0/1010966859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 msgr2=0x55a2f548b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6660011870 tx=0x7f6660011d30 comp rx=0 tx=0).stop 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 -- 172.21.15.2:0/1010966859 shutdown_connections 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50c5390 0x55a2f548bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f548b850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 --2- 172.21.15.2:0/1010966859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50e6070 0x55a2f548b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 -- 172.21.15.2:0/1010966859 >> 172.21.15.2:0/1010966859 conn(0x55a2f50da460 msgr2=0x55a2f5489200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 -- 172.21.15.2:0/1010966859 shutdown_connections 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.975+0000 7f667d463740 1 -- 172.21.15.2:0/1010966859 wait complete. 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 -- start start 2024-08-31T04:34:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 Processor -- start 2024-08-31T04:34:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f5496ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f54a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5254700 con 0x55a2f50e6070 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5378750 con 0x55a2f50bd1b0 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5499af0 con 0x55a2f50c5390 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667d463740 10 client.0 _ll_register_callbacks cb 0x55a2f53a7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f667548b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f54a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f666ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f5496ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:39376/0 (socket says 172.21.15.2:39376) 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f666ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f5496ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:60236/0 (socket says 172.21.15.2:60236) 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.976+0000 7f6674c8a640 1 -- 172.21.15.2:0/1836780010 learned_addr learned my addr 172.21.15.2:0/1836780010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 -- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 msgr2=0x55a2f5496ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f5496ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 -- 172.21.15.2:0/1836780010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 msgr2=0x55a2f54a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f54a2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 -- 172.21.15.2:0/1836780010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f53b1900 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f6674c8a640 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6658005d00 tx=0x7f66580e3130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a09c11c7ca38ec1a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f664ffff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66580b0020 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f66580b4a30 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6660003e20 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.977+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6658020070 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 10 client.26717 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a2f54a5850 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6660003e20 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f66580aaeb0 con 0x55a2f50bd1b0 2024-08-31T04:34:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 10 client.26717 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 10 client.26717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 20 client.26717 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f50a49f0 0x55a2f54a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 4 client.26717 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2f54045d0 con 0x55a2f50a49f0 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.978+0000 7f666ffff640 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f50a49f0 0x55a2f54a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.979+0000 7f666ffff640 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f50a49f0 0x55a2f54a8df0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4180700ca87812e6 server_cookie=81140aaa9142a4bb in_seq=0 out_seq=0 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.979+0000 7f664ffff640 10 client.26717 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f664ffff640 1 -- 172.21.15.2:0/1836780010 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2f54045d0 con 0x55a2f50a49f0 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f664ffff640 10 client.26717 handle_command_reply: tid=0 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 client.26717 shutdown 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 msgr2=0x55a2f5496980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6658005d00 tx=0x7f66580e3130 comp rx=0 tx=0).stop 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 shutdown_connections 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f50a49f0 0x55a2f54a8df0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f54a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f5496ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f664ffff640 0 client.26717 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 --2- 172.21.15.2:0/1836780010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f5496980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 >> 172.21.15.2:0/1836780010 conn(0x55a2f50da460 msgr2=0x55a2f548e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 shutdown_connections 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 1 -- 172.21.15.2:0/1836780010 wait complete. 2024-08-31T04:34:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.980+0000 7f667d463740 20 client.26717 trim_cache size 0 max 16384 2024-08-31T04:34:53.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 Processor -- start 2024-08-31T04:34:53.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 -- start start 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f54887d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50e6070 0x55a2f5488d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b5b20 con 0x55a2f50bd1b0 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b33c0 con 0x55a2f50e6070 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667d463740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b1210 con 0x55a2f50c5390 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37940/0 (socket says 172.21.15.2:37940) 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f6674c8a640 1 -- 172.21.15.2:0/3427517227 learned_addr learned my addr 172.21.15.2:0/3427517227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f666ffff640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f54887d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.994+0000 7f667548b640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50e6070 0x55a2f5488d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 -- 172.21.15.2:0/3427517227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 msgr2=0x55a2f54887d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f54887d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 -- 172.21.15.2:0/3427517227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50e6070 msgr2=0x55a2f5488d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50e6070 0x55a2f5488d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 -- 172.21.15.2:0/3427517227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f5498d50 con 0x55a2f50bd1b0 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f666ffff640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f54887d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f6674c8a640 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6658004650 tx=0x7f66580abd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94356e19aecb4370 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f66667fc640 1 -- 172.21.15.2:0/3427517227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66580c5020 con 0x55a2f50bd1b0 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f66667fc640 1 -- 172.21.15.2:0/3427517227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66580b01e0 con 0x55a2f50bd1b0 2024-08-31T04:34:53.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.995+0000 7f66667fc640 1 -- 172.21.15.2:0/3427517227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66580b0040 con 0x55a2f50bd1b0 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 -- 172.21.15.2:0/3427517227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 msgr2=0x55a2f5497ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6658004650 tx=0x7f66580abd90 comp rx=0 tx=0).stop 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 -- 172.21.15.2:0/3427517227 shutdown_connections 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50e6070 0x55a2f5488d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f54887d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 --2- 172.21.15.2:0/3427517227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50bd1b0 0x55a2f5497ea0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 -- 172.21.15.2:0/3427517227 >> 172.21.15.2:0/3427517227 conn(0x55a2f50da460 msgr2=0x55a2f548cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 -- 172.21.15.2:0/3427517227 shutdown_connections 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.996+0000 7f667d463740 1 -- 172.21.15.2:0/3427517227 wait complete. 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 -- start start 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 Processor -- start 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f549b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f55127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b1880 con 0x55a2f50e6070 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b2cf0 con 0x55a2f50bd1b0 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f66701b1f50 con 0x55a2f50c5390 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667d463740 10 client.0 _ll_register_callbacks cb 0x7f66580a74b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f6674c8a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f549b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f666ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667548b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f55127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f666ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:60242/0 (socket says 172.21.15.2:60242) 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f666ffff640 1 -- 172.21.15.2:0/172461449 learned_addr learned my addr 172.21.15.2:0/172461449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.997+0000 7f667548b640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f55127b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37942/0 (socket says 172.21.15.2:37942) 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 -- 172.21.15.2:0/172461449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 msgr2=0x55a2f549b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f549b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 -- 172.21.15.2:0/172461449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 msgr2=0x55a2f55127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f55127b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 -- 172.21.15.2:0/172461449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f5512cf0 con 0x55a2f50c5390 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f666ffff640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f666000f790 tx=0x7f6660009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22723a98e901a036 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f664ffff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660011230 con 0x55a2f50c5390 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f66600113d0 con 0x55a2f50c5390 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66580b01e0 con 0x55a2f50c5390 2024-08-31T04:34:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f666000f9a0 con 0x55a2f50c5390 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f667d463740 10 client.26530 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a2f5513e00 con 0x55a2f50c5390 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.998+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66580b01e0 con 0x55a2f50c5390 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f666001a480 con 0x55a2f50c5390 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 10 client.26530 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 10 client.26530 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 20 client.26530 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f5079da0 0x55a2f55164a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 4 client.26530 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2f5400070 con 0x55a2f5079da0 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f6674c8a640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f5079da0 0x55a2f55164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f664ffff640 10 client.26530 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:53.999+0000 7f6674c8a640 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f5079da0 0x55a2f55164a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2aa45890ecd47bf4 server_cookie=e514366f0fb64633 in_seq=0 out_seq=0 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f664ffff640 1 -- 172.21.15.2:0/172461449 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2f5400070 con 0x55a2f5079da0 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f664ffff640 10 client.26530 handle_command_reply: tid=0 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 client.26530 shutdown 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 msgr2=0x55a2f549b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f666000f790 tx=0x7f6660009f50 comp rx=0 tx=0).stop 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 shutdown_connections 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a2f5079da0 0x55a2f55164a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2f50e6070 0x55a2f55127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a2f50c5390 0x55a2f549b630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f664ffff640 0 client.26530 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 --2- 172.21.15.2:0/172461449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a2f50bd1b0 0x55a2f549b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 >> 172.21.15.2:0/172461449 conn(0x55a2f50da460 msgr2=0x55a2f548cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 shutdown_connections 2024-08-31T04:34:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 1 -- 172.21.15.2:0/172461449 wait complete. 2024-08-31T04:34:54.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.000+0000 7f667d463740 20 client.26530 trim_cache size 0 max 16384 2024-08-31T04:34:54.007 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 msgr2=0x7f665c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 0x7f665c0b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6668006010 tx=0x7f6668032b80 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 msgr2=0x7f6670102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 0x7f6670102760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6658005fd0 tx=0x7f665800dde0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 shutdown_connections 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f665c0b4ca0 0x7f665c0b71b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6670109260 0x7f6670102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6670109bb0 0x7f66701031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 --2- 172.21.15.2:0/807912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f667006bb30 0x7f6670102760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 >> 172.21.15.2:0/807912142 conn(0x7f6670079780 msgr2=0x7f66700ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:54.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 shutdown_connections 2024-08-31T04:34:54.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:54.001+0000 7f6676eee640 1 -- 172.21.15.2:0/807912142 wait complete. 2024-08-31T04:34:54.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:54 smithi002 ceph-mon[18656]: pgmap v629: 129 pgs: 129 active+clean; 557 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 230 op/s 2024-08-31T04:34:54.686 INFO:tasks.workunit.client.0.smithi002.stdout: 1 975117 10.97 MB/sec execute 374 sec latency 40.358 ms 2024-08-31T04:34:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:54 smithi064 ceph-mon[22007]: pgmap v629: 129 pgs: 129 active+clean; 557 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 230 op/s 2024-08-31T04:34:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:54 smithi132 ceph-mon[22335]: pgmap v629: 129 pgs: 129 active+clean; 557 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 230 op/s 2024-08-31T04:34:54.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:34:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:55.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 977400 10.97 MB/sec execute 375 sec latency 16.559 ms 2024-08-31T04:34:56.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 -- 172.21.15.2:0/1929981585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 msgr2=0x7fb868108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1929981585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb868108580 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb858009900 tx=0x7fb85802a410 comp rx=0 tx=0).stop 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 -- 172.21.15.2:0/1929981585 shutdown_connections 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1929981585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb868108580 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1929981585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 0x7fb86810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1929981585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 0x7fb868102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 -- 172.21.15.2:0/1929981585 >> 172.21.15.2:0/1929981585 conn(0x7fb868079500 msgr2=0x7fb868079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 -- 172.21.15.2:0/1929981585 shutdown_connections 2024-08-31T04:34:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.039+0000 7fb86fa61640 1 -- 172.21.15.2:0/1929981585 wait complete. 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 Processor -- start 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 -- start start 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 0x7fb868199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 0x7fb86819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb868112710 con 0x7fb868108170 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb868112590 con 0x7fb868102880 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86fa61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb868112890 con 0x7fb868108ac0 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43582/0 (socket says 172.21.15.2:43582) 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86cffc640 1 -- 172.21.15.2:0/1784073530 learned_addr learned my addr 172.21.15.2:0/1784073530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 0x7fb868199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.040+0000 7fb86dffe640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 0x7fb86819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 -- 172.21.15.2:0/1784073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 msgr2=0x7fb86819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 0x7fb86819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 -- 172.21.15.2:0/1784073530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 msgr2=0x7fb868199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 0x7fb868199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 -- 172.21.15.2:0/1784073530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86819f070 con 0x7fb868108170 2024-08-31T04:34:56.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb858032fd0 tx=0x7fb858031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb85e7fc640 1 -- 172.21.15.2:0/1784073530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85803f030 con 0x7fb868108170 2024-08-31T04:34:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb85e7fc640 1 -- 172.21.15.2:0/1784073530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb858004490 con 0x7fb868108170 2024-08-31T04:34:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86819f300 con 0x7fb868108170 2024-08-31T04:34:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb85e7fc640 1 -- 172.21.15.2:0/1784073530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858035070 con 0x7fb868108170 2024-08-31T04:34:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.041+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86806b8e0 con 0x7fb868108170 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 Processor -- start 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 -- start start 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb85e7fc640 1 -- 172.21.15.2:0/1784073530 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb858042030 con 0x7fb868108170 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 0x563ca19d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ca194c680 con 0x563ca160f390 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563ca193bc10 con 0x563ca16071b0 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.044+0000 7fb875fd6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563ca193fbc0 con 0x563ca1630070 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 0x563ca19d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:34910/0 (socket says 172.21.15.2:34910) 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 -- 172.21.15.2:0/119223830 learned_addr learned my addr 172.21.15.2:0/119223830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 0x563ca19d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43586/0 (socket says 172.21.15.2:43586) 2024-08-31T04:34:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 -- 172.21.15.2:0/119223830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 msgr2=0x563ca19d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 -- 172.21.15.2:0/119223830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 msgr2=0x563ca19d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 0x563ca19d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 -- 172.21.15.2:0/119223830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca169b650 con 0x563ca1630070 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86dffe640 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb860009fd0 tx=0x7fb8600118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=433b91876ab17195 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb85e7fc640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 0x7fb8540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb8537fe640 1 -- 172.21.15.2:0/119223830 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860004d20 con 0x563ca1630070 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 0x7fb8540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb8537fe640 1 -- 172.21.15.2:0/119223830 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb860004050 con 0x563ca1630070 2024-08-31T04:34:56.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.045+0000 7fb8537fe640 1 -- 172.21.15.2:0/119223830 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860005220 con 0x563ca1630070 2024-08-31T04:34:56.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.046+0000 7fb85e7fc640 1 -- 172.21.15.2:0/1784073530 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fb858105cd0 con 0x7fb868108170 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.046+0000 7fb875fd6740 1 -- 172.21.15.2:0/119223830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 msgr2=0x563ca19d5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.046+0000 7fb875fd6740 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb860009fd0 tx=0x7fb8600118d0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.046+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 0x7fb8540b71b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563ca19d3f90 tx=0x7fb864010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 -- 172.21.15.2:0/119223830 shutdown_connections 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca160f390 0x563ca19d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 --2- 172.21.15.2:0/119223830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca1630070 0x563ca19d5310 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 -- 172.21.15.2:0/119223830 >> 172.21.15.2:0/119223830 conn(0x563ca1624460 msgr2=0x563ca19d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 -- 172.21.15.2:0/119223830 shutdown_connections 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 -- 172.21.15.2:0/119223830 wait complete. 2024-08-31T04:34:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 -- start start 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.047+0000 7fb875fd6740 1 Processor -- start 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ca179e700 con 0x563ca1630070 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563ca18c2750 con 0x563ca16071b0 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563ca19e3af0 con 0x563ca160f390 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb875fd6740 10 client.0 _ll_register_callbacks cb 0x563ca18f1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86d7fd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:34914/0 (socket says 172.21.15.2:34914) 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 -- 172.21.15.2:0/1412199606 learned_addr learned my addr 172.21.15.2:0/1412199606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86dffe640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 -- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 msgr2=0x563ca19e0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 -- 172.21.15.2:0/1412199606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 msgr2=0x563ca19ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 -- 172.21.15.2:0/1412199606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca18fb900 con 0x563ca160f390 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb86cffc640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8580cbf90 tx=0x7fb858009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd61190bade5d50a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.048+0000 7fb850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858049030 con 0x563ca160f390 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fb8580c8290 con 0x563ca160f390 2024-08-31T04:34:56.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb860004050 con 0x563ca160f390 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb8580cb950 con 0x563ca160f390 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 10 client.26542 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563ca19ef900 con 0x563ca160f390 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb860004050 con 0x563ca160f390 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fb85810a040 con 0x563ca160f390 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 10 client.26542 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 10 client.26542 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 20 client.26542 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15ee9f0 0x563ca19f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 4 client.26542 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:56.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.049+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ca194e5d0 con 0x563ca15ee9f0 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.050+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15ee9f0 0x563ca19f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.050+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15ee9f0 0x563ca19f2d70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ac7c1f435feedc5 server_cookie=4bd7fef973eab504 in_seq=0 out_seq=0 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.050+0000 7fb850ff9640 10 client.26542 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb850ff9640 1 -- 172.21.15.2:0/1412199606 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ca194e5d0 con 0x563ca15ee9f0 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb850ff9640 10 client.26542 handle_command_reply: tid=0 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 client.26542 shutdown 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 msgr2=0x563ca19e0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8580cbf90 tx=0x7fb858009260 comp rx=0 tx=0).stop 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 shutdown_connections 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15ee9f0 0x563ca19f2d70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e0fd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 --2- 172.21.15.2:0/1412199606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb850ff9640 0 client.26542 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:56.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 >> 172.21.15.2:0/1412199606 conn(0x563ca1624460 msgr2=0x563ca19d84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 shutdown_connections 2024-08-31T04:34:56.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 1 -- 172.21.15.2:0/1412199606 wait complete. 2024-08-31T04:34:56.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.051+0000 7fb875fd6740 20 client.26542 trim_cache size 0 max 16384 2024-08-31T04:34:56.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.064+0000 7fb875fd6740 1 Processor -- start 2024-08-31T04:34:56.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.064+0000 7fb875fd6740 1 -- start start 2024-08-31T04:34:56.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b1610 con 0x563ca1630070 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681aeeb0 con 0x563ca16071b0 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb875fd6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681acd00 con 0x563ca160f390 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43614/0 (socket says 172.21.15.2:43614) 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 -- 172.21.15.2:0/2064266831 learned_addr learned my addr 172.21.15.2:0/2064266831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86cffc640 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 -- 172.21.15.2:0/2064266831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 msgr2=0x563ca19ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 -- 172.21.15.2:0/2064266831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 msgr2=0x563ca19d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 -- 172.21.15.2:0/2064266831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca19f30e0 con 0x563ca1630070 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.065+0000 7fb86dffe640 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb86001b040 tx=0x7fb860009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e105ff859d80e60b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb852ffd640 1 -- 172.21.15.2:0/2064266831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860003a30 con 0x563ca1630070 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb852ffd640 1 -- 172.21.15.2:0/2064266831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb860003bd0 con 0x563ca1630070 2024-08-31T04:34:56.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb852ffd640 1 -- 172.21.15.2:0/2064266831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860005030 con 0x563ca1630070 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 -- 172.21.15.2:0/2064266831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 msgr2=0x563ca19ed250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb86001b040 tx=0x7fb860009cc0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 -- 172.21.15.2:0/2064266831 shutdown_connections 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca19ed250 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2064266831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 -- 172.21.15.2:0/2064266831 >> 172.21.15.2:0/2064266831 conn(0x563ca1624460 msgr2=0x563ca19d2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 -- 172.21.15.2:0/2064266831 shutdown_connections 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.066+0000 7fb875fd6740 1 -- 172.21.15.2:0/2064266831 wait complete. 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.067+0000 7fb875fd6740 1 -- start start 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.067+0000 7fb875fd6740 1 Processor -- start 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.067+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.067+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.067+0000 7fb875fd6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca1a5abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb875fd6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681ad370 con 0x563ca1630070 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb875fd6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681ae7e0 con 0x563ca16071b0 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb875fd6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681ada40 con 0x563ca160f390 2024-08-31T04:34:56.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb875fd6740 10 client.0 _ll_register_callbacks cb 0x7fb858005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca1a5abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86dffe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca1a5abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43620/0 (socket says 172.21.15.2:43620) 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86dffe640 1 -- 172.21.15.2:0/2959709182 learned_addr learned my addr 172.21.15.2:0/2959709182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86cffc640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 -- 172.21.15.2:0/2959709182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 msgr2=0x563ca19e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 -- 172.21.15.2:0/2959709182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 msgr2=0x563ca1a5abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca1a5abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 -- 172.21.15.2:0/2959709182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca1a5b260 con 0x563ca16071b0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb86d7fd640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e57a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563ca19f3430 tx=0x7fb864004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e8c66860d2e1d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864003f80 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb860003bd0 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.068+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fb864005020 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb86403c050 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 10 client.26741 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563ca1a62600 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb860003bd0 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fb864027450 con 0x563ca16071b0 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 10 client.26741 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 10 client.26741 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 20 client.26741 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15c3da0 0x563ca1a64dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:56.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 4 client.26741 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ca194a070 con 0x563ca15c3da0 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.069+0000 7fb86cffc640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15c3da0 0x563ca1a64dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb850ff9640 10 client.26741 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb86cffc640 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15c3da0 0x563ca1a64dc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b88835dd0af7111 server_cookie=ba979fad868cbd3d in_seq=0 out_seq=0 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb850ff9640 1 -- 172.21.15.2:0/2959709182 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ca194a070 con 0x563ca15c3da0 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb850ff9640 10 client.26741 handle_command_reply: tid=0 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 client.26741 shutdown 2024-08-31T04:34:56.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 msgr2=0x563ca19e57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e57a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563ca19f3430 tx=0x7fb864004730 comp rx=0 tx=0).stop 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 shutdown_connections 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x563ca15c3da0 0x563ca1a64dc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ca1630070 0x563ca1a5abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563ca160f390 0x563ca19e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb850ff9640 0 client.26741 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 --2- 172.21.15.2:0/2959709182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ca16071b0 0x563ca19e57a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 >> 172.21.15.2:0/2959709182 conn(0x563ca1624460 msgr2=0x563ca19d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 shutdown_connections 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.070+0000 7fb875fd6740 1 -- 172.21.15.2:0/2959709182 wait complete. 2024-08-31T04:34:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb875fd6740 20 client.26741 trim_cache size 0 max 16384 2024-08-31T04:34:56.079 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 msgr2=0x7fb8540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 0x7fb8540b71b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563ca19d3f90 tx=0x7fb864010040 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 msgr2=0x7fb8681996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb858032fd0 tx=0x7fb858031a20 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 shutdown_connections 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb8540b4ca0 0x7fb8540b71b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb868108170 0x7fb8681996a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb868108ac0 0x7fb86819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 --2- 172.21.15.2:0/1784073530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb868102880 0x7fb868199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 >> 172.21.15.2:0/1784073530 conn(0x7fb868079500 msgr2=0x7fb868105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 shutdown_connections 2024-08-31T04:34:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:56.071+0000 7fb86fa61640 1 -- 172.21.15.2:0/1784073530 wait complete. 2024-08-31T04:34:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:56 smithi002 ceph-mon[18656]: pgmap v630: 129 pgs: 129 active+clean; 559 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T04:34:56.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 979159 10.96 MB/sec execute 376 sec latency 28.751 ms 2024-08-31T04:34:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:56 smithi064 ceph-mon[22007]: pgmap v630: 129 pgs: 129 active+clean; 559 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T04:34:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:56 smithi132 ceph-mon[22335]: pgmap v630: 129 pgs: 129 active+clean; 559 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T04:34:57.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:34:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:34:57.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 981102 10.97 MB/sec execute 377 sec latency 14.983 ms 2024-08-31T04:34:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 -- 172.21.15.2:0/2024062818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 msgr2=0x7fec1c1123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 --2- 172.21.15.2:0/2024062818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1123a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fec14009ca0 tx=0x7fec1402a950 comp rx=0 tx=0).stop 2024-08-31T04:34:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 -- 172.21.15.2:0/2024062818 shutdown_connections 2024-08-31T04:34:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 --2- 172.21.15.2:0/2024062818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1123a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 --2- 172.21.15.2:0/2024062818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 0x7fec1c10fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 --2- 172.21.15.2:0/2024062818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c1027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 -- 172.21.15.2:0/2024062818 >> 172.21.15.2:0/2024062818 conn(0x7fec1c0794d0 msgr2=0x7fec1c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 -- 172.21.15.2:0/2024062818 shutdown_connections 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 -- 172.21.15.2:0/2024062818 wait complete. 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.979+0000 7fec21411640 1 Processor -- start 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 -- start start 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 0x7fec1c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1159f0 con 0x7fec1c10ff80 2024-08-31T04:34:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c115870 con 0x7fec1c1023d0 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec21411640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c115b70 con 0x7fec1c102d20 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57604/0 (socket says 172.21.15.2:57604) 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1affd640 1 -- 172.21.15.2:0/342314032 learned_addr learned my addr 172.21.15.2:0/342314032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 0x7fec1c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1affd640 1 -- 172.21.15.2:0/342314032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 msgr2=0x7fec1c19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.980+0000 7fec1affd640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 0x7fec1c19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec1affd640 1 -- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 msgr2=0x7fec1c1a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec1affd640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec1affd640 1 -- 172.21.15.2:0/342314032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c1a22d0 con 0x7fec1c1023d0 2024-08-31T04:34:57.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec1affd640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9f0 tx=0x7fec0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec03fff640 1 -- 172.21.15.2:0/342314032 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00cd80 con 0x7fec1c1023d0 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c1a25c0 con 0x7fec1c1023d0 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec03fff640 1 -- 172.21.15.2:0/342314032 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec0c0108e0 con 0x7fec1c1023d0 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec03fff640 1 -- 172.21.15.2:0/342314032 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c018980 con 0x7fec1c1023d0 2024-08-31T04:34:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.981+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c1a8d20 con 0x7fec1c1023d0 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 Processor -- start 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 -- start start 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 0x5650a1e33850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e33d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a1daa680 con 0x5650a1a8e070 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5650a1d99c10 con 0x5650a1a651b0 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec27986740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5650a1d9dbc0 con 0x5650a1a6d390 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43648/0 (socket says 172.21.15.2:43648) 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 -- 172.21.15.2:0/1446465923 learned_addr learned my addr 172.21.15.2:0/1446465923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e33d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec03fff640 1 -- 172.21.15.2:0/342314032 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fec0c010430 con 0x7fec1c1023d0 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1affd640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 0x5650a1e33850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 -- 172.21.15.2:0/1446465923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 msgr2=0x5650a1e33d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e33d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.984+0000 7fec1b7fe640 1 -- 172.21.15.2:0/1446465923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 msgr2=0x5650a1e33850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 0x5650a1e33850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec1b7fe640 1 -- 172.21.15.2:0/1446465923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a1af9650 con 0x5650a1a8e070 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec1affd640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 0x5650a1e33850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:57.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fec14035000 tx=0x7fec140098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d32d9e7d6408e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec017fa640 1 -- 172.21.15.2:0/1446465923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14048070 con 0x5650a1a8e070 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec017fa640 1 -- 172.21.15.2:0/1446465923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec14003e20 con 0x5650a1a8e070 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec03fff640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 0x7fec040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec017fa640 1 -- 172.21.15.2:0/1446465923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14034040 con 0x5650a1a8e070 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.985+0000 7fec1affd640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 0x7fec040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec03fff640 1 -- 172.21.15.2:0/342314032 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fec0c0e5d30 con 0x7fec1c1023d0 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 -- 172.21.15.2:0/1446465923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 msgr2=0x5650a1e33310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fec14035000 tx=0x7fec140098b0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec1affd640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 0x7fec040b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5650a1e31f90 tx=0x7fec0c093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 -- 172.21.15.2:0/1446465923 shutdown_connections 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e33d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a651b0 0x5650a1e33850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 --2- 172.21.15.2:0/1446465923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a8e070 0x5650a1e33310 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 -- 172.21.15.2:0/1446465923 >> 172.21.15.2:0/1446465923 conn(0x5650a1a82460 msgr2=0x5650a1e31200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 -- 172.21.15.2:0/1446465923 shutdown_connections 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.986+0000 7fec27986740 1 -- 172.21.15.2:0/1446465923 wait complete. 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 -- start start 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 Processor -- start 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e3eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a8e070 0x5650a1e4ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a1bfc700 con 0x5650a1a651b0 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5650a1d20750 con 0x5650a1a8e070 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5650a1e41a90 con 0x5650a1a6d390 2024-08-31T04:34:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec27986740 10 client.0 _ll_register_callbacks cb 0x5650a1d4fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec1a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e3eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43664/0 (socket says 172.21.15.2:43664) 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec1b7fe640 1 -- 172.21.15.2:0/459726038 learned_addr learned my addr 172.21.15.2:0/459726038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.987+0000 7fec1a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e3eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:34988/0 (socket says 172.21.15.2:34988) 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a8e070 0x5650a1e4ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 -- 172.21.15.2:0/459726038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 msgr2=0x5650a1e3eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e3eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 -- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a8e070 msgr2=0x5650a1e4ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a8e070 0x5650a1e4ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 -- 172.21.15.2:0/459726038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a1d59900 con 0x5650a1a651b0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fec1402a990 tx=0x7fec1402fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8065bd7f2d9e4fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7febfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14053060 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec14003e20 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.988+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fec140042c0 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec1405a050 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 10 client.17037 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5650a1e4d790 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec14003e20 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fec14030b00 con 0x5650a1a651b0 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 10 client.17037 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 20 client.17037 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a4c9f0 0x5650a1e50af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 4 client.17037 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650a1dac5d0 con 0x5650a1a4c9f0 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.989+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a4c9f0 0x5650a1e50af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.990+0000 7febfeff5640 10 client.17037 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.990+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a4c9f0 0x5650a1e50af0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bb89b1c5abdc002 server_cookie=6a012bbd3dba525 in_seq=0 out_seq=0 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.990+0000 7febfeff5640 1 -- 172.21.15.2:0/459726038 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650a1dac5d0 con 0x5650a1a4c9f0 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.990+0000 7febfeff5640 10 client.17037 handle_command_reply: tid=0 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.990+0000 7fec27986740 1 client.17037 shutdown 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 msgr2=0x5650a1e3eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fec1402a990 tx=0x7fec1402fc20 comp rx=0 tx=0).stop 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 shutdown_connections 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a4c9f0 0x5650a1e50af0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a8e070 0x5650a1e4ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a6d390 0x5650a1e3eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 --2- 172.21.15.2:0/459726038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e3eab0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 >> 172.21.15.2:0/459726038 conn(0x5650a1a82460 msgr2=0x5650a1e364f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7febfeff5640 0 client.17037 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 shutdown_connections 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 1 -- 172.21.15.2:0/459726038 wait complete. 2024-08-31T04:34:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:57.991+0000 7fec27986740 20 client.17037 trim_cache size 0 max 16384 2024-08-31T04:34:58.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.005+0000 7fec27986740 1 Processor -- start 2024-08-31T04:34:58.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.005+0000 7fec27986740 1 -- start start 2024-08-31T04:34:58.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.005+0000 7fec27986740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec27986740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e4acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec27986740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e36410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec27986740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b5980 con 0x5650a1a651b0 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec27986740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b3220 con 0x5650a1a6d390 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec27986740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b1070 con 0x5650a1a8e070 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e4acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43680/0 (socket says 172.21.15.2:43680) 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1b7fe640 1 -- 172.21.15.2:0/3191078200 learned_addr learned my addr 172.21.15.2:0/3191078200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e36410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 -- 172.21.15.2:0/3191078200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 msgr2=0x5650a1e36410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e36410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 -- 172.21.15.2:0/3191078200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 msgr2=0x5650a1e31250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 -- 172.21.15.2:0/3191078200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a1e35600 con 0x5650a1a6d390 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.006+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e4acf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5650a1e41ac0 tx=0x7fec10010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134e0129ff252998 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.007+0000 7fec00ff9640 1 -- 172.21.15.2:0/3191078200 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10005220 con 0x5650a1a6d390 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.007+0000 7fec00ff9640 1 -- 172.21.15.2:0/3191078200 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec10004c50 con 0x5650a1a6d390 2024-08-31T04:34:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.007+0000 7fec00ff9640 1 -- 172.21.15.2:0/3191078200 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1001e7a0 con 0x5650a1a6d390 2024-08-31T04:34:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- 172.21.15.2:0/3191078200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 msgr2=0x5650a1e4acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e4acf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5650a1e41ac0 tx=0x7fec10010800 comp rx=0 tx=0).stop 2024-08-31T04:34:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- 172.21.15.2:0/3191078200 shutdown_connections 2024-08-31T04:34:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e36410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e4acf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 --2- 172.21.15.2:0/3191078200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e31250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- 172.21.15.2:0/3191078200 >> 172.21.15.2:0/3191078200 conn(0x5650a1a82460 msgr2=0x5650a1e30b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- 172.21.15.2:0/3191078200 shutdown_connections 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- 172.21.15.2:0/3191078200 wait complete. 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 -- start start 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.008+0000 7fec27986740 1 Processor -- start 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b16e0 con 0x5650a1a651b0 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b2b50 con 0x5650a1a6d390 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1b1db0 con 0x5650a1a8e070 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec27986740 10 client.0 _ll_register_callbacks cb 0x7fec14046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57648/0 (socket says 172.21.15.2:57648) 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43696/0 (socket says 172.21.15.2:43696) 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 -- 172.21.15.2:0/2467218485 learned_addr learned my addr 172.21.15.2:0/2467218485 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 -- 172.21.15.2:0/2467218485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 msgr2=0x5650a1e520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 -- 172.21.15.2:0/2467218485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 msgr2=0x5650a1e54490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 -- 172.21.15.2:0/2467218485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a1eba270 con 0x5650a1a6d390 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7fec1a7fc640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec10009fa0 tx=0x7fec10004ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448f1a810beef936 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.009+0000 7febfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10004a30 con 0x5650a1a6d390 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fec10004030 con 0x5650a1a6d390 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec10004c50 con 0x5650a1a6d390 2024-08-31T04:34:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec10036050 con 0x5650a1a6d390 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 10 client.26756 fetch_fsmap learned FSMap version 31 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5650a1ebb310 con 0x5650a1a6d390 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec10004c50 con 0x5650a1a6d390 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fec10003790 con 0x5650a1a6d390 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 10 client.26756 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 10 client.26756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 20 client.26756 populate_metadata read hostname 'smithi002' 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a21da0 0x5650a1ebda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 4 client.26756 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:34:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.010+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650a1da8070 con 0x5650a1a21da0 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a21da0 0x5650a1ebda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec1b7fe640 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a21da0 0x5650a1ebda30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c08a4d7c6f61e1 server_cookie=d3abc12f93848fd7 in_seq=0 out_seq=0 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7febfeff5640 10 client.26756 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7febfeff5640 1 -- 172.21.15.2:0/2467218485 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650a1da8070 con 0x5650a1a21da0 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7febfeff5640 10 client.26756 handle_command_reply: tid=0 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 client.26756 shutdown 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 msgr2=0x5650a1e519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec10009fa0 tx=0x7fec10004ef0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 shutdown_connections 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5650a1a21da0 0x5650a1ebda30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650a1a8e070 0x5650a1e520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5650a1a6d390 0x5650a1e519b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7febfeff5640 0 client.26756 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 --2- 172.21.15.2:0/2467218485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a1a651b0 0x5650a1e54490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.011+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 >> 172.21.15.2:0/2467218485 conn(0x5650a1a82460 msgr2=0x5650a1e36410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 shutdown_connections 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec27986740 1 -- 172.21.15.2:0/2467218485 wait complete. 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec27986740 20 client.26756 trim_cache size 0 max 16384 2024-08-31T04:34:58.020 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:34:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 msgr2=0x7fec040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 0x7fec040b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5650a1e31f90 tx=0x7fec0c093040 comp rx=0 tx=0).stop 2024-08-31T04:34:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 msgr2=0x7fec1c19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9f0 tx=0x7fec0c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 shutdown_connections 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fec040b4ca0 0x7fec040b71b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec1c10ff80 0x7fec1c1a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec1c102d20 0x7fec1c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 --2- 172.21.15.2:0/342314032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec1c1023d0 0x7fec1c19c360 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 >> 172.21.15.2:0/342314032 conn(0x7fec1c0794d0 msgr2=0x7fec1c101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 shutdown_connections 2024-08-31T04:34:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:34:58.012+0000 7fec21411640 1 -- 172.21.15.2:0/342314032 wait complete. 2024-08-31T04:34:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:34:58 smithi002 ceph-mon[18656]: pgmap v631: 129 pgs: 129 active+clean; 565 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 214 op/s 2024-08-31T04:34:58.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 982758 10.95 MB/sec execute 378 sec latency 88.552 ms 2024-08-31T04:34:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:34:58 smithi064 ceph-mon[22007]: pgmap v631: 129 pgs: 129 active+clean; 565 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 214 op/s 2024-08-31T04:34:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:34:58 smithi132 ceph-mon[22335]: pgmap v631: 129 pgs: 129 active+clean; 565 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 214 op/s 2024-08-31T04:34:59.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 984488 10.96 MB/sec execute 379 sec latency 18.734 ms 2024-08-31T04:35:00.126 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:35:00.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:35:00.409 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:00.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:00 smithi002 ceph-mon[18656]: pgmap v632: 129 pgs: 129 active+clean; 576 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:35:00.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 986309 10.95 MB/sec execute 380 sec latency 27.806 ms 2024-08-31T04:35:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:00 smithi064 ceph-mon[22007]: pgmap v632: 129 pgs: 129 active+clean; 576 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:35:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:00 smithi132 ceph-mon[22335]: pgmap v632: 129 pgs: 129 active+clean; 576 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T04:35:01.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 986399 10.92 MB/sec execute 381 sec latency 119.230 ms 2024-08-31T04:35:01.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 -- 172.21.15.2:0/2790810706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 msgr2=0x7f10a410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 --2- 172.21.15.2:0/2790810706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a410f300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f109c009ca0 tx=0x7f109c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 -- 172.21.15.2:0/2790810706 shutdown_connections 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 --2- 172.21.15.2:0/2790810706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a410f300 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 --2- 172.21.15.2:0/2790810706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4108180 0x7f10a4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 --2- 172.21.15.2:0/2790810706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4102840 0x7f10a4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 -- 172.21.15.2:0/2790810706 >> 172.21.15.2:0/2790810706 conn(0x7f10a4079580 msgr2=0x7f10a4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 -- 172.21.15.2:0/2790810706 shutdown_connections 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.465+0000 7f10a88ef640 1 -- 172.21.15.2:0/2790810706 wait complete. 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 Processor -- start 2024-08-31T04:35:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 -- start start 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 0x7f10a410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 0x7f10a41102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a4110810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4113860 con 0x7f10a4108ad0 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41136e0 con 0x7f10a4102840 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a88ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41139e0 con 0x7f10a4108180 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 0x7f10a41102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 0x7f10a410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 0x7f10a41102d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:35028/0 (socket says 172.21.15.2:35028) 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.466+0000 7f10a1d9b640 1 -- 172.21.15.2:0/341119659 learned_addr learned my addr 172.21.15.2:0/341119659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 -- 172.21.15.2:0/341119659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 msgr2=0x7f10a41102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 0x7f10a41102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a4110810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 -- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 msgr2=0x7f10a4110810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a4110810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 -- 172.21.15.2:0/341119659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a41a8430 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a4110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a259c640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 0x7f10a410fd90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f109400e9f0 tx=0x7f109400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10937fe640 1 -- 172.21.15.2:0/341119659 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109400ccc0 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a41a8720 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10937fe640 1 -- 172.21.15.2:0/341119659 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10940108e0 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.467+0000 7f10937fe640 1 -- 172.21.15.2:0/341119659 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094018880 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.468+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a8cb0 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.471+0000 7f10937fe640 1 -- 172.21.15.2:0/341119659 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1094010430 con 0x7f10a4102840 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.471+0000 7f10aee64740 1 Processor -- start 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.471+0000 7f10aee64740 1 -- start start 2024-08-31T04:35:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.471+0000 7f10aee64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.471+0000 7f10aee64740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82739cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10aee64740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 0x55fa8273a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10aee64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa826af5f0 con 0x55fa82393350 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10aee64740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fa8269eb80 con 0x55fa8236a490 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10aee64740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa826a2b30 con 0x55fa82372670 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43732/0 (socket says 172.21.15.2:43732) 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 -- 172.21.15.2:0/906316033 learned_addr learned my addr 172.21.15.2:0/906316033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 0x55fa8273a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a259c640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82739cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 -- 172.21.15.2:0/906316033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 msgr2=0x55fa8273a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10937fe640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 0x7f108c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 0x55fa8273a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 -- 172.21.15.2:0/906316033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 msgr2=0x55fa82739cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82739cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a2d9d640 1 -- 172.21.15.2:0/906316033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa823fe930 con 0x55fa82393350 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 0x55fa8273a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.472+0000 7f10937fe640 1 -- 172.21.15.2:0/341119659 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f10940e5db0 con 0x7f10a4102840 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.473+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7c7c327b8a6cfa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.473+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 0x7f108c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.473+0000 7f1090ff9640 1 -- 172.21.15.2:0/906316033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c049040 con 0x55fa82393350 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.473+0000 7f1090ff9640 1 -- 172.21.15.2:0/906316033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f109c036070 con 0x55fa82393350 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.473+0000 7f1090ff9640 1 -- 172.21.15.2:0/906316033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c004700 con 0x55fa82393350 2024-08-31T04:35:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- 172.21.15.2:0/906316033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 msgr2=0x55fa82739780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 0x7f108c0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f109c0094e0 tx=0x7f109c02fa30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c009800 comp rx=0 tx=0).stop 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- 172.21.15.2:0/906316033 shutdown_connections 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82372670 0x55fa8273a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82739cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 --2- 172.21.15.2:0/906316033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82393350 0x55fa82739780 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- 172.21.15.2:0/906316033 >> 172.21.15.2:0/906316033 conn(0x55fa82387740 msgr2=0x55fa82737670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- 172.21.15.2:0/906316033 shutdown_connections 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- 172.21.15.2:0/906316033 wait complete. 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.474+0000 7f10aee64740 1 -- start start 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 Processor -- start 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82744f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82393350 0x55fa827511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa82501890 con 0x55fa82372670 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fa82625790 con 0x55fa8236a490 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa82747f00 con 0x55fa82393350 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10aee64740 10 client.0 _ll_register_callbacks cb 0x55fa823aaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43740/0 (socket says 172.21.15.2:43740) 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 -- 172.21.15.2:0/2893654236 learned_addr learned my addr 172.21.15.2:0/2893654236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a259c640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82744f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82393350 0x55fa827511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 -- 172.21.15.2:0/2893654236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82393350 msgr2=0x55fa827511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82393350 0x55fa827511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 -- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 msgr2=0x55fa82744f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82744f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.475+0000 7f10a1d9b640 1 -- 172.21.15.2:0/2893654236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8265cf30 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f10980127d0 tx=0x7f1098012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5795e4b8055fa5a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098004050 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f10980041f0 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109c036070 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10980043f0 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f10aee64740 10 client.17052 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fa82753d60 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f109c036070 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.476+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f1098003b50 con 0x55fa82372670 2024-08-31T04:35:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 10 client.17052 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 20 client.17052 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82351cd0 0x55fa82757270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 4 client.17052 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa826b1540 con 0x55fa82351cd0 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10a259c640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82351cd0 0x55fa82757270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f1089ffb640 10 client.17052 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.477+0000 7f10a259c640 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82351cd0 0x55fa82757270 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935fa5fb8b980fe9 server_cookie=7ede19c953675b20 in_seq=0 out_seq=0 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.478+0000 7f1089ffb640 1 -- 172.21.15.2:0/2893654236 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa826b1540 con 0x55fa82351cd0 2024-08-31T04:35:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.478+0000 7f1089ffb640 10 client.17052 handle_command_reply: tid=0 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.478+0000 7f10aee64740 1 client.17052 shutdown 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.478+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 msgr2=0x55fa82745490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.478+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f10980127d0 tx=0x7f1098012c90 comp rx=0 tx=0).stop 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 shutdown_connections 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82351cd0 0x55fa82757270 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa82745490 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f1089ffb640 0 client.17052 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82393350 0x55fa827511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 --2- 172.21.15.2:0/2893654236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82744f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 >> 172.21.15.2:0/2893654236 conn(0x55fa82387740 msgr2=0x55fa8273c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 shutdown_connections 2024-08-31T04:35:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 1 -- 172.21.15.2:0/2893654236 wait complete. 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.479+0000 7f10aee64740 20 client.17052 trim_cache size 0 max 16384 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 Processor -- start 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 -- start start 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa8236a490 0x55fa827510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa82372670 0x55fa82751630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b5b30 con 0x55fa82351cd0 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b33d0 con 0x55fa82372670 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10aee64740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b1220 con 0x55fa8236a490 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10a259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10a259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43746/0 (socket says 172.21.15.2:43746) 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.500+0000 7f10a259c640 1 -- 172.21.15.2:0/100903281 learned_addr learned my addr 172.21.15.2:0/100903281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa82372670 0x55fa82751630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa8236a490 0x55fa827510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 -- 172.21.15.2:0/100903281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa8236a490 msgr2=0x55fa827510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa8236a490 0x55fa827510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 -- 172.21.15.2:0/100903281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa82372670 msgr2=0x55fa82751630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa82372670 0x55fa82751630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 -- 172.21.15.2:0/100903281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8273ba70 con 0x55fa82351cd0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f10a259c640 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10940abfc0 tx=0x7f10940e8240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e53a5e752142ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f108bfff640 1 -- 172.21.15.2:0/100903281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940b5350 con 0x55fa82351cd0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f108bfff640 1 -- 172.21.15.2:0/100903281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094010d90 con 0x55fa82351cd0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.501+0000 7f108bfff640 1 -- 172.21.15.2:0/100903281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940a79a0 con 0x55fa82351cd0 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- 172.21.15.2:0/100903281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 msgr2=0x55fa8273cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10940abfc0 tx=0x7f10940e8240 comp rx=0 tx=0).stop 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- 172.21.15.2:0/100903281 shutdown_connections 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa82372670 0x55fa82751630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa8236a490 0x55fa827510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 --2- 172.21.15.2:0/100903281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82351cd0 0x55fa8273cf90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- 172.21.15.2:0/100903281 >> 172.21.15.2:0/100903281 conn(0x55fa82387740 msgr2=0x55fa8273c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- 172.21.15.2:0/100903281 shutdown_connections 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- 172.21.15.2:0/100903281 wait complete. 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.502+0000 7f10aee64740 1 -- start start 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 Processor -- start 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82351cd0 0x55fa8274d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82749b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b1890 con 0x55fa82372670 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b2d00 con 0x55fa8236a490 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41b1f60 con 0x55fa82351cd0 2024-08-31T04:35:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10aee64740 10 client.0 _ll_register_callbacks cb 0x7f1098009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43758/0 (socket says 172.21.15.2:43758) 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 -- 172.21.15.2:0/2947452163 learned_addr learned my addr 172.21.15.2:0/2947452163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a1d9b640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82749b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a259c640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82351cd0 0x55fa8274d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 -- 172.21.15.2:0/2947452163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82351cd0 msgr2=0x55fa8274d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82351cd0 0x55fa8274d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 -- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 msgr2=0x55fa82749b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82749b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.503+0000 7f10a2d9d640 1 -- 172.21.15.2:0/2947452163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8274a580 con 0x55fa82372670 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f10a2d9d640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f109c009a60 tx=0x7f109c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820d170a4a96602 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f1089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c056040 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1094010d90 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7f109c031650 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f109c06b050 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f10aee64740 10 client.17058 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.504+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fa827c28c0 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094010d90 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f109c030ce0 con 0x55fa82372670 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 10 client.17058 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 20 client.17058 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82393350 0x55fa827c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 4 client.17058 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa82740b00 con 0x55fa82393350 2024-08-31T04:35:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.505+0000 7f10a259c640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82393350 0x55fa827c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.506+0000 7f1089ffb640 10 client.17058 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.506+0000 7f10a259c640 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82393350 0x55fa827c4da0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ab844076434a06 server_cookie=94498e1b80fd8a19 in_seq=0 out_seq=0 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.507+0000 7f1089ffb640 1 -- 172.21.15.2:0/2947452163 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa82740b00 con 0x55fa82393350 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.507+0000 7f1089ffb640 10 client.17058 handle_command_reply: tid=0 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 client.17058 shutdown 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 msgr2=0x55fa8274a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f109c009a60 tx=0x7f109c042000 comp rx=0 tx=0).stop 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 shutdown_connections 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa82393350 0x55fa827c4da0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa82372670 0x55fa8274a040 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa8236a490 0x55fa82749b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 --2- 172.21.15.2:0/2947452163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa82351cd0 0x55fa8274d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 >> 172.21.15.2:0/2947452163 conn(0x55fa82387740 msgr2=0x55fa8273a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f1089ffb640 0 client.17058 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "305858c7-0009-45a1-9134-382eb2814473", 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:35:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 shutdown_connections 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 1 -- 172.21.15.2:0/2947452163 wait complete. 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.508+0000 7f10aee64740 20 client.17058 trim_cache size 0 max 16384 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 msgr2=0x7f108c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 0x7f108c0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f109c0094e0 tx=0x7f109c02fa30 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 msgr2=0x7f10a410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 0x7f10a410fd90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f109400e9f0 tx=0x7f109400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 shutdown_connections 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f108c0b4ca0 0x7f108c0b71b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a4108ad0 0x7f10a4110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10a4108180 0x7f10a41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 --2- 172.21.15.2:0/341119659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10a4102840 0x7f10a410fd90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 >> 172.21.15.2:0/341119659 conn(0x7f10a4079580 msgr2=0x7f10a4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 shutdown_connections 2024-08-31T04:35:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:01.509+0000 7f10a88ef640 1 -- 172.21.15.2:0/341119659 wait complete. 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: pgmap v633: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 205 op/s 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:02 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:35:02.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 987990 10.92 MB/sec execute 382 sec latency 119.640 ms 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: pgmap v633: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 205 op/s 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:35:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:02 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: pgmap v633: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 205 op/s 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:02 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 -- 172.21.15.2:0/2763817993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad601050e0 msgr2=0x7fad6010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 --2- 172.21.15.2:0/2763817993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad601050e0 0x7fad6010d630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fad50009900 tx=0x7fad5002a410 comp rx=0 tx=0).stop 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 -- 172.21.15.2:0/2763817993 shutdown_connections 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 --2- 172.21.15.2:0/2763817993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 0x7fad601100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 --2- 172.21.15.2:0/2763817993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad601050e0 0x7fad6010d630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 --2- 172.21.15.2:0/2763817993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad60104790 0x7fad60104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 -- 172.21.15.2:0/2763817993 >> 172.21.15.2:0/2763817993 conn(0x7fad600794f0 msgr2=0x7fad60079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 -- 172.21.15.2:0/2763817993 shutdown_connections 2024-08-31T04:35:03.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.344+0000 7fad67f5e640 1 -- 172.21.15.2:0/2763817993 wait complete. 2024-08-31T04:35:03.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 Processor -- start 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 -- start start 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 0x7fad6019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 0x7fad6019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad60113850 con 0x7fad601050e0 2024-08-31T04:35:03.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad601136d0 con 0x7fad60104790 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad67f5e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad601139d0 con 0x7fad6010dbf0 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad65cfa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad654f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 0x7fad6019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad65cfa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57704/0 (socket says 172.21.15.2:57704) 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.345+0000 7fad65cfa640 1 -- 172.21.15.2:0/1241212144 learned_addr learned my addr 172.21.15.2:0/1241212144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad664fb640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 0x7fad6019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 -- 172.21.15.2:0/1241212144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 msgr2=0x7fad6019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 0x7fad6019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 -- 172.21.15.2:0/1241212144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 msgr2=0x7fad6019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 -- 172.21.15.2:0/1241212144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad601a0130 con 0x7fad601050e0 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad65cfa640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad654f9640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 0x7fad6019a760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fad5002a930 tx=0x7fad50031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad56ffd640 1 -- 172.21.15.2:0/1241212144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5003f070 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad601a03c0 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad56ffd640 1 -- 172.21.15.2:0/1241212144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad50004490 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad56ffd640 1 -- 172.21.15.2:0/1241212144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50048060 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.346+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601a0830 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 Processor -- start 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 -- start start 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad56ffd640 1 -- 172.21.15.2:0/1241212144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fad5003bc60 con 0x7fad601050e0 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b73800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b73d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4b5aea630 con 0x55d4b57ad390 2024-08-31T04:35:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d4b5ad9bc0 con 0x55d4b57ce070 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.349+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4b5addb70 con 0x55d4b57a51b0 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad664fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad654f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b73d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b73800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad664fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57708/0 (socket says 172.21.15.2:57708) 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad664fb640 1 -- 172.21.15.2:0/955388269 learned_addr learned my addr 172.21.15.2:0/955388269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 -- 172.21.15.2:0/955388269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 msgr2=0x55d4b5b732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 -- 172.21.15.2:0/955388269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 msgr2=0x55d4b5b73d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b73d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 -- 172.21.15.2:0/955388269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b5839650 con 0x55d4b57a51b0 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad664fb640 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad65cfa640 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b73800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0114f0 tx=0x7fad5c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a52271b05c4b9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad56ffd640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 0x7fad4c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad4bfff640 1 -- 172.21.15.2:0/955388269 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01e070 con 0x55d4b57a51b0 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad4bfff640 1 -- 172.21.15.2:0/955388269 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad5c0035f0 con 0x55d4b57a51b0 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.350+0000 7fad4bfff640 1 -- 172.21.15.2:0/955388269 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00f7c0 con 0x55d4b57a51b0 2024-08-31T04:35:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.351+0000 7fad664fb640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 0x7fad4c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.351+0000 7fad56ffd640 1 -- 172.21.15.2:0/1241212144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fad50105b80 con 0x7fad601050e0 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.351+0000 7fad6e4d3740 1 -- 172.21.15.2:0/955388269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 msgr2=0x55d4b5b73800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.351+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b73800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0114f0 tx=0x7fad5c0119b0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.351+0000 7fad664fb640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 0x7fad4c0b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fad58011830 tx=0x7fad58009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 -- 172.21.15.2:0/955388269 shutdown_connections 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b73800 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/955388269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ce070 0x55d4b5b732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 -- 172.21.15.2:0/955388269 >> 172.21.15.2:0/955388269 conn(0x55d4b57c2460 msgr2=0x55d4b5b711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 -- 172.21.15.2:0/955388269 shutdown_connections 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 -- 172.21.15.2:0/955388269 wait complete. 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 -- start start 2024-08-31T04:35:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.352+0000 7fad6e4d3740 1 Processor -- start 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 0x55d4b5b8f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4b593c700 con 0x55d4b57ce070 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d4b5a60700 con 0x55d4b57ad390 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4b5b85e00 con 0x55d4b57a51b0 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad6e4d3740 10 client.0 _ll_register_callbacks cb 0x55d4b5a8fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad664fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 0x55d4b5b8f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57712/0 (socket says 172.21.15.2:57712) 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad664fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 0x55d4b5b8f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43804/0 (socket says 172.21.15.2:43804) 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 -- 172.21.15.2:0/1137871752 learned_addr learned my addr 172.21.15.2:0/1137871752 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad65cfa640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 -- 172.21.15.2:0/1137871752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 msgr2=0x55d4b5b82d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 -- 172.21.15.2:0/1137871752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 msgr2=0x55d4b5b8f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 0x55d4b5b8f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 -- 172.21.15.2:0/1137871752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4b5a998b0 con 0x55d4b57ad390 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad654f9640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad500c9070 tx=0x7fad501091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8e0e8a9c837047 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.353+0000 7fad497fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50035030 con 0x55d4b57ad390 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fad501030e0 con 0x55d4b57ad390 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad5c0035f0 con 0x55d4b57ad390 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fad500c7cc0 con 0x55d4b57ad390 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 10 client.26786 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d4b5b91b40 con 0x55d4b57ad390 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad5c0035f0 con 0x55d4b57ad390 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fad5004b060 con 0x55d4b57ad390 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 10 client.26786 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 10 client.26786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 20 client.26786 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.354+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b578c9f0 0x55d4b5b94f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.355+0000 7fad6e4d3740 4 client.26786 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.355+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4b5aec580 con 0x55d4b578c9f0 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.355+0000 7fad65cfa640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b578c9f0 0x55d4b5b94f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.355+0000 7fad497fa640 10 client.26786 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.355+0000 7fad65cfa640 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b578c9f0 0x55d4b5b94f40 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e65da421021212f9 server_cookie=460b40440124ae1a in_seq=0 out_seq=0 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad497fa640 1 -- 172.21.15.2:0/1137871752 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4b5aec580 con 0x55d4b578c9f0 2024-08-31T04:35:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad497fa640 10 client.26786 handle_command_reply: tid=0 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 client.26786 shutdown 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 msgr2=0x55d4b5b832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad500c9070 tx=0x7fad501091a0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 shutdown_connections 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b578c9f0 0x55d4b5b94f40 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ce070 0x55d4b5b8f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57ad390 0x55d4b5b832c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/1137871752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad497fa640 0 client.26786 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.356+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 >> 172.21.15.2:0/1137871752 conn(0x55d4b57c2460 msgr2=0x55d4b5b74cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.357+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 shutdown_connections 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.357+0000 7fad6e4d3740 1 -- 172.21.15.2:0/1137871752 wait complete. 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.357+0000 7fad6e4d3740 20 client.26786 trim_cache size 0 max 16384 2024-08-31T04:35:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 Processor -- start 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 -- start start 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad601b1590 con 0x55d4b57ad390 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad601aee30 con 0x55d4b57a51b0 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.375+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad601acc80 con 0x55d4b578c9f0 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad664fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad664fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43816/0 (socket says 172.21.15.2:43816) 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad664fb640 1 -- 172.21.15.2:0/3167384626 learned_addr learned my addr 172.21.15.2:0/3167384626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad65cfa640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 -- 172.21.15.2:0/3167384626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 msgr2=0x55d4b5b711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 -- 172.21.15.2:0/3167384626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 msgr2=0x55d4b5b8f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 -- 172.21.15.2:0/3167384626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b5b81ce0 con 0x55d4b57a51b0 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad65cfa640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad664fb640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.376+0000 7fad654f9640 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad500c7e80 tx=0x7fad50000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a942bda6147d65a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.377+0000 7fad4b7fe640 1 -- 172.21.15.2:0/3167384626 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50035020 con 0x55d4b57a51b0 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.377+0000 7fad4b7fe640 1 -- 172.21.15.2:0/3167384626 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad500cc500 con 0x55d4b57a51b0 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.377+0000 7fad4b7fe640 1 -- 172.21.15.2:0/3167384626 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500cb570 con 0x55d4b57a51b0 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3167384626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 msgr2=0x55d4b5b82cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad500c7e80 tx=0x7fad50000bc0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3167384626 shutdown_connections 2024-08-31T04:35:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b8f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b82cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3167384626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3167384626 >> 172.21.15.2:0/3167384626 conn(0x55d4b57c2460 msgr2=0x55d4b5b70ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3167384626 shutdown_connections 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3167384626 wait complete. 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.378+0000 7fad6e4d3740 1 -- start start 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 Processor -- start 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b8b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ad2f0 con 0x55d4b57ad390 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ae760 con 0x55d4b57a51b0 2024-08-31T04:35:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ad9c0 con 0x55d4b578c9f0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad6e4d3740 10 client.0 _ll_register_callbacks cb 0x7fad50005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad654f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad664fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad654f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:57740/0 (socket says 172.21.15.2:57740) 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad654f9640 1 -- 172.21.15.2:0/3339525124 learned_addr learned my addr 172.21.15.2:0/3339525124 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.379+0000 7fad65cfa640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b8b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 -- 172.21.15.2:0/3339525124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 msgr2=0x55d4b5b8b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b8b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 -- 172.21.15.2:0/3339525124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 msgr2=0x55d4b5b87fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b87fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 -- 172.21.15.2:0/3339525124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4b5b884e0 con 0x55d4b57a51b0 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad664fb640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b87fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad654f9640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad500cbb00 tx=0x7fad50105e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea926d0ebc5a04c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.380+0000 7fad497fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.381+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50035070 con 0x55d4b57a51b0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.381+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9664+0+0 (secure 0 0 0) 0x7fad500c83f0 con 0x55d4b57a51b0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.381+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad500cc500 con 0x55d4b57a51b0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.389+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fad500cb750 con 0x55d4b57a51b0 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.391+0000 7fad6e4d3740 10 client.26792 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.391+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d4b5b884e0 con 0x55d4b57a51b0 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.393+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad500cc500 con 0x55d4b57a51b0 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.393+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fad500cc060 con 0x55d4b57a51b0 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.393+0000 7fad6e4d3740 10 client.26792 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.393+0000 7fad6e4d3740 10 client.26792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.394+0000 7fad6e4d3740 20 client.26792 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.394+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b57ce070 0x55d4b5c02830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.394+0000 7fad6e4d3740 4 client.26792 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.394+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4b5ae8020 con 0x55d4b57ce070 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.396+0000 7fad65cfa640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b57ce070 0x55d4b5c02830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.401+0000 7fad65cfa640 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b57ce070 0x55d4b5c02830 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3848d91e8c2a1b59 server_cookie=95af76320e362589 in_seq=0 out_seq=0 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.402+0000 7fad497fa640 10 client.26792 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.404+0000 7fad497fa640 1 -- 172.21.15.2:0/3339525124 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55d4b5ae8020 con 0x55d4b57ce070 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.404+0000 7fad497fa640 10 client.26792 handle_command_reply: tid=0 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.404+0000 7fad6e4d3740 1 client.26792 shutdown 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 msgr2=0x55d4b5b87a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad500cbb00 tx=0x7fad50105e90 comp rx=0 tx=0).stop 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 shutdown_connections 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55d4b57ce070 0x55d4b5c02830 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4b57ad390 0x55d4b5b87fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4b57a51b0 0x55d4b5b87a60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 --2- 172.21.15.2:0/3339525124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4b578c9f0 0x55d4b5b8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.405+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 >> 172.21.15.2:0/3339525124 conn(0x55d4b57c2460 msgr2=0x55d4b5b742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.406+0000 7fad497fa640 0 client.26792 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.406+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 shutdown_connections 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.406+0000 7fad6e4d3740 1 -- 172.21.15.2:0/3339525124 wait complete. 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.408+0000 7fad6e4d3740 20 client.26792 trim_cache size 0 max 16384 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:35:03.413 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "305858c7-0009-45a1-9134-382eb2814473", 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.414 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.415 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:35:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:35:03.420 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:03.422 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 msgr2=0x7fad4c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 0x7fad4c0b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fad58011830 tx=0x7fad58009500 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 msgr2=0x7fad6019a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 0x7fad6019a760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fad5002a930 tx=0x7fad50031a20 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 shutdown_connections 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fad4c0b4ca0 0x7fad4c0b71b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601050e0 0x7fad6019a760 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6010dbf0 0x7fad6019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 --2- 172.21.15.2:0/1241212144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad60104790 0x7fad6019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.412+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 >> 172.21.15.2:0/1241212144 conn(0x7fad600794f0 msgr2=0x7fad60100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.413+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 shutdown_connections 2024-08-31T04:35:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:03.413+0000 7fad67f5e640 1 -- 172.21.15.2:0/1241212144 wait complete. 2024-08-31T04:35:03.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 989176 10.91 MB/sec execute 383 sec latency 105.558 ms 2024-08-31T04:35:04.158 INFO:tasks.cephfs.filesystem:scrub status for tag:305858c7-0009-45a1-9134-382eb2814473 - {'path': '/', 'tag': '305858c7-0009-45a1-9134-382eb2814473', 'options': 'recursive,force'} 2024-08-31T04:35:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:04 smithi002 ceph-mon[18656]: pgmap v634: 129 pgs: 129 active+clean; 596 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2024-08-31T04:35:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:04 smithi002 ceph-mon[18656]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T04:35:04.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 991307 10.91 MB/sec execute 384 sec latency 47.232 ms 2024-08-31T04:35:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:04 smithi064 ceph-mon[22007]: pgmap v634: 129 pgs: 129 active+clean; 596 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2024-08-31T04:35:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:04 smithi064 ceph-mon[22007]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T04:35:04.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:04 smithi132 ceph-mon[22335]: pgmap v634: 129 pgs: 129 active+clean; 596 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2024-08-31T04:35:04.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:04 smithi132 ceph-mon[22335]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T04:35:05.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 992511 10.89 MB/sec execute 385 sec latency 31.078 ms 2024-08-31T04:35:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:06 smithi002 ceph-mon[18656]: pgmap v636: 129 pgs: 129 active+clean; 599 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 253 op/s 2024-08-31T04:35:06.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 994785 10.91 MB/sec execute 386 sec latency 29.641 ms 2024-08-31T04:35:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:06 smithi064 ceph-mon[22007]: pgmap v636: 129 pgs: 129 active+clean; 599 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 253 op/s 2024-08-31T04:35:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:06 smithi132 ceph-mon[22335]: pgmap v636: 129 pgs: 129 active+clean; 599 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 253 op/s 2024-08-31T04:35:07.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 995992 10.89 MB/sec execute 387 sec latency 32.286 ms 2024-08-31T04:35:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:08 smithi002 ceph-mon[18656]: pgmap v637: 129 pgs: 129 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 250 op/s 2024-08-31T04:35:08.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:08 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:35:08.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:08 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:35:08.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:08 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:08.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:08 smithi132 ceph-mon[22335]: pgmap v637: 129 pgs: 129 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 250 op/s 2024-08-31T04:35:08.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:08 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:35:08.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:08 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:35:08.668 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:08 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:08.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 998034 10.89 MB/sec execute 388 sec latency 128.488 ms 2024-08-31T04:35:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:08 smithi064 ceph-mon[22007]: pgmap v637: 129 pgs: 129 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 250 op/s 2024-08-31T04:35:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:08 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:35:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:08 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:35:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:08 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:09.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 998870 10.87 MB/sec execute 389 sec latency 40.400 ms 2024-08-31T04:35:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: pgmap v638: 129 pgs: 129 active+clean; 606 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 223 op/s 2024-08-31T04:35:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:10.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1000683 10.86 MB/sec execute 390 sec latency 54.984 ms 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: pgmap v638: 129 pgs: 129 active+clean; 606 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 223 op/s 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: pgmap v638: 129 pgs: 129 active+clean; 606 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 223 op/s 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:10.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:10.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:10.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:35:11.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1002257 10.87 MB/sec execute 391 sec latency 15.926 ms 2024-08-31T04:35:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:12 smithi002 ceph-mon[18656]: pgmap v639: 129 pgs: 129 active+clean; 614 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-08-31T04:35:12.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:12 smithi002 ceph-mon[18656]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T04:35:12.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1004300 10.86 MB/sec execute 392 sec latency 33.450 ms 2024-08-31T04:35:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:12 smithi064 ceph-mon[22007]: pgmap v639: 129 pgs: 129 active+clean; 614 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-08-31T04:35:12.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:12 smithi064 ceph-mon[22007]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T04:35:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:12 smithi132 ceph-mon[22335]: pgmap v639: 129 pgs: 129 active+clean; 614 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-08-31T04:35:12.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:12 smithi132 ceph-mon[22335]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T04:35:13.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1005738 10.86 MB/sec execute 393 sec latency 63.129 ms 2024-08-31T04:35:14.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:14 smithi002 ceph-mon[18656]: pgmap v641: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 239 op/s 2024-08-31T04:35:14.687 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1007304 10.85 MB/sec execute 394 sec latency 39.704 ms 2024-08-31T04:35:14.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:14 smithi064 ceph-mon[22007]: pgmap v641: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 239 op/s 2024-08-31T04:35:14.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:14 smithi132 ceph-mon[22335]: pgmap v641: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.3 MiB/s wr, 239 op/s 2024-08-31T04:35:15.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1009170 10.85 MB/sec execute 395 sec latency 18.699 ms 2024-08-31T04:35:16.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:16 smithi002 ceph-mon[18656]: pgmap v642: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 199 op/s 2024-08-31T04:35:16.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1010872 10.84 MB/sec execute 396 sec latency 47.353 ms 2024-08-31T04:35:16.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:16 smithi064 ceph-mon[22007]: pgmap v642: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 199 op/s 2024-08-31T04:35:16.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:16 smithi132 ceph-mon[22335]: pgmap v642: 129 pgs: 129 active+clean; 616 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 199 op/s 2024-08-31T04:35:17.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1012754 10.85 MB/sec execute 397 sec latency 20.869 ms 2024-08-31T04:35:18.619 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:18 smithi132 ceph-mon[22335]: pgmap v643: 129 pgs: 129 active+clean; 626 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:35:18.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:18 smithi002 ceph-mon[18656]: pgmap v643: 129 pgs: 129 active+clean; 626 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:35:18.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1014163 10.83 MB/sec execute 398 sec latency 82.900 ms 2024-08-31T04:35:18.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:18 smithi064 ceph-mon[22007]: pgmap v643: 129 pgs: 129 active+clean; 626 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:35:19.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1016160 10.84 MB/sec execute 399 sec latency 33.660 ms 2024-08-31T04:35:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:20 smithi002 ceph-mon[18656]: pgmap v644: 129 pgs: 129 active+clean; 620 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 217 op/s 2024-08-31T04:35:20.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1017671 10.83 MB/sec execute 400 sec latency 31.754 ms 2024-08-31T04:35:20.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:20 smithi064 ceph-mon[22007]: pgmap v644: 129 pgs: 129 active+clean; 620 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 217 op/s 2024-08-31T04:35:20.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:20 smithi132 ceph-mon[22335]: pgmap v644: 129 pgs: 129 active+clean; 620 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 217 op/s 2024-08-31T04:35:21.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1019702 10.83 MB/sec execute 401 sec latency 26.371 ms 2024-08-31T04:35:22.619 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:22 smithi064 ceph-mon[22007]: pgmap v645: 129 pgs: 129 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 180 op/s 2024-08-31T04:35:22.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:22 smithi002 ceph-mon[18656]: pgmap v645: 129 pgs: 129 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 180 op/s 2024-08-31T04:35:22.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1021220 10.82 MB/sec execute 402 sec latency 30.141 ms 2024-08-31T04:35:22.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:22 smithi132 ceph-mon[22335]: pgmap v645: 129 pgs: 129 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 180 op/s 2024-08-31T04:35:23.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1023140 10.82 MB/sec execute 403 sec latency 64.859 ms 2024-08-31T04:35:24.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:24 smithi002 ceph-mon[18656]: pgmap v646: 129 pgs: 129 active+clean; 581 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 206 op/s 2024-08-31T04:35:24.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1024078 10.80 MB/sec execute 404 sec latency 29.282 ms 2024-08-31T04:35:24.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:24 smithi064 ceph-mon[22007]: pgmap v646: 129 pgs: 129 active+clean; 581 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 206 op/s 2024-08-31T04:35:24.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:24 smithi132 ceph-mon[22335]: pgmap v646: 129 pgs: 129 active+clean; 581 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 206 op/s 2024-08-31T04:35:25.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1026512 10.81 MB/sec execute 405 sec latency 38.095 ms 2024-08-31T04:35:26.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:26 smithi002 ceph-mon[18656]: pgmap v647: 129 pgs: 129 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 200 op/s 2024-08-31T04:35:26.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1027612 10.80 MB/sec execute 406 sec latency 32.182 ms 2024-08-31T04:35:26.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:26 smithi064 ceph-mon[22007]: pgmap v647: 129 pgs: 129 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 200 op/s 2024-08-31T04:35:26.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:26 smithi132 ceph-mon[22335]: pgmap v647: 129 pgs: 129 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 200 op/s 2024-08-31T04:35:27.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1030048 10.80 MB/sec execute 407 sec latency 34.617 ms 2024-08-31T04:35:28.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:28 smithi002 ceph-mon[18656]: pgmap v648: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 252 op/s 2024-08-31T04:35:28.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1030942 10.79 MB/sec execute 408 sec latency 84.789 ms 2024-08-31T04:35:28.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:28 smithi064 ceph-mon[22007]: pgmap v648: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 252 op/s 2024-08-31T04:35:28.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:28 smithi132 ceph-mon[22335]: pgmap v648: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 252 op/s 2024-08-31T04:35:29.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1033008 10.79 MB/sec execute 409 sec latency 22.174 ms 2024-08-31T04:35:30.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:30 smithi002 ceph-mon[18656]: pgmap v649: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:35:30.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1034354 10.78 MB/sec execute 410 sec latency 29.385 ms 2024-08-31T04:35:30.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:30 smithi064 ceph-mon[22007]: pgmap v649: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:35:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:30 smithi132 ceph-mon[22335]: pgmap v649: 129 pgs: 129 active+clean; 594 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:35:31.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1036374 10.78 MB/sec execute 411 sec latency 29.414 ms 2024-08-31T04:35:32.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:32 smithi002 ceph-mon[18656]: pgmap v650: 129 pgs: 129 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 194 op/s 2024-08-31T04:35:32.688 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1037915 10.78 MB/sec execute 412 sec latency 16.587 ms 2024-08-31T04:35:32.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:32 smithi064 ceph-mon[22007]: pgmap v650: 129 pgs: 129 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 194 op/s 2024-08-31T04:35:32.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:32 smithi132 ceph-mon[22335]: pgmap v650: 129 pgs: 129 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 194 op/s 2024-08-31T04:35:33.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1039874 10.77 MB/sec execute 413 sec latency 50.042 ms 2024-08-31T04:35:34.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:35:34.429 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:34.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:34 smithi002 ceph-mon[18656]: pgmap v651: 129 pgs: 129 active+clean; 604 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T04:35:34.567 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:34 smithi064 ceph-mon[22007]: pgmap v651: 129 pgs: 129 active+clean; 604 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T04:35:34.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1041241 10.77 MB/sec execute 414 sec latency 18.549 ms 2024-08-31T04:35:34.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:34 smithi132 ceph-mon[22335]: pgmap v651: 129 pgs: 129 active+clean; 604 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T04:35:34.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 -- 172.21.15.2:0/3922833707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108a90 msgr2=0x7f853810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 --2- 172.21.15.2:0/3922833707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108a90 0x7f853810f2c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8530009ca0 tx=0x7f853002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 -- 172.21.15.2:0/3922833707 shutdown_connections 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 --2- 172.21.15.2:0/3922833707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108a90 0x7f853810f2c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 --2- 172.21.15.2:0/3922833707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538108140 0x7f8538108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 --2- 172.21.15.2:0/3922833707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538102800 0x7f8538102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 -- 172.21.15.2:0/3922833707 >> 172.21.15.2:0/3922833707 conn(0x7f85380794d0 msgr2=0x7f85380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 -- 172.21.15.2:0/3922833707 shutdown_connections 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 -- 172.21.15.2:0/3922833707 wait complete. 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.944+0000 7f853ec43640 1 Processor -- start 2024-08-31T04:35:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 -- start start 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538102800 0x7f853819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 0x7f853819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85381126f0 con 0x7f8538108140 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8538112570 con 0x7f8538108a90 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853ec43640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8538112870 con 0x7f8538102800 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f8537fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 0x7f853819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f8537fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48592/0 (socket says 172.21.15.2:48592) 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f8537fff640 1 -- 172.21.15.2:0/2303928441 learned_addr learned my addr 172.21.15.2:0/2303928441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853c9df640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538102800 0x7f853819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 -- 172.21.15.2:0/2303928441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538102800 msgr2=0x7f853819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538102800 0x7f853819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 -- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 msgr2=0x7f853819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f853d1e0640 1 -- 172.21.15.2:0/2303928441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85381a00e0 con 0x7f8538108a90 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.945+0000 7f8537fff640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f853d1e0640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 0x7f853819fa70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f853002ade0 tx=0x7f85300316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f8535ffb640 1 -- 172.21.15.2:0/2303928441 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530003b70 con 0x7f8538108a90 2024-08-31T04:35:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85381a0370 con 0x7f8538108a90 2024-08-31T04:35:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f8535ffb640 1 -- 172.21.15.2:0/2303928441 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8530003d10 con 0x7f8538108a90 2024-08-31T04:35:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f8535ffb640 1 -- 172.21.15.2:0/2303928441 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853002f9e0 con 0x7f8538108a90 2024-08-31T04:35:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.946+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85381a08b0 con 0x7f8538108a90 2024-08-31T04:35:34.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.949+0000 7f85451b8740 1 Processor -- start 2024-08-31T04:35:34.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f8535ffb640 1 -- 172.21.15.2:0/2303928441 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8530004040 con 0x7f8538108a90 2024-08-31T04:35:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 -- start start 2024-08-31T04:35:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 0x5562126ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x5562126efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556212666630 con 0x5562123211b0 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556212655bc0 con 0x55621234a070 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.950+0000 7f85451b8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556212659b70 con 0x556212329390 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f853c9df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 0x5562126ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:55630/0 (socket says 172.21.15.2:55630) 2024-08-31T04:35:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f853c9df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 0x5562126ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48594/0 (socket says 172.21.15.2:48594) 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 -- 172.21.15.2:0/2167143486 learned_addr learned my addr 172.21.15.2:0/2167143486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x5562126efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 -- 172.21.15.2:0/2167143486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 msgr2=0x5562126efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x5562126efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 -- 172.21.15.2:0/2167143486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 msgr2=0x5562126ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 0x5562126ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8535ffb640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 0x7f85280b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 -- 172.21.15.2:0/2167143486 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562123b5650 con 0x55621234a070 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 0x7f85280b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8535ffb640 1 -- 172.21.15.2:0/2303928441 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f8530106a60 con 0x7f8538108a90 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.951+0000 7f8537fff640 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8524011ba0 tx=0x7f852400ab40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dbc3050e51fca91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.952+0000 7f8522ffd640 1 -- 172.21.15.2:0/2167143486 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852400fc50 con 0x55621234a070 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.952+0000 7f8522ffd640 1 -- 172.21.15.2:0/2167143486 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852401e8e0 con 0x55621234a070 2024-08-31T04:35:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.952+0000 7f8522ffd640 1 -- 172.21.15.2:0/2167143486 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852401da80 con 0x55621234a070 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- 172.21.15.2:0/2167143486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 msgr2=0x5562126ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f8537fff640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 0x7f85280b71e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8524020040 tx=0x7f852401c710 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8524011ba0 tx=0x7f852400ab40 comp rx=0 tx=0).stop 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- 172.21.15.2:0/2167143486 shutdown_connections 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562123211b0 0x5562126ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x5562126efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 --2- 172.21.15.2:0/2167143486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55621234a070 0x5562126ef300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- 172.21.15.2:0/2167143486 >> 172.21.15.2:0/2167143486 conn(0x55621233e460 msgr2=0x5562126ed1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- 172.21.15.2:0/2167143486 shutdown_connections 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- 172.21.15.2:0/2167143486 wait complete. 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 -- start start 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.953+0000 7f85451b8740 1 Processor -- start 2024-08-31T04:35:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x5562126fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x55621270b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562124b8700 con 0x55621234a070 2024-08-31T04:35:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5562125dc700 con 0x556212329390 2024-08-31T04:35:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556212701ef0 con 0x5562123211b0 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f85451b8740 10 client.0 _ll_register_callbacks cb 0x55621260bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f8537fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x5562126fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:58888/0 (socket says 172.21.15.2:58888) 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 -- 172.21.15.2:0/2687701234 learned_addr learned my addr 172.21.15.2:0/2687701234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853d1e0640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x55621270b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 -- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 msgr2=0x5562126fafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x5562126fafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 -- 172.21.15.2:0/2687701234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 msgr2=0x55621270b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x55621270b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 -- 172.21.15.2:0/2687701234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562126158b0 con 0x5562123211b0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f853c9df640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f852c012740 tx=0x7f852c012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c336762c4c3a0572 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.954+0000 7f8517fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c00f920 con 0x5562123211b0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f852401e8e0 con 0x5562123211b0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f852c00fac0 con 0x5562123211b0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f852c00fcc0 con 0x5562123211b0 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 10 client.26611 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55621270dd10 con 0x5562123211b0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f852401e8e0 con 0x5562123211b0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f852c01c420 con 0x5562123211b0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 10 client.26611 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 10 client.26611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 20 client.26611 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562123089f0 0x5562127111e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 4 client.26611 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.955+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556212668580 con 0x5562123089f0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.956+0000 7f8537fff640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562123089f0 0x5562127111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.956+0000 7f8517fff640 10 client.26611 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.956+0000 7f8537fff640 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562123089f0 0x5562127111e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e96e8e070cb899b server_cookie=c68008f8e59d1d6e in_seq=0 out_seq=0 2024-08-31T04:35:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f8517fff640 1 -- 172.21.15.2:0/2687701234 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556212668580 con 0x5562123089f0 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f8517fff640 10 client.26611 handle_command_reply: tid=0 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 client.26611 shutdown 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 msgr2=0x5562126faa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f852c012740 tx=0x7f852c012c00 comp rx=0 tx=0).stop 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 shutdown_connections 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562123089f0 0x5562127111e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x55621270b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x5562126fafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f8517fff640 0 client.26611 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 --2- 172.21.15.2:0/2687701234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126faa60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 >> 172.21.15.2:0/2687701234 conn(0x55621233e460 msgr2=0x5562126f24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 shutdown_connections 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 1 -- 172.21.15.2:0/2687701234 wait complete. 2024-08-31T04:35:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.957+0000 7f85451b8740 20 client.26611 trim_cache size 0 max 16384 2024-08-31T04:35:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 Processor -- start 2024-08-31T04:35:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 -- start start 2024-08-31T04:35:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85381b16f0 con 0x55621234a070 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85381aef90 con 0x556212329390 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f85451b8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f85381acde0 con 0x5562123211b0 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f8537fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f8537fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:55648/0 (socket says 172.21.15.2:55648) 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f8537fff640 1 -- 172.21.15.2:0/3369186773 learned_addr learned my addr 172.21.15.2:0/3369186773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.979+0000 7f853d1e0640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 -- 172.21.15.2:0/3369186773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 msgr2=0x5562126ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f853c9df640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 -- 172.21.15.2:0/3369186773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 msgr2=0x5562126f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 -- 172.21.15.2:0/3369186773 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562126f99c0 con 0x556212329390 2024-08-31T04:35:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f853d1e0640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f853c9df640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.980+0000 7f8537fff640 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f852401f000 tx=0x7f852402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4bb0a44f456141d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.981+0000 7f85227fc640 1 -- 172.21.15.2:0/3369186773 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524040070 con 0x556212329390 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.981+0000 7f85227fc640 1 -- 172.21.15.2:0/3369186773 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8524005d70 con 0x556212329390 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.981+0000 7f85227fc640 1 -- 172.21.15.2:0/3369186773 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524005610 con 0x556212329390 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 -- 172.21.15.2:0/3369186773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 msgr2=0x55621270b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f852401f000 tx=0x7f852402a000 comp rx=0 tx=0).stop 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 -- 172.21.15.2:0/3369186773 shutdown_connections 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556212329390 0x55621270b0e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 --2- 172.21.15.2:0/3369186773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562123211b0 0x5562126ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.982+0000 7f85451b8740 1 -- 172.21.15.2:0/3369186773 >> 172.21.15.2:0/3369186773 conn(0x55621233e460 msgr2=0x5562126ecbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.983+0000 7f85451b8740 1 -- 172.21.15.2:0/3369186773 shutdown_connections 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.983+0000 7f85451b8740 1 -- 172.21.15.2:0/3369186773 wait complete. 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.983+0000 7f85451b8740 1 -- start start 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.983+0000 7f85451b8740 1 Processor -- start 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x556212707680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85381ad450 con 0x55621234a070 2024-08-31T04:35:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85381ae8c0 con 0x5562123211b0 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f85381adb20 con 0x556212329390 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:55654/0 (socket says 172.21.15.2:55654) 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 -- 172.21.15.2:0/4039617131 learned_addr learned my addr 172.21.15.2:0/4039617131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f85451b8740 10 client.0 _ll_register_callbacks cb 0x7f852c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853d1e0640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 -- 172.21.15.2:0/4039617131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 msgr2=0x556212707680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x556212707680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 -- 172.21.15.2:0/4039617131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 msgr2=0x5562126fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126fedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.984+0000 7f853c9df640 1 -- 172.21.15.2:0/4039617131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556212707d70 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f853c9df640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5562126fd2b0 tx=0x7f852c00f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af166e5516f4245b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f8517fff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c01cce0 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8524005d70 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f852c01c420 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f852c033050 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f85451b8740 10 client.26810 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.985+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556212780820 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8524005d70 con 0x5562123211b0 2024-08-31T04:35:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f852c003a00 con 0x5562123211b0 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 10 client.26810 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 10 client.26810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 20 client.26810 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562122ddda0 0x556212783030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 4 client.26810 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556212664020 con 0x5562122ddda0 2024-08-31T04:35:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.986+0000 7f8537fff640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562122ddda0 0x556212783030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.987+0000 7f8517fff640 10 client.26810 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.987+0000 7f8537fff640 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562122ddda0 0x556212783030 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1a2bcbb7fa23a48 server_cookie=5bc54eb77e520c46 in_seq=0 out_seq=0 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.987+0000 7f8517fff640 1 -- 172.21.15.2:0/4039617131 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x556212664020 con 0x5562122ddda0 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f8517fff640 10 client.26810 handle_command_reply: tid=0 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 client.26810 shutdown 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 msgr2=0x556212707140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5562126fd2b0 tx=0x7f852c00f810 comp rx=0 tx=0).stop 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 shutdown_connections 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5562122ddda0 0x556212783030 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55621234a070 0x5562126fedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556212329390 0x556212707680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f8517fff640 0 client.26810 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 --2- 172.21.15.2:0/4039617131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562123211b0 0x556212707140 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 >> 172.21.15.2:0/4039617131 conn(0x55621233e460 msgr2=0x5562126f0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 shutdown_connections 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 1 -- 172.21.15.2:0/4039617131 wait complete. 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.988+0000 7f85451b8740 20 client.26810 trim_cache size 0 max 16384 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:35:34.996 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:34.997 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:34.998 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:34.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.000 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:35:35.002 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:35:35.003 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.004 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:35.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:35.007 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 msgr2=0x7f85280b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 0x7f85280b71e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8524020040 tx=0x7f852401c710 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 msgr2=0x7f853819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 0x7f853819fa70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f853002ade0 tx=0x7f85300316f0 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 shutdown_connections 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f85280b4cd0 0x7f85280b71e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8538108140 0x7f853819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8538108a90 0x7f853819fa70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 --2- 172.21.15.2:0/2303928441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8538102800 0x7f853819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 >> 172.21.15.2:0/2303928441 conn(0x7f85380794d0 msgr2=0x7f853806af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 shutdown_connections 2024-08-31T04:35:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:34.989+0000 7f853ec43640 1 -- 172.21.15.2:0/2303928441 wait complete. 2024-08-31T04:35:35.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1043016 10.76 MB/sec execute 415 sec latency 41.705 ms 2024-08-31T04:35:35.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:35:35.802 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:35:36.099 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:36.491 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:36 smithi002 ceph-mon[18656]: pgmap v652: 129 pgs: 129 active+clean; 605 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T04:35:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 -- 172.21.15.2:0/2749504226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 msgr2=0x7f5a6010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 --2- 172.21.15.2:0/2749504226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6010f2c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ca0 tx=0x7f5a5802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 -- 172.21.15.2:0/2749504226 shutdown_connections 2024-08-31T04:35:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 --2- 172.21.15.2:0/2749504226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6010f2c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 --2- 172.21.15.2:0/2749504226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60108140 0x7f5a60108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 --2- 172.21.15.2:0/2749504226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60102800 0x7f5a60102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 -- 172.21.15.2:0/2749504226 >> 172.21.15.2:0/2749504226 conn(0x7f5a600794d0 msgr2=0x7f5a600798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 -- 172.21.15.2:0/2749504226 shutdown_connections 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.584+0000 7f5a665af640 1 -- 172.21.15.2:0/2749504226 wait complete. 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.585+0000 7f5a665af640 1 Processor -- start 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.585+0000 7f5a665af640 1 -- start start 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60102800 0x7f5a6019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60112710 con 0x7f5a60108a90 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60112590 con 0x7f5a60108140 2024-08-31T04:35:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a665af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60112890 con 0x7f5a60102800 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a64b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40138/0 (socket says 172.21.15.2:40138) 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60102800 0x7f5a6019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 -- 172.21.15.2:0/1113454988 learned_addr learned my addr 172.21.15.2:0/1113454988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a64b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6019fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60122/0 (socket says 172.21.15.2:60122) 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 -- 172.21.15.2:0/1113454988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60102800 msgr2=0x7f5a6019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60102800 0x7f5a6019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 -- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 msgr2=0x7f5a6019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 -- 172.21.15.2:0/1113454988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a601a0160 con 0x7f5a60108140 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.586+0000 7f5a5f7fe640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e9f0 tx=0x7f5a5400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.587+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400ccc0 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.587+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a601a0450 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.587+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a540054d0 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.587+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54010430 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.587+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a601a6bb0 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.588+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a60102c10 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.590+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5a540046c0 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.590+0000 7f5a5d7fa640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 0x7f5a480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.591+0000 7f5a5ffff640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 0x7f5a480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.591+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f5a540e5ee0 con 0x7f5a60108140 2024-08-31T04:35:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.591+0000 7f5a5ffff640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 0x7f5a480b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009bd0 tx=0x7f5a50005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.598+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5a54056130 con 0x7f5a60108140 2024-08-31T04:35:36.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1044702 10.77 MB/sec execute 416 sec latency 39.406 ms 2024-08-31T04:35:36.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:36 smithi064 ceph-mon[22007]: pgmap v652: 129 pgs: 129 active+clean; 605 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T04:35:36.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:36 smithi132 ceph-mon[22335]: pgmap v652: 129 pgs: 129 active+clean; 605 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T04:35:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.837+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a6019b320 con 0x7f5a60108140 2024-08-31T04:35:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.838+0000 7f5a5d7fa640 1 -- 172.21.15.2:0/1113454988 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11898 (secure 0 0 0) 0x7f5a540ac860 con 0x7f5a60108140 2024-08-31T04:35:36.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:35:36.840 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-08-31T04:34:29:339032+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:34:28.729383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:35:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 msgr2=0x7f5a480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 0x7f5a480b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009bd0 tx=0x7f5a50005f90 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 msgr2=0x7f5a6019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e9f0 tx=0x7f5a5400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 shutdown_connections 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5a480b4ca0 0x7f5a480b71b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a60108a90 0x7f5a6019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a60108140 0x7f5a6019a790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 --2- 172.21.15.2:0/1113454988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a60102800 0x7f5a6019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 >> 172.21.15.2:0/1113454988 conn(0x7f5a600794d0 msgr2=0x7f5a6006af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 shutdown_connections 2024-08-31T04:35:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:36.840+0000 7f5a665af640 1 -- 172.21.15.2:0/1113454988 wait complete. 2024-08-31T04:35:37.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:37 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1113454988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:35:37.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:35:37.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1046615 10.75 MB/sec execute 417 sec latency 26.374 ms 2024-08-31T04:35:37.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:37 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1113454988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:35:37.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:37 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1113454988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:35:37.875 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3552038159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108ab0 msgr2=0x7f56d810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3552038159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108ab0 0x7f56d810f2e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009ca0 tx=0x7f56d002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3552038159 shutdown_connections 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3552038159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108ab0 0x7f56d810f2e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3552038159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108160 0x7f56d8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3552038159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.439+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3552038159 >> 172.21.15.2:0/3552038159 conn(0x7f56d80794e0 msgr2=0x7f56d80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.440+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3552038159 shutdown_connections 2024-08-31T04:35:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.440+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3552038159 wait complete. 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.440+0000 7f56dfbc4640 1 Processor -- start 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.440+0000 7f56dfbc4640 1 -- start start 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 0x7f56d819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108ab0 0x7f56d819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8112730 con 0x7f56d8108160 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81125b0 con 0x7f56d8108ab0 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dfbc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81128b0 con 0x7f56d8102820 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd15f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 0x7f56d819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56de161640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108ab0 0x7f56d819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43438/0 (socket says 172.21.15.2:43438) 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 -- 172.21.15.2:0/3249107970 learned_addr learned my addr 172.21.15.2:0/3249107970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 -- 172.21.15.2:0/3249107970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108ab0 msgr2=0x7f56d819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108ab0 0x7f56d819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 -- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 msgr2=0x7f56d819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 0x7f56d819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 -- 172.21.15.2:0/3249107970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d81a0160 con 0x7f56d8102820 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd15f640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 0x7f56d819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.441+0000 7f56dd960640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56d400e9f0 tx=0x7f56d400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.442+0000 7f56ceffd640 1 -- 172.21.15.2:0/3249107970 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d400cd80 con 0x7f56d8102820 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.442+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d81a0450 con 0x7f56d8102820 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.442+0000 7f56ceffd640 1 -- 172.21.15.2:0/3249107970 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d40054d0 con 0x7f56d8102820 2024-08-31T04:35:38.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.442+0000 7f56ceffd640 1 -- 172.21.15.2:0/3249107970 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4010690 con 0x7f56d8102820 2024-08-31T04:35:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.442+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d81a6bb0 con 0x7f56d8102820 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.444+0000 7f56e6139740 1 Processor -- start 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.444+0000 7f56e6139740 1 -- start start 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.444+0000 7f56ceffd640 1 -- 172.21.15.2:0/3249107970 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f56d4004e90 con 0x7f56d8102820 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a100e49680 con 0x55a100b0c390 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a100e38c10 con 0x55a100b2d070 2024-08-31T04:35:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56e6139740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a100e3cbc0 con 0x55a100b041b0 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56dd960640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40162/0 (socket says 172.21.15.2:40162) 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 -- 172.21.15.2:0/1847908746 learned_addr learned my addr 172.21.15.2:0/1847908746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56dd15f640 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 -- 172.21.15.2:0/1847908746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 msgr2=0x55a100ed2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 -- 172.21.15.2:0/1847908746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 msgr2=0x55a100ed2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.445+0000 7f56de161640 1 -- 172.21.15.2:0/1847908746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a100b98650 con 0x55a100b2d070 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56de161640 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f56d002f410 tx=0x7f56d002f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bbf50956b8b306c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56c3fff640 1 -- 172.21.15.2:0/1847908746 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0031cf0 con 0x55a100b2d070 2024-08-31T04:35:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56c3fff640 1 -- 172.21.15.2:0/1847908746 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d0036030 con 0x55a100b2d070 2024-08-31T04:35:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56c3fff640 1 -- 172.21.15.2:0/1847908746 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d00042a0 con 0x55a100b2d070 2024-08-31T04:35:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56ceffd640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 0x7f56c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56ceffd640 1 -- 172.21.15.2:0/3249107970 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f56d40e5e00 con 0x7f56d8102820 2024-08-31T04:35:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.446+0000 7f56dd960640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 0x7f56c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 -- 172.21.15.2:0/1847908746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 msgr2=0x55a100ed2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f56d002f410 tx=0x7f56d002f440 comp rx=0 tx=0).stop 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56dd960640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 0x7f56c40b71b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55a100ed0f90 tx=0x7f56d40f4b80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 -- 172.21.15.2:0/1847908746 shutdown_connections 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 --2- 172.21.15.2:0/1847908746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ed2310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 -- 172.21.15.2:0/1847908746 >> 172.21.15.2:0/1847908746 conn(0x55a100b21460 msgr2=0x55a100ed0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 -- 172.21.15.2:0/1847908746 shutdown_connections 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.447+0000 7f56e6139740 1 -- 172.21.15.2:0/1847908746 wait complete. 2024-08-31T04:35:38.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 -- start start 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 Processor -- start 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100eddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 0x55a100ede2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ee3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a100c9b700 con 0x55a100b041b0 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a100dbf750 con 0x55a100b2d070 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a100ed86a0 con 0x55a100b0c390 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56e6139740 10 client.0 _ll_register_callbacks cb 0x55a100deee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56de161640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100eddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56de161640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100eddd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60144/0 (socket says 172.21.15.2:60144) 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56dd15f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 0x55a100ede2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56de161640 1 -- 172.21.15.2:0/1401758137 learned_addr learned my addr 172.21.15.2:0/1401758137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.448+0000 7f56de161640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ee3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 -- 172.21.15.2:0/1401758137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 msgr2=0x55a100ee3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ee3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 -- 172.21.15.2:0/1401758137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 msgr2=0x55a100eddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100eddd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 -- 172.21.15.2:0/1401758137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a100df8900 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56dd15f640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 0x55a100ede2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56d806b460 tx=0x7f56c800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a818849525a632 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8012110 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d0036030 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f56c8004050 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f56c8025050 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56e6139740 10 client.26629 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.449+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a100eec660 con 0x55a100b0c390 2024-08-31T04:35:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d0036030 con 0x55a100b0c390 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f56c8010430 con 0x55a100b0c390 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 10 client.26629 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 10 client.26629 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 20 client.26629 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100aeb9f0 0x55a100eefc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 4 client.26629 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a100e4b5d0 con 0x55a100aeb9f0 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56de161640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100aeb9f0 0x55a100eefc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.450+0000 7f56c17fa640 10 client.26629 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.451+0000 7f56de161640 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100aeb9f0 0x55a100eefc00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e915ee05994080e server_cookie=cd17cfcff83ce4fd in_seq=0 out_seq=0 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.451+0000 7f56c17fa640 1 -- 172.21.15.2:0/1401758137 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a100e4b5d0 con 0x55a100aeb9f0 2024-08-31T04:35:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.451+0000 7f56c17fa640 10 client.26629 handle_command_reply: tid=0 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.451+0000 7f56e6139740 1 client.26629 shutdown 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 msgr2=0x55a100ede2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 0x55a100ede2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56d806b460 tx=0x7f56c800f790 comp rx=0 tx=0).stop 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 shutdown_connections 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100aeb9f0 0x55a100eefc00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100ee3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b0c390 0x55a100ede2c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56c17fa640 0 client.26629 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 --2- 172.21.15.2:0/1401758137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100eddd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 >> 172.21.15.2:0/1401758137 conn(0x55a100b21460 msgr2=0x55a100ece7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 shutdown_connections 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 1 -- 172.21.15.2:0/1401758137 wait complete. 2024-08-31T04:35:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.452+0000 7f56e6139740 20 client.26629 trim_cache size 0 max 16384 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 Processor -- start 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 -- start start 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100edc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81b1610 con 0x55a100b0c390 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81aeeb0 con 0x55a100b2d070 2024-08-31T04:35:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56e6139740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81acd00 con 0x55a100b041b0 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56dd15f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.466+0000 7f56dd15f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60154/0 (socket says 172.21.15.2:60154) 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 -- 172.21.15.2:0/459051676 learned_addr learned my addr 172.21.15.2:0/459051676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56de161640 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56de161640 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100edc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 -- 172.21.15.2:0/459051676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 msgr2=0x55a100ed8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 -- 172.21.15.2:0/459051676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 msgr2=0x55a100edc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100edc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 -- 172.21.15.2:0/459051676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a100edc280 con 0x55a100b0c390 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56dd15f640 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f56c8012870 tx=0x7f56c80123a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d018a2cec27262c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56c37fe640 1 -- 172.21.15.2:0/459051676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c802e070 con 0x55a100b0c390 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56c37fe640 1 -- 172.21.15.2:0/459051676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c8005560 con 0x55a100b0c390 2024-08-31T04:35:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.467+0000 7f56c37fe640 1 -- 172.21.15.2:0/459051676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003850 con 0x55a100b0c390 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 -- 172.21.15.2:0/459051676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 msgr2=0x55a100ed9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f56c8012870 tx=0x7f56c80123a0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 -- 172.21.15.2:0/459051676 shutdown_connections 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b0c390 0x55a100ed9470 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b2d070 0x55a100edc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 --2- 172.21.15.2:0/459051676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b041b0 0x55a100ed8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 -- 172.21.15.2:0/459051676 >> 172.21.15.2:0/459051676 conn(0x55a100b21460 msgr2=0x55a100ece7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 -- 172.21.15.2:0/459051676 shutdown_connections 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.468+0000 7f56e6139740 1 -- 172.21.15.2:0/459051676 wait complete. 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 -- start start 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 Processor -- start 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b0c390 0x55a100ed1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b2d070 0x55a100ee7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81ad370 con 0x55a100b041b0 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81ae7e0 con 0x55a100b0c390 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.469+0000 7f56e6139740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81ada40 con 0x55a100b2d070 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56e6139740 10 client.0 _ll_register_callbacks cb 0x7f56c8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60158/0 (socket says 172.21.15.2:60158) 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 -- 172.21.15.2:0/3849460393 learned_addr learned my addr 172.21.15.2:0/3849460393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56dd15f640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b0c390 0x55a100ed1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b2d070 0x55a100ee7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 -- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b2d070 msgr2=0x55a100ee7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b2d070 0x55a100ee7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 -- 172.21.15.2:0/3849460393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b0c390 msgr2=0x55a100ed1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b0c390 0x55a100ed1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 -- 172.21.15.2:0/3849460393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a100ee7e80 con 0x55a100b041b0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56de161640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f56d002ade0 tx=0x7f56c80128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10ee3a28ccd5b67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0031660 con 0x55a100b041b0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f56d0031800 con 0x55a100b041b0 2024-08-31T04:35:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.470+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c8005560 con 0x55a100b041b0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f56d0004b40 con 0x55a100b041b0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 10 client.17118 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a100f5aca0 con 0x55a100b041b0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c8005560 con 0x55a100b041b0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f56d0043070 con 0x55a100b041b0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 10 client.17118 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 10 client.17118 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 20 client.17118 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100ac0da0 0x55a100f5d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 4 client.17118 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a100e47070 con 0x55a100ac0da0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.471+0000 7f56dd15f640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100ac0da0 0x55a100f5d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56dd15f640 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100ac0da0 0x55a100f5d050 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c313ec0b158f34c5 server_cookie=a50d7067966a2ae9 in_seq=0 out_seq=0 2024-08-31T04:35:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56c17fa640 10 client.17118 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56c17fa640 1 -- 172.21.15.2:0/3849460393 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a100e47070 con 0x55a100ac0da0 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56c17fa640 10 client.17118 handle_command_reply: tid=0 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 client.17118 shutdown 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 msgr2=0x55a100ed1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f56d002ade0 tx=0x7f56c80128a0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 shutdown_connections 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x55a100ac0da0 0x55a100f5d050 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a100b2d070 0x55a100ee7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a100b0c390 0x55a100ed1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 --2- 172.21.15.2:0/3849460393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a100b041b0 0x55a100ed1430 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56c17fa640 0 client.17118 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 >> 172.21.15.2:0/3849460393 conn(0x55a100b21460 msgr2=0x55a100ece7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 shutdown_connections 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 1 -- 172.21.15.2:0/3849460393 wait complete. 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.472+0000 7f56e6139740 20 client.17118 trim_cache size 0 max 16384 2024-08-31T04:35:38.479 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 msgr2=0x7f56c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 0x7f56c40b71b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55a100ed0f90 tx=0x7f56d40f4b80 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 msgr2=0x7f56d819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56d400e9f0 tx=0x7f56d400edf0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 shutdown_connections 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f56c40b4ca0 0x7f56c40b71b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56d8108160 0x7f56d819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d8108ab0 0x7f56d819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 --2- 172.21.15.2:0/3249107970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56d8102820 0x7f56d819a1f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 >> 172.21.15.2:0/3249107970 conn(0x7f56d80794e0 msgr2=0x7f56d806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 shutdown_connections 2024-08-31T04:35:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:38.473+0000 7f56dfbc4640 1 -- 172.21.15.2:0/3249107970 wait complete. 2024-08-31T04:35:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:38 smithi002 ceph-mon[18656]: pgmap v653: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2024-08-31T04:35:38.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1048250 10.76 MB/sec execute 418 sec latency 41.800 ms 2024-08-31T04:35:38.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:38 smithi064 ceph-mon[22007]: pgmap v653: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2024-08-31T04:35:38.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:38 smithi132 ceph-mon[22335]: pgmap v653: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2024-08-31T04:35:39.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:35:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:39.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1049668 10.75 MB/sec execute 419 sec latency 27.729 ms 2024-08-31T04:35:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 -- 172.21.15.2:0/151291213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 msgr2=0x7f84f0104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 --2- 172.21.15.2:0/151291213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f0104be0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009900 tx=0x7f84e002a410 comp rx=0 tx=0).stop 2024-08-31T04:35:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 -- 172.21.15.2:0/151291213 shutdown_connections 2024-08-31T04:35:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 --2- 172.21.15.2:0/151291213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 0x7f84f01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 --2- 172.21.15.2:0/151291213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 --2- 172.21.15.2:0/151291213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f0104be0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 -- 172.21.15.2:0/151291213 >> 172.21.15.2:0/151291213 conn(0x7f84f0079500 msgr2=0x7f84f0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 -- 172.21.15.2:0/151291213 shutdown_connections 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.100+0000 7f84f54fb640 1 -- 172.21.15.2:0/151291213 wait complete. 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.101+0000 7f84f54fb640 1 Processor -- start 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 -- start start 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 0x7f84f019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0113840 con 0x7f84f01047d0 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01136c0 con 0x7f84f0105120 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84f54fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01139c0 con 0x7f84f010dc00 2024-08-31T04:35:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60180/0 (socket says 172.21.15.2:60180) 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84eeffd640 1 -- 172.21.15.2:0/4222201511 learned_addr learned my addr 172.21.15.2:0/4222201511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 0x7f84f019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 -- 172.21.15.2:0/4222201511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 msgr2=0x7f84f019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 0x7f84f019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 -- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 msgr2=0x7f84f019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.102+0000 7f84ee7fc640 1 -- 172.21.15.2:0/4222201511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f01a01e0 con 0x7f84f0105120 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f019a810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84f006b6b0 tx=0x7f84e400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84d7fff640 1 -- 172.21.15.2:0/4222201511 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e400cd00 con 0x7f84f0105120 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84d7fff640 1 -- 172.21.15.2:0/4222201511 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e40035f0 con 0x7f84f0105120 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f01a04d0 con 0x7f84f0105120 2024-08-31T04:35:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84d7fff640 1 -- 172.21.15.2:0/4222201511 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4010690 con 0x7f84f0105120 2024-08-31T04:35:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.103+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a6c30 con 0x7f84f0105120 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84d7fff640 1 -- 172.21.15.2:0/4222201511 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f84e40037a0 con 0x7f84f0105120 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 Processor -- start 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 -- start start 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c88310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c88d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564906bff680 con 0x5649068c2390 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.106+0000 7f84fba70740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564906beec10 con 0x5649068e3070 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84fba70740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564906bf2bc0 con 0x5649068ba1b0 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c88310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43494/0 (socket says 172.21.15.2:43494) 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 -- 172.21.15.2:0/2283604709 learned_addr learned my addr 172.21.15.2:0/2283604709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84d7fff640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 0x7f84d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 -- 172.21.15.2:0/2283604709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 msgr2=0x564906c88310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c88310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 -- 172.21.15.2:0/2283604709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 msgr2=0x564906c88d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c88d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 -- 172.21.15.2:0/2283604709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490694e650 con 0x5649068ba1b0 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 0x7f84d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84d7fff640 1 -- 172.21.15.2:0/4222201511 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f84e40e5bf0 con 0x7f84f0105120 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.107+0000 7f84eeffd640 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009690 tx=0x7f84e0031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4c1b341dee3a08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.108+0000 7f84d57fa640 1 -- 172.21.15.2:0/2283604709 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0035040 con 0x5649068ba1b0 2024-08-31T04:35:40.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.108+0000 7f84d57fa640 1 -- 172.21.15.2:0/2283604709 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e0031760 con 0x5649068ba1b0 2024-08-31T04:35:40.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.108+0000 7f84d57fa640 1 -- 172.21.15.2:0/2283604709 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0004a00 con 0x5649068ba1b0 2024-08-31T04:35:40.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- 172.21.15.2:0/2283604709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 msgr2=0x564906c88850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009690 tx=0x7f84e0031b10 comp rx=0 tx=0).stop 2024-08-31T04:35:40.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 0x7f84d80b71b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009fd0 tx=0x7f84e8004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- 172.21.15.2:0/2283604709 shutdown_connections 2024-08-31T04:35:40.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068ba1b0 0x564906c88850 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- 172.21.15.2:0/2283604709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c88310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- 172.21.15.2:0/2283604709 >> 172.21.15.2:0/2283604709 conn(0x5649068d7460 msgr2=0x564906c86200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- 172.21.15.2:0/2283604709 shutdown_connections 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- 172.21.15.2:0/2283604709 wait complete. 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 -- start start 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 Processor -- start 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.109+0000 7f84fba70740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906ca40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84fba70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564906a51700 con 0x5649068ba1b0 2024-08-31T04:35:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84fba70740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564906b75750 con 0x5649068e3070 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84fba70740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564906c9adc0 con 0x5649068c2390 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84fba70740 10 client.0 _ll_register_callbacks cb 0x564906ba4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60192/0 (socket says 172.21.15.2:60192) 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84eeffd640 1 -- 172.21.15.2:0/856479722 learned_addr learned my addr 172.21.15.2:0/856479722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906ca40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 -- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 msgr2=0x564906ca40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906ca40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 -- 172.21.15.2:0/856479722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 msgr2=0x564906c97e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 -- 172.21.15.2:0/856479722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564906bae900 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84eeffd640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c983b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e40e2ed0 tx=0x7f84e40a7df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ac88a04fcb0bb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4009460 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f84e40e3150 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.110+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e0031760 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f84e40e3350 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 10 client.26647 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564906ca6c00 con 0x5649068c2390 2024-08-31T04:35:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e0031760 con 0x5649068c2390 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f84e40930d0 con 0x5649068c2390 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 10 client.26647 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 10 client.26647 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 20 client.26647 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5649068a19f0 0x564906caa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 4 client.26647 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564906c015d0 con 0x5649068a19f0 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.111+0000 7f84eeffd640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5649068a19f0 0x564906caa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.112+0000 7f84d2ff5640 10 client.26647 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.112+0000 7f84eeffd640 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5649068a19f0 0x564906caa060 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac54fce04dfa76b5 server_cookie=ceb197f3a01aeb64 in_seq=0 out_seq=0 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84d2ff5640 1 -- 172.21.15.2:0/856479722 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564906c015d0 con 0x5649068a19f0 2024-08-31T04:35:40.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84d2ff5640 10 client.26647 handle_command_reply: tid=0 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 client.26647 shutdown 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 msgr2=0x564906c983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c983b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e40e2ed0 tx=0x7f84e40a7df0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 shutdown_connections 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906ca40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c983b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x5649068a19f0 0x564906caa060 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 --2- 172.21.15.2:0/856479722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906c97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 >> 172.21.15.2:0/856479722 conn(0x5649068d7460 msgr2=0x564906c8b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84d2ff5640 0 client.26647 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 shutdown_connections 2024-08-31T04:35:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 1 -- 172.21.15.2:0/856479722 wait complete. 2024-08-31T04:35:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.113+0000 7f84fba70740 20 client.26647 trim_cache size 0 max 16384 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 Processor -- start 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 -- start start 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 0x564906c99d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068e3070 0x564906c857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01b1740 con 0x5649068c2390 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01aefe0 con 0x5649068ba1b0 2024-08-31T04:35:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84fba70740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ace30 con 0x5649068e3070 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.128+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 0x564906c99d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60208/0 (socket says 172.21.15.2:60208) 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 -- 172.21.15.2:0/1159033802 learned_addr learned my addr 172.21.15.2:0/1159033802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 0x564906c99d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40252/0 (socket says 172.21.15.2:40252) 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068e3070 0x564906c857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 -- 172.21.15.2:0/1159033802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068e3070 msgr2=0x564906c857d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068e3070 0x564906c857d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 -- 172.21.15.2:0/1159033802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 msgr2=0x564906c99d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 0x564906c99d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 -- 172.21.15.2:0/1159033802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564906caa580 con 0x5649068c2390 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f84e40a90e0 tx=0x7f84e400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc7a47544e3f0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84d4ff9640 1 -- 172.21.15.2:0/1159033802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e40ab7c0 con 0x5649068c2390 2024-08-31T04:35:40.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84d4ff9640 1 -- 172.21.15.2:0/1159033802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e40971f0 con 0x5649068c2390 2024-08-31T04:35:40.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.129+0000 7f84d4ff9640 1 -- 172.21.15.2:0/1159033802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e40e93d0 con 0x5649068c2390 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 -- 172.21.15.2:0/1159033802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 msgr2=0x564906c89a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f84e40a90e0 tx=0x7f84e400c750 comp rx=0 tx=0).stop 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 -- 172.21.15.2:0/1159033802 shutdown_connections 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068c2390 0x564906c89a50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068e3070 0x564906c857d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 --2- 172.21.15.2:0/1159033802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068ba1b0 0x564906c99d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 -- 172.21.15.2:0/1159033802 >> 172.21.15.2:0/1159033802 conn(0x5649068d7460 msgr2=0x564906c89340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 -- 172.21.15.2:0/1159033802 shutdown_connections 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.130+0000 7f84fba70740 1 -- 172.21.15.2:0/1159033802 wait complete. 2024-08-31T04:35:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 -- start start 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 Processor -- start 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c9bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ad4a0 con 0x5649068ba1b0 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ae910 con 0x5649068e3070 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01adb70 con 0x5649068c2390 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84fba70740 10 client.0 _ll_register_callbacks cb 0x7f84e4003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60210/0 (socket says 172.21.15.2:60210) 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84eeffd640 1 -- 172.21.15.2:0/644506687 learned_addr learned my addr 172.21.15.2:0/644506687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c9bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.131+0000 7f84ef7fe640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 -- 172.21.15.2:0/644506687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 msgr2=0x564906c9bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c9bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 -- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 msgr2=0x564906c9c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c9c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 -- 172.21.15.2:0/644506687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564906c9c770 con 0x5649068ba1b0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84eeffd640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f84e0034040 tx=0x7f84e0005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4c7c3b5daf0a63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0035040 con 0x5649068ba1b0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f84e0004450 con 0x5649068ba1b0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e40971f0 con 0x5649068ba1b0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f84e0065050 con 0x5649068ba1b0 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84fba70740 10 client.17136 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564906d14850 con 0x5649068ba1b0 2024-08-31T04:35:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.132+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e40971f0 con 0x5649068ba1b0 2024-08-31T04:35:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f84e0057460 con 0x5649068ba1b0 2024-08-31T04:35:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 10 client.17136 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 10 client.17136 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:35:40.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 20 client.17136 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:40.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564906876da0 0x564906d16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 4 client.17136 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564906c987e0 con 0x564906876da0 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564906876da0 0x564906d16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84ee7fc640 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564906876da0 0x564906d16cb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cdecb1d5a5834e3 server_cookie=b080f0b88076c112 in_seq=0 out_seq=0 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84d2ff5640 10 client.17136 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84d2ff5640 1 -- 172.21.15.2:0/644506687 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564906c987e0 con 0x564906876da0 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84d2ff5640 10 client.17136 handle_command_reply: tid=0 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.133+0000 7f84fba70740 1 client.17136 shutdown 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 msgr2=0x564906ca0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f84e0034040 tx=0x7f84e0005420 comp rx=0 tx=0).stop 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 shutdown_connections 2024-08-31T04:35:40.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5649068e3070 0x564906c9c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5649068c2390 0x564906c9bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564906876da0 0x564906d16cb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 --2- 172.21.15.2:0/644506687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649068ba1b0 0x564906ca0710 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84d2ff5640 0 client.17136 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 >> 172.21.15.2:0/644506687 conn(0x5649068d7460 msgr2=0x564906c99af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 shutdown_connections 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 1 -- 172.21.15.2:0/644506687 wait complete. 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84fba70740 20 client.17136 trim_cache size 0 max 16384 2024-08-31T04:35:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:35:40.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 msgr2=0x7f84d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 0x7f84d80b71b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009fd0 tx=0x7f84e8004a40 comp rx=0 tx=0).stop 2024-08-31T04:35:40.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 msgr2=0x7f84f019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:40.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.134+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f019a810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84f006b6b0 tx=0x7f84e400ee50 comp rx=0 tx=0).stop 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 shutdown_connections 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f010dc00 0x7f84f019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84f0105120 0x7f84f019a810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f84d80b4ca0 0x7f84d80b71b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 --2- 172.21.15.2:0/4222201511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84f01047d0 0x7f84f019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 >> 172.21.15.2:0/4222201511 conn(0x7f84f0079500 msgr2=0x7f84f0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 shutdown_connections 2024-08-31T04:35:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:40.135+0000 7f84f54fb640 1 -- 172.21.15.2:0/4222201511 wait complete. 2024-08-31T04:35:40.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:40 smithi002 ceph-mon[18656]: pgmap v654: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-08-31T04:35:40.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1051625 10.75 MB/sec execute 420 sec latency 50.552 ms 2024-08-31T04:35:40.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:40 smithi064 ceph-mon[22007]: pgmap v654: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-08-31T04:35:40.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:40 smithi132 ceph-mon[22335]: pgmap v654: 129 pgs: 129 active+clean; 612 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-08-31T04:35:40.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:35:41.155 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:41.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1053027 10.74 MB/sec execute 421 sec latency 43.039 ms 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 -- 172.21.15.2:0/3345610106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108a90 msgr2=0x7fbfb010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 --2- 172.21.15.2:0/3345610106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108a90 0x7fbfb010f2c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009ca0 tx=0x7fbfa802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 -- 172.21.15.2:0/3345610106 shutdown_connections 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 --2- 172.21.15.2:0/3345610106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108a90 0x7fbfb010f2c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 --2- 172.21.15.2:0/3345610106 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0108140 0x7fbfb0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 --2- 172.21.15.2:0/3345610106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0102800 0x7fbfb0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 -- 172.21.15.2:0/3345610106 >> 172.21.15.2:0/3345610106 conn(0x7fbfb00794d0 msgr2=0x7fbfb00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 -- 172.21.15.2:0/3345610106 shutdown_connections 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.684+0000 7fbfb602b640 1 -- 172.21.15.2:0/3345610106 wait complete. 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 Processor -- start 2024-08-31T04:35:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 -- start start 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 0x7fbfb019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 0x7fbfb019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 0x7fbfb01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01126f0 con 0x7fbfb0108140 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0112570 con 0x7fbfb0102800 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfb602b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0112870 con 0x7fbfb0108a90 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 0x7fbfb019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 0x7fbfb019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 0x7fbfb01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 0x7fbfb019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40290/0 (socket says 172.21.15.2:40290) 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.685+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/1704784225 learned_addr learned my addr 172.21.15.2:0/1704784225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 -- 172.21.15.2:0/1704784225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 msgr2=0x7fbfb019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 0x7fbfb019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 -- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 msgr2=0x7fbfb019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 0x7fbfb019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 -- 172.21.15.2:0/1704784225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb01a23e0 con 0x7fbfb0108a90 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 0x7fbfb019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfaffff640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 0x7fbfb01a1cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfa802ade0 tx=0x7fbfa8031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfacff9640 1 -- 172.21.15.2:0/1704784225 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8003b70 con 0x7fbfb0108a90 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfacff9640 1 -- 172.21.15.2:0/1704784225 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa8031910 con 0x7fbfb0108a90 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfacff9640 1 -- 172.21.15.2:0/1704784225 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa802f950 con 0x7fbfb0108a90 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb01a2670 con 0x7fbfb0108a90 2024-08-31T04:35:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.686+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01a8e30 con 0x7fbfb0108a90 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 Processor -- start 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfacff9640 1 -- 172.21.15.2:0/1704784225 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbfa802faf0 con 0x7fbfb0108a90 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 -- start start 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c28850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.689+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560105b9f680 con 0x56010585a1b0 2024-08-31T04:35:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560105b8ec10 con 0x560105883070 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560105b92bc0 con 0x560105862390 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40294/0 (socket says 172.21.15.2:40294) 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 -- 172.21.15.2:0/3746367734 learned_addr learned my addr 172.21.15.2:0/3746367734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c28850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 -- 172.21.15.2:0/3746367734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 msgr2=0x560105c28d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c28d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 -- 172.21.15.2:0/3746367734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 msgr2=0x560105c28850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c28850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 -- 172.21.15.2:0/3746367734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601058ee650 con 0x560105883070 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfacff9640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 0x7fbf980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4011b20 tx=0x7fbfa4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b68b310801b6c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 0x7fbf980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbfacff9640 1 -- 172.21.15.2:0/1704784225 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fbfa8106a20 con 0x7fbfb0108a90 2024-08-31T04:35:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.690+0000 7fbf95ffb640 1 -- 172.21.15.2:0/3746367734 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011070 con 0x560105883070 2024-08-31T04:35:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbf95ffb640 1 -- 172.21.15.2:0/3746367734 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa4011210 con 0x560105883070 2024-08-31T04:35:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbf95ffb640 1 -- 172.21.15.2:0/3746367734 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40035f0 con 0x560105883070 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/3746367734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 msgr2=0x560105c28310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4011b20 tx=0x7fbfa4005850 comp rx=0 tx=0).stop 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 0x7fbf980b71b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x560105c26f90 tx=0x7fbfa0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/3746367734 shutdown_connections 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c28850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c28d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/3746367734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105883070 0x560105c28310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/3746367734 >> 172.21.15.2:0/3746367734 conn(0x560105877460 msgr2=0x560105c26200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/3746367734 shutdown_connections 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.691+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/3746367734 wait complete. 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 -- start start 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 Processor -- start 2024-08-31T04:35:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c34040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5601059f1700 con 0x560105883070 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560105b15750 con 0x56010585a1b0 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560105c36af0 con 0x560105862390 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.692+0000 7fbfbc5a0740 10 client.0 _ll_register_callbacks cb 0x560105b44e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c34040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40310/0 (socket says 172.21.15.2:40310) 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/903895810 learned_addr learned my addr 172.21.15.2:0/903895810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaffff640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/903895810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 msgr2=0x560105c34040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c34040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/903895810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 msgr2=0x560105c3fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/903895810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560105b4e900 con 0x56010585a1b0 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c34040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009fd0 tx=0x7fbfa0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52197c76c64b356 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbf8effd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0005020 con 0x56010585a1b0 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa4011210 con 0x56010585a1b0 2024-08-31T04:35:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.693+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fbfa0018030 con 0x56010585a1b0 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbfa0033050 con 0x56010585a1b0 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 10 client.26864 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560105c42910 con 0x56010585a1b0 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa4011210 con 0x56010585a1b0 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fbfa0020710 con 0x56010585a1b0 2024-08-31T04:35:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 10 client.26864 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 10 client.26864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 20 client.26864 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5601058419f0 0x560105c45e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 4 client.26864 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560105ba15d0 con 0x5601058419f0 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.694+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5601058419f0 0x560105c45e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.695+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5601058419f0 0x560105c45e30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e257e79e68f287fa server_cookie=3716884af442827c in_seq=0 out_seq=0 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.695+0000 7fbf8effd640 10 client.26864 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbf8effd640 1 -- 172.21.15.2:0/903895810 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560105ba15d0 con 0x5601058419f0 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbf8effd640 10 client.26864 handle_command_reply: tid=0 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 client.26864 shutdown 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 msgr2=0x560105c33b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009fd0 tx=0x7fbfa0004730 comp rx=0 tx=0).stop 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 shutdown_connections 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5601058419f0 0x560105c45e30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105862390 0x560105c34040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbf8effd640 0 client.26864 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/903895810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56010585a1b0 0x560105c33b00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 >> 172.21.15.2:0/903895810 conn(0x560105877460 msgr2=0x560105c2b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 shutdown_connections 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/903895810 wait complete. 2024-08-31T04:35:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.696+0000 7fbfbc5a0740 20 client.26864 trim_cache size 0 max 16384 2024-08-31T04:35:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 Processor -- start 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 -- start start 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 0x560105c29d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c35730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b5ae0 con 0x560105883070 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b3380 con 0x560105862390 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b11d0 con 0x56010585a1b0 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c35730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60266/0 (socket says 172.21.15.2:60266) 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfaffff640 1 -- 172.21.15.2:0/2736887663 learned_addr learned my addr 172.21.15.2:0/2736887663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.711+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 0x560105c29d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/2736887663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 msgr2=0x560105c35730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c35730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/2736887663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 msgr2=0x560105c3fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/2736887663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560105c2a600 con 0x56010585a1b0 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaffff640 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 0x560105c29d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009c70 tx=0x7fbfa00043e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7cc88ee2b57fef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbf957fa640 1 -- 172.21.15.2:0/2736887663 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0005020 con 0x56010585a1b0 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbf957fa640 1 -- 172.21.15.2:0/2736887663 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa00047a0 con 0x56010585a1b0 2024-08-31T04:35:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.712+0000 7fbf957fa640 1 -- 172.21.15.2:0/2736887663 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00296e0 con 0x56010585a1b0 2024-08-31T04:35:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/2736887663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 msgr2=0x560105c29d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 0x560105c29d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009c70 tx=0x7fbfa00043e0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/2736887663 shutdown_connections 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560105883070 0x560105c3fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c35730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/2736887663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56010585a1b0 0x560105c29d00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/2736887663 >> 172.21.15.2:0/2736887663 conn(0x560105877460 msgr2=0x560105c35020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/2736887663 shutdown_connections 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/2736887663 wait complete. 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.713+0000 7fbfbc5a0740 1 -- start start 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 Processor -- start 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c3a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105883070 0x560105caf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b1840 con 0x56010585a1b0 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b2cb0 con 0x560105862390 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b1f10 con 0x560105883070 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfbc5a0740 10 client.0 _ll_register_callbacks cb 0x7fbfa0009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60268/0 (socket says 172.21.15.2:60268) 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/741875409 learned_addr learned my addr 172.21.15.2:0/741875409 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105883070 0x560105caf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c3a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/741875409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105883070 msgr2=0x560105caf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105883070 0x560105caf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 msgr2=0x560105c3a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.714+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c3a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbfaf7fe640 1 -- 172.21.15.2:0/741875409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560105cafd90 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbfaf7fe640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0021d50 tx=0x7fbfa0004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0b29de31a90f5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbf8effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0043680 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa00047a0 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fbfa0038480 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbfa0043820 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbfbc5a0740 10 client.17154 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560105cb0ff0 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.715+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa00047a0 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fbfa0004c20 con 0x56010585a1b0 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 10 client.17154 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 20 client.17154 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560105816da0 0x560105cb36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 4 client.17154 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560105b9d070 con 0x560105816da0 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560105816da0 0x560105cb36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbfaeffd640 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560105816da0 0x560105cb36d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd70ce677c50285 server_cookie=eda08b3857a9edb7 in_seq=0 out_seq=0 2024-08-31T04:35:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.716+0000 7fbf8effd640 10 client.17154 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:41.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.717+0000 7fbf8effd640 1 -- 172.21.15.2:0/741875409 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560105b9d070 con 0x560105816da0 2024-08-31T04:35:41.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.717+0000 7fbf8effd640 10 client.17154 handle_command_reply: tid=0 2024-08-31T04:35:41.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.717+0000 7fbfbc5a0740 1 client.17154 shutdown 2024-08-31T04:35:41.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 msgr2=0x560105c3a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0021d50 tx=0x7fbfa0004550 comp rx=0 tx=0).stop 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 shutdown_connections 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560105816da0 0x560105cb36d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560105883070 0x560105caf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560105862390 0x560105c3a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 --2- 172.21.15.2:0/741875409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56010585a1b0 0x560105c3a4b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 >> 172.21.15.2:0/741875409 conn(0x560105877460 msgr2=0x560105c29ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbf8effd640 0 client.17154 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 shutdown_connections 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 1 -- 172.21.15.2:0/741875409 wait complete. 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.718+0000 7fbfbc5a0740 20 client.17154 trim_cache size 0 max 16384 2024-08-31T04:35:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:35:41.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 msgr2=0x7fbf980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 0x7fbf980b71b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x560105c26f90 tx=0x7fbfa0005f90 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 msgr2=0x7fbfb01a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 0x7fbfb01a1cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfa802ade0 tx=0x7fbfa8031660 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 shutdown_connections 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fbf980b4ca0 0x7fbf980b71b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb0108140 0x7fbfb019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb0108a90 0x7fbfb01a1cb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 --2- 172.21.15.2:0/1704784225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfb0102800 0x7fbfb019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 >> 172.21.15.2:0/1704784225 conn(0x7fbfb00794d0 msgr2=0x7fbfb006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 shutdown_connections 2024-08-31T04:35:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:41.719+0000 7fbfb602b640 1 -- 172.21.15.2:0/1704784225 wait complete. 2024-08-31T04:35:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:42 smithi002 ceph-mon[18656]: pgmap v655: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-31T04:35:42.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1055171 10.75 MB/sec execute 422 sec latency 29.803 ms 2024-08-31T04:35:42.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:42 smithi064 ceph-mon[22007]: pgmap v655: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-31T04:35:42.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:42 smithi132 ceph-mon[22335]: pgmap v655: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-31T04:35:43.507 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:35:43.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:35:43.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1056704 10.74 MB/sec execute 423 sec latency 19.609 ms 2024-08-31T04:35:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/894090030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 msgr2=0x7f2eec110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/894090030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec110170 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ca0 tx=0x7f2ee402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/894090030 shutdown_connections 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/894090030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec110170 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/894090030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec105150 0x7f2eec10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/894090030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec104720 0x7f2eec104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.331+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/894090030 >> 172.21.15.2:0/894090030 conn(0x7f2eec0794f0 msgr2=0x7f2eec079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.332+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/894090030 shutdown_connections 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.332+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/894090030 wait complete. 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.332+0000 7f2ef0c8c640 1 Processor -- start 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.332+0000 7f2ef0c8c640 1 -- start start 2024-08-31T04:35:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec104720 0x7f2eec19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec113840 con 0x7f2eec10dcd0 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1136c0 con 0x7f2eec105150 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ef0c8c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1139c0 con 0x7f2eec104720 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40342/0 (socket says 172.21.15.2:40342) 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60296/0 (socket says 172.21.15.2:60296) 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 -- 172.21.15.2:0/787370022 learned_addr learned my addr 172.21.15.2:0/787370022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2eea59c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec104720 0x7f2eec19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 -- 172.21.15.2:0/787370022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec104720 msgr2=0x7f2eec19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec104720 0x7f2eec19a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 -- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 msgr2=0x7f2eec19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 -- 172.21.15.2:0/787370022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eec1a01a0 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2eead9d640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.333+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400e9f0 tx=0x7f2ed400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.334+0000 7f2ee37fe640 1 -- 172.21.15.2:0/787370022 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400ccc0 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.334+0000 7f2ee37fe640 1 -- 172.21.15.2:0/787370022 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ed40054d0 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.334+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eec1a0490 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.334+0000 7f2ee37fe640 1 -- 172.21.15.2:0/787370022 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4010430 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.334+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eec1a6bf0 con 0x7f2eec105150 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.336+0000 7f2ef7201740 1 Processor -- start 2024-08-31T04:35:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.336+0000 7f2ef7201740 1 -- start start 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.336+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.336+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040f93cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040f94200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ef7201740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562040f095f0 con 0x562040bc4490 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ef7201740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562040ef8b80 con 0x562040bcc670 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ef7201740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562040efcb30 con 0x562040bed350 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ee37fe640 1 -- 172.21.15.2:0/787370022 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2ed4005020 con 0x7f2eec105150 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040f93cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43586/0 (socket says 172.21.15.2:43586) 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 -- 172.21.15.2:0/1664476233 learned_addr learned my addr 172.21.15.2:0/1664476233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040f94200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 -- 172.21.15.2:0/1664476233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 msgr2=0x562040f94200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040f94200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 -- 172.21.15.2:0/1664476233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 msgr2=0x562040f93cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040f93cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 -- 172.21.15.2:0/1664476233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562040c58930 con 0x562040bed350 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eea59c640 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040f93cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.337+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4033040 tx=0x7f2ee402f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfb5babc09452c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2ee37fe640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 0x7f2ed80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2ee0ff9640 1 -- 172.21.15.2:0/1664476233 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4031650 con 0x562040bed350 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2eea59c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 0x7f2ed80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2ee0ff9640 1 -- 172.21.15.2:0/1664476233 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4036040 con 0x562040bed350 2024-08-31T04:35:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2ee0ff9640 1 -- 172.21.15.2:0/1664476233 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4004460 con 0x562040bed350 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.338+0000 7f2ee37fe640 1 -- 172.21.15.2:0/787370022 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f2ed40e5d30 con 0x7f2eec105150 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- 172.21.15.2:0/1664476233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 msgr2=0x562040f93780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2eea59c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 0x7f2ed80b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x562040f92400 tx=0x7f2edc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4033040 tx=0x7f2ee402f310 comp rx=0 tx=0).stop 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- 172.21.15.2:0/1664476233 shutdown_connections 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040f93cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040f94200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1664476233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040f93780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- 172.21.15.2:0/1664476233 >> 172.21.15.2:0/1664476233 conn(0x562040be1740 msgr2=0x562040f91670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- 172.21.15.2:0/1664476233 shutdown_connections 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- 172.21.15.2:0/1664476233 wait complete. 2024-08-31T04:35:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 -- start start 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.339+0000 7f2ef7201740 1 Processor -- start 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 0x562040f9eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bed350 0x562040fab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562040d5b890 con 0x562040bcc670 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562040e7f790 con 0x562040bed350 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562040fa1d80 con 0x562040bc4490 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ef7201740 10 client.0 _ll_register_callbacks cb 0x562040c04ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 0x562040f9eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 0x562040f9eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43588/0 (socket says 172.21.15.2:43588) 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60312/0 (socket says 172.21.15.2:60312) 2024-08-31T04:35:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2eea59c640 1 -- 172.21.15.2:0/3573957038 learned_addr learned my addr 172.21.15.2:0/3573957038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bed350 0x562040fab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 -- 172.21.15.2:0/3573957038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 msgr2=0x562040f9eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 0x562040f9eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 -- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bed350 msgr2=0x562040fab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bed350 0x562040fab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 -- 172.21.15.2:0/3573957038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562040eb6f30 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40e2fd0 tx=0x7f2ed40049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ced6a0cfdaf99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.340+0000 7f2ed1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40e3460 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f2ed40b0420 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee4036040 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ed40aba80 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 10 client.17166 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562040fadb50 con 0x562040bcc670 2024-08-31T04:35:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4036040 con 0x562040bcc670 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f2ed4097190 con 0x562040bcc670 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 10 client.17166 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 20 client.17166 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040babcd0 0x562040fb10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 4 client.17166 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562040f0b540 con 0x562040babcd0 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.341+0000 7f2eea59c640 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040babcd0 0x562040fb10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.342+0000 7f2ed1ffb640 10 client.17166 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.342+0000 7f2eea59c640 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040babcd0 0x562040fb10c0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d3730e2f0231b1 server_cookie=cc879d9184d862d8 in_seq=0 out_seq=0 2024-08-31T04:35:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/3573957038 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562040f0b540 con 0x562040babcd0 2024-08-31T04:35:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ed1ffb640 10 client.17166 handle_command_reply: tid=0 2024-08-31T04:35:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 client.17166 shutdown 2024-08-31T04:35:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 msgr2=0x562040f9f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40e2fd0 tx=0x7f2ed40049c0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 shutdown_connections 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040babcd0 0x562040fb10c0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bcc670 0x562040f9f430 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bed350 0x562040fab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 --2- 172.21.15.2:0/3573957038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bc4490 0x562040f9eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ed1ffb640 0 client.17166 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 >> 172.21.15.2:0/3573957038 conn(0x562040be1740 msgr2=0x562040f96910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 shutdown_connections 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 1 -- 172.21.15.2:0/3573957038 wait complete. 2024-08-31T04:35:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.343+0000 7f2ef7201740 20 client.17166 trim_cache size 0 max 16384 2024-08-31T04:35:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 Processor -- start 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 -- start start 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 0x562040f94ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 0x562040faaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1b3890 con 0x562040bed350 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1b1130 con 0x562040bc4490 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ef7201740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1aef80 con 0x562040bcc670 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60318/0 (socket says 172.21.15.2:60318) 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2eead9d640 1 -- 172.21.15.2:0/1927448324 learned_addr learned my addr 172.21.15.2:0/1927448324 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2eea59c640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 0x562040f94ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.362+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 0x562040faaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 -- 172.21.15.2:0/1927448324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 msgr2=0x562040faaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 0x562040faaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 -- 172.21.15.2:0/1927448324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 msgr2=0x562040f94ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 0x562040f94ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 -- 172.21.15.2:0/1927448324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562040f965e0 con 0x562040bed350 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 0x562040faaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eea59c640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 0x562040f94ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009620 tx=0x7f2ee40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d488617f3955a37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2ed3fff640 1 -- 172.21.15.2:0/1927448324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4052020 con 0x562040bed350 2024-08-31T04:35:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2ed3fff640 1 -- 172.21.15.2:0/1927448324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4036040 con 0x562040bed350 2024-08-31T04:35:44.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.363+0000 7f2ed3fff640 1 -- 172.21.15.2:0/1927448324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4004150 con 0x562040bed350 2024-08-31T04:35:44.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- 172.21.15.2:0/1927448324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 msgr2=0x562040f9c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009620 tx=0x7f2ee40040e0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- 172.21.15.2:0/1927448324 shutdown_connections 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bed350 0x562040f9c0e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bcc670 0x562040faaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1927448324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bc4490 0x562040f94ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- 172.21.15.2:0/1927448324 >> 172.21.15.2:0/1927448324 conn(0x562040be1740 msgr2=0x562040f947b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- 172.21.15.2:0/1927448324 shutdown_connections 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- 172.21.15.2:0/1927448324 wait complete. 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.364+0000 7f2ef7201740 1 -- start start 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 Processor -- start 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040fa7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040fa4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1af5f0 con 0x562040bc4490 2024-08-31T04:35:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1b0a60 con 0x562040bcc670 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1afcc0 con 0x562040bed350 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ef7201740 10 client.0 _ll_register_callbacks cb 0x7f2ed400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040fa4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:40368/0 (socket says 172.21.15.2:40368) 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 -- 172.21.15.2:0/1295965216 learned_addr learned my addr 172.21.15.2:0/1295965216 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2eead9d640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040fa4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:43618/0 (socket says 172.21.15.2:43618) 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2eea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040fa7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 -- 172.21.15.2:0/1295965216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 msgr2=0x562040fa4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040fa4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 -- 172.21.15.2:0/1295965216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 msgr2=0x562040fa7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040fa7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.365+0000 7f2ee3fff640 1 -- 172.21.15.2:0/1295965216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562040f95f90 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ee3fff640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40b0830 tx=0x7f2ed4004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904c93c0e5c0d859 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ed1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40e3460 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee4036040 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7f2ed40b4e00 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ed40a7e30 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ef7201740 10 client.26888 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562041020c90 con 0x562040bcc670 2024-08-31T04:35:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.366+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4036040 con 0x562040bcc670 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f2ed40cd170 con 0x562040bcc670 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 10 client.26888 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 10 client.26888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 20 client.26888 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040b81080 0x5620410233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 4 client.26888 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562040f06fe0 con 0x562040b81080 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2eea59c640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040b81080 0x5620410233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2eea59c640 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040b81080 0x5620410233f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62b522d63931415a server_cookie=2df666d75fdab33d in_seq=0 out_seq=0 2024-08-31T04:35:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.367+0000 7f2ed1ffb640 10 client.26888 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.369+0000 7f2ed1ffb640 1 -- 172.21.15.2:0/1295965216 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562040f06fe0 con 0x562040b81080 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.369+0000 7f2ed1ffb640 10 client.26888 handle_command_reply: tid=0 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.369+0000 7f2ef7201740 1 client.26888 shutdown 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 msgr2=0x562040fa3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40b0830 tx=0x7f2ed4004a60 comp rx=0 tx=0).stop 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 shutdown_connections 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x562040b81080 0x5620410233f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562040bed350 0x562040fa4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562040bcc670 0x562040fa3d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ed1ffb640 0 client.26888 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 --2- 172.21.15.2:0/1295965216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562040bc4490 0x562040fa7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 >> 172.21.15.2:0/1295965216 conn(0x562040be1740 msgr2=0x562040fa03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 shutdown_connections 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 1 -- 172.21.15.2:0/1295965216 wait complete. 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.370+0000 7f2ef7201740 20 client.26888 trim_cache size 0 max 16384 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "66e2e486-38c0-4431-bffc-a4fe81855312", 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:35:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 msgr2=0x7f2ed80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 0x7f2ed80b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x562040f92400 tx=0x7f2edc005f90 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 msgr2=0x7f2eec19a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400e9f0 tx=0x7f2ed400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 shutdown_connections 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f2ed80b4ca0 0x7f2ed80b71b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eec10dcd0 0x7f2eec19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eec105150 0x7f2eec19a7d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 --2- 172.21.15.2:0/787370022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eec104720 0x7f2eec19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 >> 172.21.15.2:0/787370022 conn(0x7f2eec0794f0 msgr2=0x7f2eec100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 shutdown_connections 2024-08-31T04:35:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:44.371+0000 7f2ef0c8c640 1 -- 172.21.15.2:0/787370022 wait complete. 2024-08-31T04:35:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:44 smithi002 ceph-mon[18656]: pgmap v656: 129 pgs: 129 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:35:44.667 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:44 smithi064 ceph-mon[22007]: pgmap v656: 129 pgs: 129 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:35:44.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1058425 10.73 MB/sec execute 424 sec latency 103.182 ms 2024-08-31T04:35:44.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:44 smithi132 ceph-mon[22335]: pgmap v656: 129 pgs: 129 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:35:45.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:35:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:35:45.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:35:45.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:35:45.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:35:45.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:45 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1059483 10.72 MB/sec execute 425 sec latency 28.373 ms 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:45 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:45 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 -- 172.21.15.2:0/1123287425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108160 msgr2=0x7fb370108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 --2- 172.21.15.2:0/1123287425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108160 0x7fb370108570 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb360009900 tx=0x7fb36002a410 comp rx=0 tx=0).stop 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 -- 172.21.15.2:0/1123287425 shutdown_connections 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 --2- 172.21.15.2:0/1123287425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108160 0x7fb370108570 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 --2- 172.21.15.2:0/1123287425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108ab0 0x7fb37010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 --2- 172.21.15.2:0/1123287425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb370102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 -- 172.21.15.2:0/1123287425 >> 172.21.15.2:0/1123287425 conn(0x7fb3700794e0 msgr2=0x7fb3700798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 -- 172.21.15.2:0/1123287425 shutdown_connections 2024-08-31T04:35:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.882+0000 7fb374ded640 1 -- 172.21.15.2:0/1123287425 wait complete. 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 Processor -- start 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 -- start start 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108160 0x7fb37019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 0x7fb37019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701126e0 con 0x7fb370108ab0 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb370112560 con 0x7fb370102820 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb374ded640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb370112860 con 0x7fb370108160 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:45068/0 (socket says 172.21.15.2:45068) 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb36e59c640 1 -- 172.21.15.2:0/4142815717 learned_addr learned my addr 172.21.15.2:0/4142815717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb36dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108160 0x7fb37019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.883+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 0x7fb37019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 -- 172.21.15.2:0/4142815717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108160 msgr2=0x7fb37019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108160 0x7fb37019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 -- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 msgr2=0x7fb37019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 0x7fb37019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 -- 172.21.15.2:0/4142815717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3701a0250 con 0x7fb370102820 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 0x7fb37019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb36e59c640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb35800e9f0 tx=0x7fb35800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb3677fe640 1 -- 172.21.15.2:0/4142815717 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35800cd80 con 0x7fb370102820 2024-08-31T04:35:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701a0540 con 0x7fb370102820 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb3677fe640 1 -- 172.21.15.2:0/4142815717 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3580108e0 con 0x7fb370102820 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb3677fe640 1 -- 172.21.15.2:0/4142815717 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358018980 con 0x7fb370102820 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.884+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3700ff310 con 0x7fb370102820 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.887+0000 7fb3677fe640 1 -- 172.21.15.2:0/4142815717 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb358010430 con 0x7fb370102820 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.887+0000 7fb37b362740 1 Processor -- start 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.887+0000 7fb37b362740 1 -- start start 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed75840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed75d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a4ecec630 con 0x559a4e9d0070 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559a4ecdbbc0 con 0x559a4e9af390 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb37b362740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a4ecdfb70 con 0x559a4e9a71b0 2024-08-31T04:35:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58332/0 (socket says 172.21.15.2:58332) 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36ed9d640 1 -- 172.21.15.2:0/1233142640 learned_addr learned my addr 172.21.15.2:0/1233142640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed75d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb3677fe640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 0x7fb35c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36e59c640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed75840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 0x7fb35c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb3677fe640 1 -- 172.21.15.2:0/4142815717 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fb3580e5d00 con 0x7fb370102820 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 -- 172.21.15.2:0/1233142640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 msgr2=0x559a4ed75840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed75840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 -- 172.21.15.2:0/1233142640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 msgr2=0x559a4ed75300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36dd9b640 1 -- 172.21.15.2:0/1233142640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4ea3b650 con 0x559a4e9af390 2024-08-31T04:35:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.888+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.889+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed75d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb360006010 tx=0x7fb360032c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52337cb41bebeda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.889+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 0x7fb35c0b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb368007e20 tx=0x7fb368004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.889+0000 7fb364ff9640 1 -- 172.21.15.2:0/1233142640 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360040070 con 0x559a4e9af390 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.889+0000 7fb364ff9640 1 -- 172.21.15.2:0/1233142640 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb360032e50 con 0x559a4e9af390 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.889+0000 7fb364ff9640 1 -- 172.21.15.2:0/1233142640 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360035040 con 0x559a4e9af390 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.890+0000 7fb37b362740 1 -- 172.21.15.2:0/1233142640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 msgr2=0x559a4ed75d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.890+0000 7fb37b362740 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed75d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb360006010 tx=0x7fb360032c60 comp rx=0 tx=0).stop 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.892+0000 7fb37b362740 1 -- 172.21.15.2:0/1233142640 shutdown_connections 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.892+0000 7fb37b362740 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed75d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.892+0000 7fb37b362740 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed75840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.892+0000 7fb37b362740 1 --2- 172.21.15.2:0/1233142640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9d0070 0x559a4ed75300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.892+0000 7fb37b362740 1 -- 172.21.15.2:0/1233142640 >> 172.21.15.2:0/1233142640 conn(0x559a4e9c4460 msgr2=0x559a4ed731f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.893+0000 7fb37b362740 1 -- 172.21.15.2:0/1233142640 shutdown_connections 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.893+0000 7fb37b362740 1 -- 172.21.15.2:0/1233142640 wait complete. 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.894+0000 7fb37b362740 1 -- start start 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.894+0000 7fb37b362740 1 Processor -- start 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed80f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9d0070 0x559a4ed8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a4eb3e700 con 0x559a4e9a71b0 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559a4ec62700 con 0x559a4e9af390 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a4ed83a80 con 0x559a4e9d0070 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58346/0 (socket says 172.21.15.2:58346) 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb36e59c640 1 -- 172.21.15.2:0/2119061028 learned_addr learned my addr 172.21.15.2:0/2119061028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed80f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.895+0000 7fb37b362740 10 client.0 _ll_register_callbacks cb 0x559a4ec91dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 -- 172.21.15.2:0/2119061028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9d0070 msgr2=0x559a4ed8cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9d0070 0x559a4ed8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 -- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 msgr2=0x559a4ed80f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed80f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 -- 172.21.15.2:0/2119061028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a4ec9b8b0 con 0x559a4e9a71b0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb36e59c640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb35801e000 tx=0x7fb35801df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f89ae9df228abdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.896+0000 7fb355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580e3430 con 0x559a4e9a71b0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fb3580b3b30 con 0x559a4e9a71b0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb360032e50 con 0x559a4e9a71b0 2024-08-31T04:35:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb3580abb00 con 0x559a4e9a71b0 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb37b362740 10 client.17184 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.897+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559a4ed8f820 con 0x559a4e9a71b0 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb360032e50 con 0x559a4e9a71b0 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fb3580b03a0 con 0x559a4e9a71b0 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 10 client.17184 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 20 client.17184 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e98e9f0 0x559a4ed92c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 4 client.17184 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.898+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a4ecee580 con 0x559a4e98e9f0 2024-08-31T04:35:45.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.900+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e98e9f0 0x559a4ed92c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.902+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e98e9f0 0x559a4ed92c60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c499005121dec3 server_cookie=9a74e4fa76f8c9e3 in_seq=0 out_seq=0 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.902+0000 7fb355ffb640 10 client.17184 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.904+0000 7fb355ffb640 1 -- 172.21.15.2:0/2119061028 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a4ecee580 con 0x559a4e98e9f0 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.904+0000 7fb355ffb640 10 client.17184 handle_command_reply: tid=0 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.904+0000 7fb37b362740 1 client.17184 shutdown 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 msgr2=0x559a4ed80a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb35801e000 tx=0x7fb35801df90 comp rx=0 tx=0).stop 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 shutdown_connections 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e98e9f0 0x559a4ed92c60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb355ffb640 0 client.17184 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9d0070 0x559a4ed8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e9af390 0x559a4ed80f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 --2- 172.21.15.2:0/2119061028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9a71b0 0x559a4ed80a00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.905+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 >> 172.21.15.2:0/2119061028 conn(0x559a4e9c4460 msgr2=0x559a4ed784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.906+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 shutdown_connections 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.906+0000 7fb37b362740 1 -- 172.21.15.2:0/2119061028 wait complete. 2024-08-31T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.906+0000 7fb37b362740 20 client.17184 trim_cache size 0 max 16384 2024-08-31T04:35:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 Processor -- start 2024-08-31T04:35:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 -- start start 2024-08-31T04:35:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed78b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701b1880 con 0x559a4e9af390 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701af120 con 0x559a4e98e9f0 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb37b362740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701acf70 con 0x559a4e9a71b0 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.940+0000 7fb36ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58360/0 (socket says 172.21.15.2:58360) 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 -- 172.21.15.2:0/503378364 learned_addr learned my addr 172.21.15.2:0/503378364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 -- 172.21.15.2:0/503378364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 msgr2=0x559a4ed8cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed8cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 -- 172.21.15.2:0/503378364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 msgr2=0x559a4ed78b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed78b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 -- 172.21.15.2:0/503378364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4ed77b90 con 0x559a4e9af390 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.941+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb36800eb40 tx=0x7fb368010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e560005c7171a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.942+0000 7fb357fff640 1 -- 172.21.15.2:0/503378364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36800e4b0 con 0x559a4e9af390 2024-08-31T04:35:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.942+0000 7fb357fff640 1 -- 172.21.15.2:0/503378364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb368003970 con 0x559a4e9af390 2024-08-31T04:35:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.942+0000 7fb357fff640 1 -- 172.21.15.2:0/503378364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36801cdb0 con 0x559a4e9af390 2024-08-31T04:35:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.943+0000 7fb37b362740 1 -- 172.21.15.2:0/503378364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 msgr2=0x559a4ed72b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.943+0000 7fb37b362740 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb36800eb40 tx=0x7fb368010040 comp rx=0 tx=0).stop 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 -- 172.21.15.2:0/503378364 shutdown_connections 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4ed72b30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed8cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 --2- 172.21.15.2:0/503378364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed78b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 -- 172.21.15.2:0/503378364 >> 172.21.15.2:0/503378364 conn(0x559a4e9c4460 msgr2=0x559a4ed78400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 -- 172.21.15.2:0/503378364 shutdown_connections 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 -- 172.21.15.2:0/503378364 wait complete. 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 -- start start 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.944+0000 7fb37b362740 1 Processor -- start 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb37b362740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb37b362740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb37b362740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4edfc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:45120/0 (socket says 172.21.15.2:45120) 2024-08-31T04:35:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb36dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb36e59c640 1 -- 172.21.15.2:0/3017253341 learned_addr learned my addr 172.21.15.2:0/3017253341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:35:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb36ed9d640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4edfc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.945+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701ad5e0 con 0x559a4e9af390 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701aea50 con 0x559a4e98e9f0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701adcb0 con 0x559a4e9a71b0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb37b362740 10 client.0 _ll_register_callbacks cb 0x7fb358009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 -- 172.21.15.2:0/3017253341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 msgr2=0x559a4ed858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 -- 172.21.15.2:0/3017253341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 msgr2=0x559a4edfc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4edfc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a4edfcb60 con 0x559a4e98e9f0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb36e59c640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb3580a9260 tx=0x7fb3580ab500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6f0d93a20fc84c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.946+0000 7fb355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580e3430 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9664+0+0 (secure 0 0 0) 0x7fb358093320 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb368003970 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb3580b07b0 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 10 client.26903 fetch_fsmap learned FSMap version 31 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559a4edfdd10 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb368003970 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fb3580aacc0 con 0x559a4e98e9f0 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 10 client.26903 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 10 client.26903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 20 client.26903 populate_metadata read hostname 'smithi002' 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e9d0070 0x559a4ee00520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 4 client.26903 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.947+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a4ecea020 con 0x559a4e9d0070 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.948+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e9d0070 0x559a4ee00520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.948+0000 7fb355ffb640 10 client.26903 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.948+0000 7fb36dd9b640 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e9d0070 0x559a4ee00520 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63557607721b6128 server_cookie=1d3812bea3cd87d6 in_seq=0 out_seq=0 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb355ffb640 1 -- 172.21.15.2:0/3017253341 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x559a4ecea020 con 0x559a4e9d0070 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb355ffb640 10 client.26903 handle_command_reply: tid=0 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 client.26903 shutdown 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 msgr2=0x559a4ed85370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb3580a9260 tx=0x7fb3580ab500 comp rx=0 tx=0).stop 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 shutdown_connections 2024-08-31T04:35:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x559a4e9d0070 0x559a4ee00520 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb355ffb640 0 client.26903 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a4e9af390 0x559a4edfc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a4e9a71b0 0x559a4ed858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 --2- 172.21.15.2:0/3017253341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559a4e98e9f0 0x559a4ed85370 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 >> 172.21.15.2:0/3017253341 conn(0x559a4e9c4460 msgr2=0x559a4ed729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 shutdown_connections 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 1 -- 172.21.15.2:0/3017253341 wait complete. 2024-08-31T04:35:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.949+0000 7fb37b362740 20 client.26903 trim_cache size 0 max 16384 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "66e2e486-38c0-4431-bffc-a4fe81855312": { 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "66e2e486-38c0-4431-bffc-a4fe81855312", 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.960 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "66e2e486-38c0-4431-bffc-a4fe81855312": { 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:44.368541+0000", 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:35:45.964 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:35:45.966 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:35:45.969 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:35:45.970 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 msgr2=0x7fb35c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 0x7fb35c0b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb368007e20 tx=0x7fb368004ab0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 msgr2=0x7fb37019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb35800e9f0 tx=0x7fb35800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 shutdown_connections 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb35c0b4ca0 0x7fb35c0b71b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb370108ab0 0x7fb37019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb370108160 0x7fb37019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 --2- 172.21.15.2:0/4142815717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb370102820 0x7fb37019a2e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:45.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 >> 172.21.15.2:0/4142815717 conn(0x7fb3700794e0 msgr2=0x7fb37006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:45.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 shutdown_connections 2024-08-31T04:35:45.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:35:45.950+0000 7fb374ded640 1 -- 172.21.15.2:0/4142815717 wait complete. 2024-08-31T04:35:46.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:46 smithi002 ceph-mon[18656]: pgmap v657: 129 pgs: 129 active+clean; 626 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 182 op/s 2024-08-31T04:35:46.577 INFO:tasks.cephfs.filesystem:scrub status for tag:66e2e486-38c0-4431-bffc-a4fe81855312 - {'path': '/', 'tag': '66e2e486-38c0-4431-bffc-a4fe81855312', 'options': 'recursive,force'} 2024-08-31T04:35:46.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1061936 10.73 MB/sec execute 426 sec latency 32.854 ms 2024-08-31T04:35:46.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:46 smithi064 ceph-mon[22007]: pgmap v657: 129 pgs: 129 active+clean; 626 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 182 op/s 2024-08-31T04:35:46.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:46 smithi132 ceph-mon[22335]: pgmap v657: 129 pgs: 129 active+clean; 626 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 182 op/s 2024-08-31T04:35:47.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1062974 10.71 MB/sec execute 427 sec latency 27.235 ms 2024-08-31T04:35:48.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:48 smithi002 ceph-mon[18656]: pgmap v658: 129 pgs: 129 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 209 op/s 2024-08-31T04:35:48.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1065505 10.72 MB/sec execute 428 sec latency 32.407 ms 2024-08-31T04:35:48.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:48 smithi064 ceph-mon[22007]: pgmap v658: 129 pgs: 129 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 209 op/s 2024-08-31T04:35:48.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:48 smithi132 ceph-mon[22335]: pgmap v658: 129 pgs: 129 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 209 op/s 2024-08-31T04:35:49.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1066428 10.71 MB/sec execute 429 sec latency 119.450 ms 2024-08-31T04:35:50.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:50 smithi002 ceph-mon[18656]: pgmap v659: 129 pgs: 129 active+clean; 636 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-08-31T04:35:50.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1067392 10.69 MB/sec execute 430 sec latency 210.539 ms 2024-08-31T04:35:50.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:50 smithi064 ceph-mon[22007]: pgmap v659: 129 pgs: 129 active+clean; 636 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-08-31T04:35:50.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:50 smithi132 ceph-mon[22335]: pgmap v659: 129 pgs: 129 active+clean; 636 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-08-31T04:35:51.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1069345 10.70 MB/sec execute 431 sec latency 229.807 ms 2024-08-31T04:35:52.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:52 smithi002 ceph-mon[18656]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 209 op/s 2024-08-31T04:35:52.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1070800 10.69 MB/sec execute 432 sec latency 35.387 ms 2024-08-31T04:35:52.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:52 smithi064 ceph-mon[22007]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 209 op/s 2024-08-31T04:35:52.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:52 smithi132 ceph-mon[22335]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 209 op/s 2024-08-31T04:35:53.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:53 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:35:53.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:53 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:35:53.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1072889 10.69 MB/sec execute 433 sec latency 34.435 ms 2024-08-31T04:35:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:53 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:35:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:53 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:35:53.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:53 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:35:53.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:53 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:35:54.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:54 smithi002 ceph-mon[18656]: pgmap v661: 129 pgs: 129 active+clean; 644 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:35:54.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1074269 10.68 MB/sec execute 434 sec latency 51.242 ms 2024-08-31T04:35:54.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:54 smithi064 ceph-mon[22007]: pgmap v661: 129 pgs: 129 active+clean; 644 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:35:54.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:54 smithi132 ceph-mon[22335]: pgmap v661: 129 pgs: 129 active+clean; 644 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 218 op/s 2024-08-31T04:35:55.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1076335 10.69 MB/sec execute 435 sec latency 28.126 ms 2024-08-31T04:35:56.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:56 smithi002 ceph-mon[18656]: pgmap v662: 129 pgs: 129 active+clean; 641 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:35:56.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1077539 10.67 MB/sec execute 436 sec latency 31.287 ms 2024-08-31T04:35:56.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:56 smithi064 ceph-mon[22007]: pgmap v662: 129 pgs: 129 active+clean; 641 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:35:56.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:56 smithi132 ceph-mon[22335]: pgmap v662: 129 pgs: 129 active+clean; 641 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 198 op/s 2024-08-31T04:35:57.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1079880 10.68 MB/sec execute 437 sec latency 28.913 ms 2024-08-31T04:35:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:35:58 smithi002 ceph-mon[18656]: pgmap v663: 129 pgs: 129 active+clean; 613 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T04:35:58.689 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1081130 10.67 MB/sec execute 438 sec latency 29.733 ms 2024-08-31T04:35:58.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:35:58 smithi064 ceph-mon[22007]: pgmap v663: 129 pgs: 129 active+clean; 613 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T04:35:58.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:35:58 smithi132 ceph-mon[22335]: pgmap v663: 129 pgs: 129 active+clean; 613 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T04:35:59.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1083218 10.67 MB/sec execute 439 sec latency 44.637 ms 2024-08-31T04:36:00.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:00 smithi002 ceph-mon[18656]: pgmap v664: 129 pgs: 129 active+clean; 597 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:36:00.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1084005 10.66 MB/sec execute 440 sec latency 51.041 ms 2024-08-31T04:36:00.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:00 smithi064 ceph-mon[22007]: pgmap v664: 129 pgs: 129 active+clean; 597 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:36:00.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:00 smithi132 ceph-mon[22335]: pgmap v664: 129 pgs: 129 active+clean; 597 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 188 op/s 2024-08-31T04:36:01.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1084453 10.64 MB/sec execute 441 sec latency 79.850 ms 2024-08-31T04:36:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:02 smithi002 ceph-mon[18656]: pgmap v665: 129 pgs: 129 active+clean; 601 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 183 op/s 2024-08-31T04:36:02.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1086334 10.64 MB/sec execute 442 sec latency 64.221 ms 2024-08-31T04:36:02.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:02 smithi064 ceph-mon[22007]: pgmap v665: 129 pgs: 129 active+clean; 601 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 183 op/s 2024-08-31T04:36:02.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:02 smithi132 ceph-mon[22335]: pgmap v665: 129 pgs: 129 active+clean; 601 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 183 op/s 2024-08-31T04:36:03.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1087514 10.63 MB/sec execute 443 sec latency 35.565 ms 2024-08-31T04:36:04.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1089102 10.62 MB/sec execute 444 sec latency 116.965 ms 2024-08-31T04:36:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:04 smithi064 ceph-mon[22007]: pgmap v666: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-08-31T04:36:04.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:04 smithi064 ceph-mon[22007]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T04:36:04.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:04 smithi132 ceph-mon[22335]: pgmap v666: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-08-31T04:36:04.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:04 smithi132 ceph-mon[22335]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T04:36:04.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:04 smithi002 ceph-mon[18656]: pgmap v666: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-08-31T04:36:04.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:04 smithi002 ceph-mon[18656]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T04:36:05.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1090752 10.62 MB/sec execute 445 sec latency 62.225 ms 2024-08-31T04:36:06.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1092425 10.61 MB/sec execute 446 sec latency 39.123 ms 2024-08-31T04:36:06.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:06 smithi064 ceph-mon[22007]: pgmap v668: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 217 op/s 2024-08-31T04:36:06.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:06 smithi132 ceph-mon[22335]: pgmap v668: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 217 op/s 2024-08-31T04:36:06.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:06 smithi002 ceph-mon[18656]: pgmap v668: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 217 op/s 2024-08-31T04:36:07.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1094313 10.62 MB/sec execute 447 sec latency 15.247 ms 2024-08-31T04:36:08.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1096036 10.61 MB/sec execute 448 sec latency 52.133 ms 2024-08-31T04:36:08.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:08 smithi064 ceph-mon[22007]: pgmap v669: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:36:08.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:08 smithi132 ceph-mon[22335]: pgmap v669: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:36:08.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:08 smithi002 ceph-mon[18656]: pgmap v669: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T04:36:09.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1097661 10.61 MB/sec execute 449 sec latency 161.659 ms 2024-08-31T04:36:10.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1098581 10.59 MB/sec execute 450 sec latency 42.001 ms 2024-08-31T04:36:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:10 smithi064 ceph-mon[22007]: pgmap v670: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2024-08-31T04:36:10.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:10 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:10 smithi132 ceph-mon[22335]: pgmap v670: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2024-08-31T04:36:10.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:10 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:10.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:10 smithi002 ceph-mon[18656]: pgmap v670: 129 pgs: 129 active+clean; 592 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2024-08-31T04:36:10.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:10 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:11.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1100950 10.60 MB/sec execute 451 sec latency 36.170 ms 2024-08-31T04:36:11.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:11.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:11 smithi002 ceph-mon[18656]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:12.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:11 smithi064 ceph-mon[22007]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:12.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:12.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:36:12.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:11 smithi132 ceph-mon[22335]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T04:36:12.690 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1102030 10.59 MB/sec execute 452 sec latency 36.589 ms 2024-08-31T04:36:12.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:12 smithi002 ceph-mon[18656]: pgmap v671: 129 pgs: 129 active+clean; 602 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 248 op/s 2024-08-31T04:36:13.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:12 smithi064 ceph-mon[22007]: pgmap v671: 129 pgs: 129 active+clean; 602 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 248 op/s 2024-08-31T04:36:13.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:12 smithi132 ceph-mon[22335]: pgmap v671: 129 pgs: 129 active+clean; 602 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 248 op/s 2024-08-31T04:36:13.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1104513 10.59 MB/sec execute 453 sec latency 30.414 ms 2024-08-31T04:36:14.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1105426 10.58 MB/sec execute 454 sec latency 87.908 ms 2024-08-31T04:36:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:14 smithi002 ceph-mon[18656]: pgmap v673: 129 pgs: 129 active+clean; 601 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 206 op/s 2024-08-31T04:36:15.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:14 smithi064 ceph-mon[22007]: pgmap v673: 129 pgs: 129 active+clean; 601 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 206 op/s 2024-08-31T04:36:15.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:14 smithi132 ceph-mon[22335]: pgmap v673: 129 pgs: 129 active+clean; 601 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.6 MiB/s wr, 206 op/s 2024-08-31T04:36:15.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1107622 10.59 MB/sec execute 455 sec latency 52.907 ms 2024-08-31T04:36:16.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:36:16.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1108837 10.58 MB/sec execute 456 sec latency 22.850 ms 2024-08-31T04:36:16.853 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:16 smithi002 ceph-mon[18656]: pgmap v674: 129 pgs: 129 active+clean; 611 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:36:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:16 smithi064 ceph-mon[22007]: pgmap v674: 129 pgs: 129 active+clean; 611 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:36:17.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:16 smithi132 ceph-mon[22335]: pgmap v674: 129 pgs: 129 active+clean; 611 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.4 MiB/s wr, 219 op/s 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 -- 172.21.15.2:0/2169816795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604102820 msgr2=0x7f2604102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 --2- 172.21.15.2:0/2169816795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604102820 0x7f2604102c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2600009900 tx=0x7f260002a410 comp rx=0 tx=0).stop 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 -- 172.21.15.2:0/2169816795 shutdown_connections 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 --2- 172.21.15.2:0/2169816795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108ab0 0x7f260410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 --2- 172.21.15.2:0/2169816795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604108160 0x7f2604108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 --2- 172.21.15.2:0/2169816795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604102820 0x7f2604102c30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 -- 172.21.15.2:0/2169816795 >> 172.21.15.2:0/2169816795 conn(0x7f26040794e0 msgr2=0x7f26040798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 -- 172.21.15.2:0/2169816795 shutdown_connections 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 -- 172.21.15.2:0/2169816795 wait complete. 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.399+0000 7f260c7af640 1 Processor -- start 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 -- start start 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108160 0x7f260419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2604112710 con 0x7f2604108ab0 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2604112590 con 0x7f2604102820 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260c7af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2604112890 con 0x7f2604108160 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260ad4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43638/0 (socket says 172.21.15.2:43638) 2024-08-31T04:36:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 -- 172.21.15.2:0/2005999145 learned_addr learned my addr 172.21.15.2:0/2005999145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260ad4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37458/0 (socket says 172.21.15.2:37458) 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108160 0x7f260419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 -- 172.21.15.2:0/2005999145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108160 msgr2=0x7f260419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108160 0x7f260419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 -- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 msgr2=0x7f260419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260a54b640 1 -- 172.21.15.2:0/2005999145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26041a0280 con 0x7f2604102820 2024-08-31T04:36:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.400+0000 7f260ad4c640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f260a54b640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2600005940 tx=0x7f26000040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f25fb7fe640 1 -- 172.21.15.2:0/2005999145 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260003f030 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26041a0510 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f25fb7fe640 1 -- 172.21.15.2:0/2005999145 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26000044c0 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26041040b0 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.401+0000 7f25fb7fe640 1 -- 172.21.15.2:0/2005999145 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600035070 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.403+0000 7f2612d24740 1 Processor -- start 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 -- start start 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f25fb7fe640 1 -- 172.21.15.2:0/2005999145 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2600042030 con 0x7f2604102820 2024-08-31T04:36:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf836070 0x560aafbdb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbdbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aafb52630 con 0x560aaf815390 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560aafb41bc0 con 0x560aaf836070 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2612d24740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560aafb45b70 con 0x560aaf80d1b0 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f260a54b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f260a54b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:45096/0 (socket says 172.21.15.2:45096) 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f260a54b640 1 -- 172.21.15.2:0/457935811 learned_addr learned my addr 172.21.15.2:0/457935811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f260ad4c640 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf836070 0x560aafbdb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.404+0000 7f2609d4a640 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbdbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 -- 172.21.15.2:0/457935811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf836070 msgr2=0x560aafbdb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf836070 0x560aafbdb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 -- 172.21.15.2:0/457935811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 msgr2=0x560aafbdbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbdbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 -- 172.21.15.2:0/457935811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aaf8a1650 con 0x560aaf80d1b0 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f25fb7fe640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 0x7f25f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260a54b640 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2600102f70 tx=0x7f2600109f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf67f0870423af32 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f260ad4c640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 0x7f25f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f25fb7fe640 1 -- 172.21.15.2:0/2005999145 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f2600105d90 con 0x7f2604102820 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f25f8ff9640 1 -- 172.21.15.2:0/457935811 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26000c7f40 con 0x560aaf80d1b0 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f25f8ff9640 1 -- 172.21.15.2:0/457935811 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2600107070 con 0x560aaf80d1b0 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.405+0000 7f25f8ff9640 1 -- 172.21.15.2:0/457935811 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26000cb7f0 con 0x560aaf80d1b0 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 -- 172.21.15.2:0/457935811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 msgr2=0x560aafbdb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2600102f70 tx=0x7f2600109f40 comp rx=0 tx=0).stop 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f260ad4c640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 0x7f25f00b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009fd0 tx=0x7f25fc009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 -- 172.21.15.2:0/457935811 shutdown_connections 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbdbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbdb800 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 --2- 172.21.15.2:0/457935811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf836070 0x560aafbdb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 -- 172.21.15.2:0/457935811 >> 172.21.15.2:0/457935811 conn(0x560aaf82a460 msgr2=0x560aafbd91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.406+0000 7f2612d24740 1 -- 172.21.15.2:0/457935811 shutdown_connections 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 -- 172.21.15.2:0/457935811 wait complete. 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 -- start start 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 Processor -- start 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 0x560aafbe6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbf2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aaf9a4700 con 0x560aaf80d1b0 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560aafac8700 con 0x560aaf815390 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560aafbe9860 con 0x560aaf836070 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.407+0000 7f2612d24740 10 client.0 _ll_register_callbacks cb 0x560aafaf7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 0x560aafbe6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43660/0 (socket says 172.21.15.2:43660) 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f2609d4a640 1 -- 172.21.15.2:0/2705171235 learned_addr learned my addr 172.21.15.2:0/2705171235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260ad4c640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbf2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 -- 172.21.15.2:0/2705171235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 msgr2=0x560aafbf2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbf2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 -- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 msgr2=0x560aafbe6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 -- 172.21.15.2:0/2705171235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aafb018b0 con 0x560aaf80d1b0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f260a54b640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 0x560aafbe6a80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2600102f70 tx=0x7f260003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f6666505d7f9a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f25edffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600049030 con 0x560aaf80d1b0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f26000c8670 con 0x560aaf80d1b0 2024-08-31T04:36:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.408+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2600107070 con 0x560aaf80d1b0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26000cb9d0 con 0x560aaf80d1b0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 10 client.17202 fetch_fsmap learned FSMap version 31 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560aafbf5600 con 0x560aaf80d1b0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2600107070 con 0x560aaf80d1b0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f26001032b0 con 0x560aaf80d1b0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 10 client.17202 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 20 client.17202 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7f49f0 0x560aafbf8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 4 client.17202 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aafb54580 con 0x560aaf7f49f0 2024-08-31T04:36:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.409+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7f49f0 0x560aafbf8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.410+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7f49f0 0x560aafbf8790 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81dac1147a43024 server_cookie=be1909fd435c6bf6 in_seq=0 out_seq=0 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.410+0000 7f25edffb640 10 client.17202 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.411+0000 7f25edffb640 1 -- 172.21.15.2:0/2705171235 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560aafb54580 con 0x560aaf7f49f0 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.411+0000 7f25edffb640 10 client.17202 handle_command_reply: tid=0 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.411+0000 7f2612d24740 1 client.17202 shutdown 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.411+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 msgr2=0x560aafbe6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.411+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 0x560aafbe6a80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2600102f70 tx=0x7f260003b460 comp rx=0 tx=0).stop 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 shutdown_connections 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7f49f0 0x560aafbf8790 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbf2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbe6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 --2- 172.21.15.2:0/2705171235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf80d1b0 0x560aafbe6a80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 >> 172.21.15.2:0/2705171235 conn(0x560aaf82a460 msgr2=0x560aafbde4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f25edffb640 0 client.17202 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 shutdown_connections 2024-08-31T04:36:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 1 -- 172.21.15.2:0/2705171235 wait complete. 2024-08-31T04:36:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.412+0000 7f2612d24740 20 client.17202 trim_cache size 0 max 16384 2024-08-31T04:36:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 Processor -- start 2024-08-31T04:36:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 -- start start 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf80d1b0 0x560aafbdca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbe41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b5c10 con 0x560aaf815390 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b34b0 con 0x560aaf80d1b0 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2612d24740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b1300 con 0x560aaf836070 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37490/0 (socket says 172.21.15.2:37490) 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 -- 172.21.15.2:0/2895011931 learned_addr learned my addr 172.21.15.2:0/2895011931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f260a54b640 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf80d1b0 0x560aafbdca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f260ad4c640 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbe41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 -- 172.21.15.2:0/2895011931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 msgr2=0x560aafbe41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbe41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 -- 172.21.15.2:0/2895011931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf80d1b0 msgr2=0x560aafbdca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf80d1b0 0x560aafbdca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.430+0000 7f2609d4a640 1 -- 172.21.15.2:0/2895011931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aafbe7d40 con 0x560aaf815390 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.431+0000 7f2609d4a640 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25f4012390 tx=0x7f25f4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a600569e2b14a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.431+0000 7f25effff640 1 -- 172.21.15.2:0/2895011931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4029070 con 0x560aaf815390 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.431+0000 7f25effff640 1 -- 172.21.15.2:0/2895011931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f4004230 con 0x560aaf815390 2024-08-31T04:36:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.431+0000 7f25effff640 1 -- 172.21.15.2:0/2895011931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4024690 con 0x560aaf815390 2024-08-31T04:36:17.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- 172.21.15.2:0/2895011931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 msgr2=0x560aafbe3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25f4012390 tx=0x7f25f4005f90 comp rx=0 tx=0).stop 2024-08-31T04:36:17.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- 172.21.15.2:0/2895011931 shutdown_connections 2024-08-31T04:36:17.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf815390 0x560aafbe3c70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf836070 0x560aafbe41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 --2- 172.21.15.2:0/2895011931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf80d1b0 0x560aafbdca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- 172.21.15.2:0/2895011931 >> 172.21.15.2:0/2895011931 conn(0x560aaf82a460 msgr2=0x560aafbdc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- 172.21.15.2:0/2895011931 shutdown_connections 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- 172.21.15.2:0/2895011931 wait complete. 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 -- start start 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.432+0000 7f2612d24740 1 Processor -- start 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbec280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b1970 con 0x560aaf836070 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b2de0 con 0x560aaf815390 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26041b2040 con 0x560aaf80d1b0 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2612d24740 10 client.0 _ll_register_callbacks cb 0x7f25f40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260ad4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2609d4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43678/0 (socket says 172.21.15.2:43678) 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260ad4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37492/0 (socket says 172.21.15.2:37492) 2024-08-31T04:36:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2609d4a640 1 -- 172.21.15.2:0/3204048957 learned_addr learned my addr 172.21.15.2:0/3204048957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbec280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 -- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 msgr2=0x560aafbec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 -- 172.21.15.2:0/3204048957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 msgr2=0x560aafc5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 -- 172.21.15.2:0/3204048957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aafc5b5e0 con 0x560aaf80d1b0 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f2609d4a640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260ad4c640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f260a54b640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbec280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26000cc010 tx=0x7f2600003f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e747f381ac6b674e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.433+0000 7f25edffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600049070 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f26000c8670 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f4004230 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26000cbe50 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 10 client.26716 fetch_fsmap learned FSMap version 31 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560aafc5b5e0 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26000cbb90 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f26000cc2e0 con 0x560aaf80d1b0 2024-08-31T04:36:17.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 10 client.26716 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 10 client.26716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 20 client.26716 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7c9da0 0x560aafc64d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 4 client.26716 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.434+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f25f4004230 con 0x560aaf7c9da0 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f2609d4a640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7c9da0 0x560aafc64d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f2609d4a640 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7c9da0 0x560aafc64d30 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57cdc284ac05aa1c server_cookie=fca88d404904ab72 in_seq=0 out_seq=0 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f25edffb640 10 client.26716 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f25edffb640 1 -- 172.21.15.2:0/3204048957 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x7f25f4004230 con 0x560aaf7c9da0 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f25edffb640 10 client.26716 handle_command_reply: tid=0 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f2612d24740 1 client.26716 shutdown 2024-08-31T04:36:17.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 msgr2=0x560aafbec280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.435+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbec280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26000cc010 tx=0x7f2600003f50 comp rx=0 tx=0).stop 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 shutdown_connections 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560aaf7c9da0 0x560aafc64d30 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aaf836070 0x560aafc5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560aaf815390 0x560aafbec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 --2- 172.21.15.2:0/3204048957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560aaf80d1b0 0x560aafbec280 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 >> 172.21.15.2:0/3204048957 conn(0x560aaf82a460 msgr2=0x560aafbdead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f25edffb640 0 client.26716 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 shutdown_connections 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 1 -- 172.21.15.2:0/3204048957 wait complete. 2024-08-31T04:36:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.436+0000 7f2612d24740 20 client.26716 trim_cache size 0 max 16384 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "66e2e486-38c0-4431-bffc-a4fe81855312": { 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:44.368541+0000", 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.446 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.448 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:36:17.450 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.451 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.453 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:36:17.454 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 msgr2=0x7f25f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 0x7f25f00b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009fd0 tx=0x7f25fc009500 comp rx=0 tx=0).stop 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 msgr2=0x7f260419a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2600005940 tx=0x7f26000040c0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 shutdown_connections 2024-08-31T04:36:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f25f00b4ca0 0x7f25f00b71b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2604108ab0 0x7f260419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2604108160 0x7f260419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 --2- 172.21.15.2:0/2005999145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2604102820 0x7f260419a310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 >> 172.21.15.2:0/2005999145 conn(0x7f26040794e0 msgr2=0x7f2604106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 shutdown_connections 2024-08-31T04:36:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:17.437+0000 7f260c7af640 1 -- 172.21.15.2:0/2005999145 wait complete. 2024-08-31T04:36:17.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1110733 10.57 MB/sec execute 457 sec latency 67.120 ms 2024-08-31T04:36:18.336 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:36:18.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:36:18.588 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:18.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1112315 10.57 MB/sec execute 458 sec latency 13.433 ms 2024-08-31T04:36:18.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:18 smithi002 ceph-mon[18656]: pgmap v675: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 222 op/s 2024-08-31T04:36:19.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:18 smithi064 ceph-mon[22007]: pgmap v675: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 222 op/s 2024-08-31T04:36:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:18 smithi132 ceph-mon[22335]: pgmap v675: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 222 op/s 2024-08-31T04:36:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 -- 172.21.15.2:0/2875710471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c103900 msgr2=0x7fad0c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 --2- 172.21.15.2:0/2875710471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c103900 0x7fad0c103d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7facfc009900 tx=0x7facfc02a410 comp rx=0 tx=0).stop 2024-08-31T04:36:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 -- 172.21.15.2:0/2875710471 shutdown_connections 2024-08-31T04:36:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 --2- 172.21.15.2:0/2875710471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c109b90 0x7fad0c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 --2- 172.21.15.2:0/2875710471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 --2- 172.21.15.2:0/2875710471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c103900 0x7fad0c103d10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 -- 172.21.15.2:0/2875710471 >> 172.21.15.2:0/2875710471 conn(0x7fad0c07b5f0 msgr2=0x7fad0c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 -- 172.21.15.2:0/2875710471 shutdown_connections 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.206+0000 7fad11e5a640 1 -- 172.21.15.2:0/2875710471 wait complete. 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 Processor -- start 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 -- start start 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c103900 0x7fad0c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c113850 con 0x7fad0c109b90 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1136d0 con 0x7fad0c109240 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.207+0000 7fad11e5a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1139d0 con 0x7fad0c103900 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37504/0 (socket says 172.21.15.2:37504) 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0bfff640 1 -- 172.21.15.2:0/3678145121 learned_addr learned my addr 172.21.15.2:0/3678145121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0b7fe640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c103900 0x7fad0c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 -- 172.21.15.2:0/3678145121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c103900 msgr2=0x7fad0c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c103900 0x7fad0c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 -- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 msgr2=0x7fad0c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 -- 172.21.15.2:0/3678145121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c1a0210 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0bfff640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad0affd640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c19a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad0c06c790 tx=0x7fad0000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000cc40 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad0000cde0 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00018780 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.208+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c1a0500 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.209+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1a6c60 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.210+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c103d10 con 0x7fad0c109240 2024-08-31T04:36:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.211+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fad00010a90 con 0x7fad0c109240 2024-08-31T04:36:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.212+0000 7fad08ff9640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 0x7facf40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.212+0000 7fad0b7fe640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 0x7facf40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.212+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7fad000e60d0 con 0x7fad0c109240 2024-08-31T04:36:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.212+0000 7fad0b7fe640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 0x7facf40b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7facfc031440 tx=0x7facfc009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.215+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fad000ac3c0 con 0x7fad0c109240 2024-08-31T04:36:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.454+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad0c10b960 con 0x7fad0c109240 2024-08-31T04:36:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.455+0000 7fad08ff9640 1 -- 172.21.15.2:0/3678145121 <== mon.2 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11898 (secure 0 0 0) 0x7fad000b0b80 con 0x7fad0c109240 2024-08-31T04:36:19.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:36:19.457 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-08-31T04:34:29:339032+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:34:28.729383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24646,24671,24704]},"id":1}]} 2024-08-31T04:36:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-08-31T04:36:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 msgr2=0x7facf40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 0x7facf40b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7facfc031440 tx=0x7facfc009560 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 msgr2=0x7fad0c19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c19a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad0c06c790 tx=0x7fad0000ee50 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 shutdown_connections 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7facf40b4d20 0x7facf40b7230 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0c109b90 0x7fad0c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad0c109240 0x7fad0c19a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 --2- 172.21.15.2:0/3678145121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0c103900 0x7fad0c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 >> 172.21.15.2:0/3678145121 conn(0x7fad0c07b5f0 msgr2=0x7fad0c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 shutdown_connections 2024-08-31T04:36:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:19.457+0000 7fad11e5a640 1 -- 172.21.15.2:0/3678145121 wait complete. 2024-08-31T04:36:19.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1113925 10.56 MB/sec execute 459 sec latency 102.660 ms 2024-08-31T04:36:19.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:19 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3678145121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:36:20.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:19 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3678145121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:36:20.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:19 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3678145121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:36:20.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:36:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:20.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1115554 10.57 MB/sec execute 460 sec latency 29.567 ms 2024-08-31T04:36:20.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:20 smithi002 ceph-mon[18656]: pgmap v676: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T04:36:20.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:20 smithi002 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:36:21.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:20 smithi064 ceph-mon[22007]: pgmap v676: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T04:36:21.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:20 smithi064 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:36:21.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:20 smithi132 ceph-mon[22335]: pgmap v676: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T04:36:21.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:20 smithi132 ceph-mon[22335]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T04:36:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 -- 172.21.15.2:0/1487885378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4102830 msgr2=0x7fe9c4102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/1487885378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4102830 0x7fe9c4102c40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009900 tx=0x7fe9b402a410 comp rx=0 tx=0).stop 2024-08-31T04:36:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 -- 172.21.15.2:0/1487885378 shutdown_connections 2024-08-31T04:36:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/1487885378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108ac0 0x7fe9c410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/1487885378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4108170 0x7fe9c4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/1487885378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4102830 0x7fe9c4102c40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 -- 172.21.15.2:0/1487885378 >> 172.21.15.2:0/1487885378 conn(0x7fe9c40794d0 msgr2=0x7fe9c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 -- 172.21.15.2:0/1487885378 shutdown_connections 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.096+0000 7fe9cb20e640 1 -- 172.21.15.2:0/1487885378 wait complete. 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 Processor -- start 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 -- start start 2024-08-31T04:36:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108170 0x7fe9c419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4112790 con 0x7fe9c4108ac0 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4112610 con 0x7fe9c4102830 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9cb20e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4112910 con 0x7fe9c4108170 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43706/0 (socket says 172.21.15.2:43706) 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37520/0 (socket says 172.21.15.2:37520) 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c8faa640 1 -- 172.21.15.2:0/2504294148 learned_addr learned my addr 172.21.15.2:0/2504294148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108170 0x7fe9c419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 -- 172.21.15.2:0/2504294148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108170 msgr2=0x7fe9c419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108170 0x7fe9c419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 -- 172.21.15.2:0/2504294148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 msgr2=0x7fe9c419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.097+0000 7fe9c97ab640 1 -- 172.21.15.2:0/2504294148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c4198fb0 con 0x7fe9c4108ac0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e940 tx=0x7fe9bc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9c1ffb640 1 -- 172.21.15.2:0/2504294148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004d20 con 0x7fe9c4108ac0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9c1ffb640 1 -- 172.21.15.2:0/2504294148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc005020 con 0x7fe9c4108ac0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9c1ffb640 1 -- 172.21.15.2:0/2504294148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0116d0 con 0x7fe9c4108ac0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c41992a0 con 0x7fe9c4108ac0 2024-08-31T04:36:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.098+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c41997e0 con 0x7fe9c4108ac0 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 Processor -- start 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c1ffb640 1 -- 172.21.15.2:0/2504294148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe9bc005460 con 0x7fe9c4108ac0 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 -- start start 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf941310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf941850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 0x5562bf941d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562bf8b8680 con 0x5562bf57b390 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5562bf8a7c10 con 0x5562bf5731b0 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9d1783740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5562bf8abbc0 con 0x5562bf59c070 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 0x5562bf941d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf941850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 0x5562bf941d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37526/0 (socket says 172.21.15.2:37526) 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c3fff640 1 -- 172.21.15.2:0/737728701 learned_addr learned my addr 172.21.15.2:0/737728701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf941310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c8faa640 1 -- 172.21.15.2:0/737728701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 msgr2=0x5562bf941310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.101+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf941310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c8faa640 1 -- 172.21.15.2:0/737728701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 msgr2=0x5562bf941d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 0x5562bf941d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c8faa640 1 -- 172.21.15.2:0/737728701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bf607650 con 0x5562bf5731b0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c1ffb640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 0x7fe9b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 0x7fe9b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf941850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004770 tx=0x7fe9b40314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35f1379407636ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9c1ffb640 1 -- 172.21.15.2:0/2504294148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7fe9bc0e5d70 con 0x7fe9c4108ac0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9baffd640 1 -- 172.21.15.2:0/737728701 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4035040 con 0x5562bf5731b0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9baffd640 1 -- 172.21.15.2:0/737728701 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9b4031810 con 0x5562bf5731b0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.102+0000 7fe9baffd640 1 -- 172.21.15.2:0/737728701 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40049a0 con 0x5562bf5731b0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 -- 172.21.15.2:0/737728701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 msgr2=0x5562bf941850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf941850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004770 tx=0x7fe9b40314a0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 0x7fe9b00b71b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0043c0 tx=0x7fe9ac009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 -- 172.21.15.2:0/737728701 shutdown_connections 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf57b390 0x5562bf941d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf941850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 --2- 172.21.15.2:0/737728701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf941310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 -- 172.21.15.2:0/737728701 >> 172.21.15.2:0/737728701 conn(0x5562bf590460 msgr2=0x5562bf93f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 -- 172.21.15.2:0/737728701 shutdown_connections 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.103+0000 7fe9d1783740 1 -- 172.21.15.2:0/737728701 wait complete. 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 -- start start 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 Processor -- start 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf94cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf958d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562bf70a700 con 0x5562bf5731b0 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5562bf82e750 con 0x5562bf57b390 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5562bf94fa90 con 0x5562bf59c070 2024-08-31T04:36:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37536/0 (socket says 172.21.15.2:37536) 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9c8faa640 1 -- 172.21.15.2:0/548843378 learned_addr learned my addr 172.21.15.2:0/548843378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9d1783740 10 client.0 _ll_register_callbacks cb 0x5562bf85de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf94cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.104+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf958d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 -- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 msgr2=0x5562bf958d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf958d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 -- 172.21.15.2:0/548843378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 msgr2=0x5562bf94cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf94cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 -- 172.21.15.2:0/548843378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bf867900 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf94cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004320 tx=0x7fe9b4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522011d2a665392f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b404e020 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7fe9b4003800 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b4031810 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4059050 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9d1783740 10 client.17226 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.105+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5562bf95b800 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9b4031810 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fe9b4046750 con 0x5562bf5731b0 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 10 client.17226 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 10 client.17226 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 20 client.17226 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf55a9f0 0x5562bf95eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 4 client.17226 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562bf8ba5d0 con 0x5562bf55a9f0 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.106+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf55a9f0 0x5562bf95eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.107+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf55a9f0 0x5562bf95eb60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b26b1eb463b5e7d server_cookie=56b2ae93fefd924f in_seq=0 out_seq=0 2024-08-31T04:36:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.107+0000 7fe9a3fff640 10 client.17226 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:36:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9a3fff640 1 -- 172.21.15.2:0/548843378 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562bf8ba5d0 con 0x5562bf55a9f0 2024-08-31T04:36:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9a3fff640 10 client.17226 handle_command_reply: tid=0 2024-08-31T04:36:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 client.17226 shutdown 2024-08-31T04:36:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 msgr2=0x5562bf94ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004320 tx=0x7fe9b4031400 comp rx=0 tx=0).stop 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 shutdown_connections 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf55a9f0 0x5562bf95eb60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf59c070 0x5562bf958d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf94cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9a3fff640 0 client.17226 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 --2- 172.21.15.2:0/548843378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf94ca50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 >> 172.21.15.2:0/548843378 conn(0x5562bf590460 msgr2=0x5562bf9444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 shutdown_connections 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.108+0000 7fe9d1783740 1 -- 172.21.15.2:0/548843378 wait complete. 2024-08-31T04:36:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.109+0000 7fe9d1783740 20 client.17226 trim_cache size 0 max 16384 2024-08-31T04:36:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 Processor -- start 2024-08-31T04:36:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 -- start start 2024-08-31T04:36:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf55a9f0 0x5562bf942a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf949c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b5bc0 con 0x5562bf5731b0 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b3490 con 0x5562bf57b390 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9d1783740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b12e0 con 0x5562bf55a9f0 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37548/0 (socket says 172.21.15.2:37548) 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9c3fff640 1 -- 172.21.15.2:0/1959035935 learned_addr learned my addr 172.21.15.2:0/1959035935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf949c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.123+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf55a9f0 0x5562bf942a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 -- 172.21.15.2:0/1959035935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf55a9f0 msgr2=0x5562bf942a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf55a9f0 0x5562bf942a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 -- 172.21.15.2:0/1959035935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 msgr2=0x5562bf949c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf949c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 -- 172.21.15.2:0/1959035935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bf94af50 con 0x5562bf5731b0 2024-08-31T04:36:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009640 tx=0x7fe9ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb8bed60b1272dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9ba7fc640 1 -- 172.21.15.2:0/1959035935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac012e50 con 0x5562bf5731b0 2024-08-31T04:36:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9ba7fc640 1 -- 172.21.15.2:0/1959035935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac02d430 con 0x5562bf5731b0 2024-08-31T04:36:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.124+0000 7fe9ba7fc640 1 -- 172.21.15.2:0/1959035935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00f640 con 0x5562bf5731b0 2024-08-31T04:36:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 -- 172.21.15.2:0/1959035935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 msgr2=0x5562bf958cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009640 tx=0x7fe9ac0046c0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 -- 172.21.15.2:0/1959035935 shutdown_connections 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf5731b0 0x5562bf958cf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf57b390 0x5562bf949c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 --2- 172.21.15.2:0/1959035935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf55a9f0 0x5562bf942a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 -- 172.21.15.2:0/1959035935 >> 172.21.15.2:0/1959035935 conn(0x5562bf590460 msgr2=0x5562bf942340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 -- 172.21.15.2:0/1959035935 shutdown_connections 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.125+0000 7fe9d1783740 1 -- 172.21.15.2:0/1959035935 wait complete. 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 -- start start 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 Processor -- start 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf960790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf57b390 0x5562bf960cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b1950 con 0x5562bf55a9f0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b2dc0 con 0x5562bf5731b0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41b2020 con 0x5562bf57b390 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9d1783740 10 client.0 _ll_register_callbacks cb 0x7fe9b4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9c8faa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37558/0 (socket says 172.21.15.2:37558) 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9c8faa640 1 -- 172.21.15.2:0/598822938 learned_addr learned my addr 172.21.15.2:0/598822938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.126+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf960790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c97ab640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf57b390 0x5562bf960cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 -- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf57b390 msgr2=0x5562bf960cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf57b390 0x5562bf960cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 -- 172.21.15.2:0/598822938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 msgr2=0x5562bf960790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf960790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 -- 172.21.15.2:0/598822938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bf961390 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf960790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9c8faa640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004720 tx=0x7fe9b4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3334cc30d1fc4f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4062060 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7fe9b4046860 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ac02d430 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4069050 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9d1783740 10 client.17232 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.127+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5562bf9ca190 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac02d430 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fe9b4032440 con 0x5562bf55a9f0 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 10 client.17232 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 10 client.17232 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 20 client.17232 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf59c070 0x5562bf9cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 4 client.17232 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562bf8b6070 con 0x5562bf59c070 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf59c070 0x5562bf9cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9a3fff640 10 client.17232 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.128+0000 7fe9c3fff640 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf59c070 0x5562bf9cc980 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=736bdeaa90215b6c server_cookie=f2707b9723c5c977 in_seq=0 out_seq=0 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9a3fff640 1 -- 172.21.15.2:0/598822938 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562bf8b6070 con 0x5562bf59c070 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9a3fff640 10 client.17232 handle_command_reply: tid=0 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 client.17232 shutdown 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 msgr2=0x5562bf9622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4004720 tx=0x7fe9b4005850 comp rx=0 tx=0).stop 2024-08-31T04:36:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 shutdown_connections 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5562bf59c070 0x5562bf9cc980 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5562bf57b390 0x5562bf960cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5562bf5731b0 0x5562bf960790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 --2- 172.21.15.2:0/598822938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562bf55a9f0 0x5562bf9622b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 >> 172.21.15.2:0/598822938 conn(0x5562bf590460 msgr2=0x5562bf94de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9a3fff640 0 client.17232 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 shutdown_connections 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 1 -- 172.21.15.2:0/598822938 wait complete. 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.129+0000 7fe9d1783740 20 client.17232 trim_cache size 0 max 16384 2024-08-31T04:36:21.137 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 msgr2=0x7fe9b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 0x7fe9b00b71b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0043c0 tx=0x7fe9ac009680 comp rx=0 tx=0).stop 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 msgr2=0x7fe9c419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e940 tx=0x7fe9bc00ee00 comp rx=0 tx=0).stop 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 shutdown_connections 2024-08-31T04:36:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fe9b00b4ca0 0x7fe9b00b71b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9c4108ac0 0x7fe9c419bbc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9c4108170 0x7fe9c419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 --2- 172.21.15.2:0/2504294148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9c4102830 0x7fe9c419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 >> 172.21.15.2:0/2504294148 conn(0x7fe9c40794d0 msgr2=0x7fe9c41062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 shutdown_connections 2024-08-31T04:36:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:21.130+0000 7fe9cb20e640 1 -- 172.21.15.2:0/2504294148 wait complete. 2024-08-31T04:36:21.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1116995 10.56 MB/sec execute 461 sec latency 34.339 ms 2024-08-31T04:36:22.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:36:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:22.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1118979 10.56 MB/sec execute 462 sec latency 25.691 ms 2024-08-31T04:36:22.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:22 smithi002 ceph-mon[18656]: pgmap v677: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-08-31T04:36:23.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 -- 172.21.15.2:0/3856421096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e4105010 msgr2=0x7f77e410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 --2- 172.21.15.2:0/3856421096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e4105010 0x7f77e410d650 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009900 tx=0x7f77cc02a410 comp rx=0 tx=0).stop 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 -- 172.21.15.2:0/3856421096 shutdown_connections 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 --2- 172.21.15.2:0/3856421096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e4105010 0x7f77e410d650 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 --2- 172.21.15.2:0/3856421096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e410db90 0x7f77e41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 --2- 172.21.15.2:0/3856421096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 -- 172.21.15.2:0/3856421096 >> 172.21.15.2:0/3856421096 conn(0x7f77e40794d0 msgr2=0x7f77e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 -- 172.21.15.2:0/3856421096 shutdown_connections 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.853+0000 7f77eb096640 1 -- 172.21.15.2:0/3856421096 wait complete. 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 Processor -- start 2024-08-31T04:36:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 -- start start 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e4105010 0x7f77e4102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41137f0 con 0x7f77e410db90 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4113670 con 0x7f77e41045e0 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.854+0000 7f77eb096640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4113970 con 0x7f77e4105010 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e4105010 0x7f77e4102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:43782/0 (socket says 172.21.15.2:43782) 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37570/0 (socket says 172.21.15.2:37570) 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e8e32640 1 -- 172.21.15.2:0/3184419498 learned_addr learned my addr 172.21.15.2:0/3184419498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 -- 172.21.15.2:0/3184419498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e4105010 msgr2=0x7f77e4102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e4105010 0x7f77e4102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 -- 172.21.15.2:0/3184419498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 msgr2=0x7f77e41024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 -- 172.21.15.2:0/3184419498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e41a8520 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e9633640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e970 tx=0x7f77dc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e1ffb640 1 -- 172.21.15.2:0/3184419498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00ccc0 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e1ffb640 1 -- 172.21.15.2:0/3184419498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77dc005020 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e41a8810 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.855+0000 7f77e1ffb640 1 -- 172.21.15.2:0/3184419498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc004a00 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.856+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e41a8d20 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77e1ffb640 1 -- 172.21.15.2:0/3184419498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f77dc004ba0 con 0x7f77e410db90 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 Processor -- start 2024-08-31T04:36:23.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 -- start start 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb578b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb578bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564cb5702680 con 0x564cb53bd1b0 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564cb56f1c10 con 0x564cb53c5390 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.858+0000 7f77f160b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564cb56f5bc0 con 0x564cb53e6070 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb578b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:45216/0 (socket says 172.21.15.2:45216) 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 -- 172.21.15.2:0/2080946282 learned_addr learned my addr 172.21.15.2:0/2080946282 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e1ffb640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb578bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e9633640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 -- 172.21.15.2:0/2080946282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 msgr2=0x564cb578bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb578bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 -- 172.21.15.2:0/2080946282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 msgr2=0x564cb578b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb578b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 -- 172.21.15.2:0/2080946282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb5451650 con 0x564cb53e6070 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e8e32640 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb578b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e1ffb640 1 -- 172.21.15.2:0/3184419498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f77dc0e5910 con 0x7f77e410db90 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0057c0 tx=0x7f77cc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63e6e178065979a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.859+0000 7f77e9633640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 0x7f77d00b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0a7c10 tx=0x7f77dc077d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.860+0000 7f77daffd640 1 -- 172.21.15.2:0/2080946282 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc044020 con 0x564cb53e6070 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.860+0000 7f77daffd640 1 -- 172.21.15.2:0/2080946282 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77cc0316a0 con 0x564cb53e6070 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.860+0000 7f77daffd640 1 -- 172.21.15.2:0/2080946282 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc035070 con 0x564cb53e6070 2024-08-31T04:36:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.860+0000 7f77f160b740 1 -- 172.21.15.2:0/2080946282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 msgr2=0x564cb578b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.860+0000 7f77f160b740 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0057c0 tx=0x7f77cc000bc0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 -- 172.21.15.2:0/2080946282 shutdown_connections 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb578b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb578bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 --2- 172.21.15.2:0/2080946282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53e6070 0x564cb578b310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 -- 172.21.15.2:0/2080946282 >> 172.21.15.2:0/2080946282 conn(0x564cb53da460 msgr2=0x564cb5789200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 -- 172.21.15.2:0/2080946282 shutdown_connections 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 -- 172.21.15.2:0/2080946282 wait complete. 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 -- start start 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.861+0000 7f77f160b740 1 Processor -- start 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53bd1b0 0x564cb5796a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53e6070 0x564cb57a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564cb5554700 con 0x564cb53c5390 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564cb5678750 con 0x564cb53e6070 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564cb5799a90 con 0x564cb53bd1b0 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77f160b740 10 client.0 _ll_register_callbacks cb 0x564cb56a7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37578/0 (socket says 172.21.15.2:37578) 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 -- 172.21.15.2:0/746324746 learned_addr learned my addr 172.21.15.2:0/746324746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e3fff640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53bd1b0 0x564cb5796a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e3fff640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53e6070 0x564cb57a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 -- 172.21.15.2:0/746324746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53bd1b0 msgr2=0x564cb5796a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53bd1b0 0x564cb5796a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 -- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53e6070 msgr2=0x564cb57a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53e6070 0x564cb57a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 -- 172.21.15.2:0/746324746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb56b1900 con 0x564cb53c5390 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77e8e32640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012d20 tx=0x7f77d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaebda0c18da791 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.862+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40120d0 con 0x564cb53c5390 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f77d4010430 con 0x564cb53c5390 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77cc0316a0 con 0x564cb53c5390 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f77d4012270 con 0x564cb53c5390 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 10 client.17244 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:23.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564cb57a58a0 con 0x564cb53c5390 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77cc0316a0 con 0x564cb53c5390 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f77d401c6f0 con 0x564cb53c5390 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 10 client.17244 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 10 client.17244 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 20 client.17244 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53a49f0 0x564cb57a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 4 client.17244 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cb57045d0 con 0x564cb53a49f0 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.863+0000 7f77e3fff640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53a49f0 0x564cb57a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.864+0000 7f77c3fff640 10 client.17244 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.864+0000 7f77e3fff640 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53a49f0 0x564cb57a8e60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=623d24932f657881 server_cookie=994fe352326d5627 in_seq=0 out_seq=0 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77c3fff640 1 -- 172.21.15.2:0/746324746 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564cb57045d0 con 0x564cb53a49f0 2024-08-31T04:36:23.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77c3fff640 10 client.17244 handle_command_reply: tid=0 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 client.17244 shutdown 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 msgr2=0x564cb5796fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012d20 tx=0x7f77d400f790 comp rx=0 tx=0).stop 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 shutdown_connections 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53a49f0 0x564cb57a8e60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77c3fff640 0 client.17244 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53c5390 0x564cb5796fc0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53e6070 0x564cb57a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 --2- 172.21.15.2:0/746324746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53bd1b0 0x564cb5796a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 >> 172.21.15.2:0/746324746 conn(0x564cb53da460 msgr2=0x564cb578e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 shutdown_connections 2024-08-31T04:36:23.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 1 -- 172.21.15.2:0/746324746 wait complete. 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.865+0000 7f77f160b740 20 client.17244 trim_cache size 0 max 16384 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.878+0000 7f77f160b740 1 Processor -- start 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.878+0000 7f77f160b740 1 -- start start 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 0x564cb5789230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53c5390 0x564cb57a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b5af0 con 0x564cb53bd1b0 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b33c0 con 0x564cb53a49f0 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77f160b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b1210 con 0x564cb53c5390 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37588/0 (socket says 172.21.15.2:37588) 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 0x564cb5789230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 -- 172.21.15.2:0/827704032 learned_addr learned my addr 172.21.15.2:0/827704032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:23.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e3fff640 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53c5390 0x564cb57a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 -- 172.21.15.2:0/827704032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53c5390 msgr2=0x564cb57a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53c5390 0x564cb57a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 -- 172.21.15.2:0/827704032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 msgr2=0x564cb5789230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 0x564cb5789230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 -- 172.21.15.2:0/827704032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb5797d40 con 0x564cb53bd1b0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e3fff640 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 0x564cb5789230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.879+0000 7f77e8e32640 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012870 tx=0x7f77d4009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32ee556eaece733 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77da7fc640 1 -- 172.21.15.2:0/827704032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4003970 con 0x564cb53bd1b0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77da7fc640 1 -- 172.21.15.2:0/827704032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d401c420 con 0x564cb53bd1b0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77da7fc640 1 -- 172.21.15.2:0/827704032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d401b800 con 0x564cb53bd1b0 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 -- 172.21.15.2:0/827704032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 msgr2=0x564cb57a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012870 tx=0x7f77d4009a10 comp rx=0 tx=0).stop 2024-08-31T04:36:23.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 -- 172.21.15.2:0/827704032 shutdown_connections 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb57a2c80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53c5390 0x564cb57a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 --2- 172.21.15.2:0/827704032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53a49f0 0x564cb5789230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.880+0000 7f77f160b740 1 -- 172.21.15.2:0/827704032 >> 172.21.15.2:0/827704032 conn(0x564cb53da460 msgr2=0x564cb5788b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- 172.21.15.2:0/827704032 shutdown_connections 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- 172.21.15.2:0/827704032 wait complete. 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- start start 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 Processor -- start 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 0x564cb579acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb579b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b1880 con 0x564cb53bd1b0 2024-08-31T04:36:23.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b2cf0 con 0x564cb53c5390 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41b1f50 con 0x564cb53a49f0 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.881+0000 7f77f160b740 10 client.0 _ll_register_callbacks cb 0x7f77d4009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 0x564cb579acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e8e32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37602/0 (socket says 172.21.15.2:37602) 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e8e32640 1 -- 172.21.15.2:0/2127697761 learned_addr learned my addr 172.21.15.2:0/2127697761 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb579b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 -- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 msgr2=0x564cb579b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb579b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 -- 172.21.15.2:0/2127697761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 msgr2=0x564cb579b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 -- 172.21.15.2:0/2127697761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb5812870 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e8e32640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77e3fff640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 0x564cb579acf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77cc006010 tx=0x7f77cc040040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52db662eb8b6f22d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc044040 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d401c420 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.882+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f77cc058f90 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f77cc035040 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 10 client.26758 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564cb5813af0 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d401c420 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f77cc03d450 con 0x564cb53a49f0 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 10 client.26758 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:23.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 10 client.26758 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 20 client.26758 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53e6070 0x564cb5815d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 4 client.26758 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564cb5700070 con 0x564cb53e6070 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.883+0000 7f77e8e32640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53e6070 0x564cb5815d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77c3fff640 10 client.26758 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77e8e32640 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53e6070 0x564cb5815d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38d4d0765431a359 server_cookie=d7c7659ee8a72ac9 in_seq=0 out_seq=0 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77c3fff640 1 -- 172.21.15.2:0/2127697761 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564cb5700070 con 0x564cb53e6070 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77c3fff640 10 client.26758 handle_command_reply: tid=0 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 client.26758 shutdown 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 msgr2=0x564cb579acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 0x564cb579acf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77cc006010 tx=0x7f77cc040040 comp rx=0 tx=0).stop 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 shutdown_connections 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x564cb53e6070 0x564cb5815d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564cb53bd1b0 0x564cb579b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564cb53c5390 0x564cb579b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77c3fff640 0 client.26758 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:36:23.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 --2- 172.21.15.2:0/2127697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564cb53a49f0 0x564cb579acf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 >> 172.21.15.2:0/2127697761 conn(0x564cb53da460 msgr2=0x564cb5797f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 shutdown_connections 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 1 -- 172.21.15.2:0/2127697761 wait complete. 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.884+0000 7f77f160b740 20 client.26758 trim_cache size 0 max 16384 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 msgr2=0x7f77d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 0x7f77d00b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0a7c10 tx=0x7f77dc077d90 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 msgr2=0x7f77e4102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e970 tx=0x7f77dc00ee30 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 shutdown_connections 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e410db90 0x7f77e4102f70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77e4105010 0x7f77e4102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 --2- 172.21.15.2:0/3184419498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41045e0 0x7f77e41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:23.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 >> 172.21.15.2:0/3184419498 conn(0x7f77e40794d0 msgr2=0x7f77e40ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:23.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 shutdown_connections 2024-08-31T04:36:23.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:22.885+0000 7f77eb096640 1 -- 172.21.15.2:0/3184419498 wait complete. 2024-08-31T04:36:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:22 smithi064 ceph-mon[22007]: pgmap v677: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-08-31T04:36:23.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:22 smithi132 ceph-mon[22335]: pgmap v677: 129 pgs: 129 active+clean; 620 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-08-31T04:36:23.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1120380 10.55 MB/sec execute 463 sec latency 32.528 ms 2024-08-31T04:36:23.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:36:24.175 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 -- 172.21.15.2:0/180747421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 msgr2=0x7f5f0010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 --2- 172.21.15.2:0/180747421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0010f2d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009ca0 tx=0x7f5ef802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 -- 172.21.15.2:0/180747421 shutdown_connections 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 --2- 172.21.15.2:0/180747421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0010f2d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 --2- 172.21.15.2:0/180747421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00108150 0x7f5f00108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 --2- 172.21.15.2:0/180747421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00102810 0x7f5f00102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 -- 172.21.15.2:0/180747421 >> 172.21.15.2:0/180747421 conn(0x7f5f000794d0 msgr2=0x7f5f000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 -- 172.21.15.2:0/180747421 shutdown_connections 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.666+0000 7f5f04be2640 1 -- 172.21.15.2:0/180747421 wait complete. 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.667+0000 7f5f04be2640 1 Processor -- start 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.667+0000 7f5f04be2640 1 -- start start 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 0x7f5f0019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 0x7f5f0019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00112720 con 0x7f5f00108aa0 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001125a0 con 0x7f5f00108150 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5f04be2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001128a0 con 0x7f5f00102810 2024-08-31T04:36:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 0x7f5f0019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37624/0 (socket says 172.21.15.2:37624) 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efe59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 0x7f5f0019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 -- 172.21.15.2:0/1652307581 learned_addr learned my addr 172.21.15.2:0/1652307581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 -- 172.21.15.2:0/1652307581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 msgr2=0x7f5f0019afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 0x7f5f0019afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 -- 172.21.15.2:0/1652307581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 msgr2=0x7f5f0019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 0x7f5f0019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 -- 172.21.15.2:0/1652307581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f001a6290 con 0x7f5f00108aa0 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efe59c640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 0x7f5f0019afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 0x7f5f0019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.668+0000 7f5efed9d640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8005cc0 tx=0x7f5ef8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.669+0000 7f5eef7fe640 1 -- 172.21.15.2:0/1652307581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8003b70 con 0x7f5f00108aa0 2024-08-31T04:36:24.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.669+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f001a6520 con 0x7f5f00108aa0 2024-08-31T04:36:24.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.669+0000 7f5eef7fe640 1 -- 172.21.15.2:0/1652307581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef80318f0 con 0x7f5f00108aa0 2024-08-31T04:36:24.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.669+0000 7f5eef7fe640 1 -- 172.21.15.2:0/1652307581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef802f950 con 0x7f5f00108aa0 2024-08-31T04:36:24.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.669+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f001a6ab0 con 0x7f5f00108aa0 2024-08-31T04:36:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.671+0000 7f5eef7fe640 1 -- 172.21.15.2:0/1652307581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5ef802fb50 con 0x7f5f00108aa0 2024-08-31T04:36:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 Processor -- start 2024-08-31T04:36:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 -- start start 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e5b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e5b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a95390 0x55fa85e5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa85dd2680 con 0x55fa85ab6070 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fa85dc1c10 con 0x55fa85a95390 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5f0b157740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa85dc5bc0 con 0x55fa85a8d1b0 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e5b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e5b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37640/0 (socket says 172.21.15.2:37640) 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5efdd9b640 1 -- 172.21.15.2:0/671006155 learned_addr learned my addr 172.21.15.2:0/671006155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5efe59c640 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e5b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a95390 0x55fa85e5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.672+0000 7f5eef7fe640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 0x7f5ee80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 -- 172.21.15.2:0/671006155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a95390 msgr2=0x55fa85e5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a95390 0x55fa85e5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 -- 172.21.15.2:0/671006155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 msgr2=0x55fa85e5b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e5b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 -- 172.21.15.2:0/671006155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa85b21650 con 0x55fa85a8d1b0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efed9d640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 0x7f5ee80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efe59c640 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e5b850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009fa0 tx=0x7f5ef00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26eef057860eeb07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5eef7fe640 1 -- 172.21.15.2:0/1652307581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f5ef8106af0 con 0x7f5f00108aa0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5eecff9640 1 -- 172.21.15.2:0/671006155 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004030 con 0x55fa85a8d1b0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5efed9d640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 0x7f5ee80b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80ccd00 tx=0x7f5ef8003ef0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5eecff9640 1 -- 172.21.15.2:0/671006155 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef00054d0 con 0x55fa85a8d1b0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.673+0000 7f5eecff9640 1 -- 172.21.15.2:0/671006155 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004be0 con 0x55fa85a8d1b0 2024-08-31T04:36:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 -- 172.21.15.2:0/671006155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 msgr2=0x55fa85e5b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e5b850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009fa0 tx=0x7f5ef00118d0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 -- 172.21.15.2:0/671006155 shutdown_connections 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a95390 0x55fa85e5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e5b850 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 --2- 172.21.15.2:0/671006155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e5b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 -- 172.21.15.2:0/671006155 >> 172.21.15.2:0/671006155 conn(0x55fa85aaa460 msgr2=0x55fa85e59200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 -- 172.21.15.2:0/671006155 shutdown_connections 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.674+0000 7f5f0b157740 1 -- 172.21.15.2:0/671006155 wait complete. 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 -- start start 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 Processor -- start 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a8d1b0 0x55fa85e6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e6b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa85c24700 con 0x55fa85ab6070 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fa85d48750 con 0x55fa85a8d1b0 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa85e6de50 con 0x55fa85a95390 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5f0b157740 10 client.0 _ll_register_callbacks cb 0x55fa85d77e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.675+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37642/0 (socket says 172.21.15.2:37642) 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 -- 172.21.15.2:0/880454288 learned_addr learned my addr 172.21.15.2:0/880454288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efe59c640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a8d1b0 0x55fa85e6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 -- 172.21.15.2:0/880454288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 msgr2=0x55fa85e6b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e6b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 -- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a8d1b0 msgr2=0x55fa85e6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a8d1b0 0x55fa85e6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 -- 172.21.15.2:0/880454288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa85d81900 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efe59c640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e6b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4013f20 tx=0x7f5ef4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85aa18522d9f525a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5ee5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4005020 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f5ef40051c0 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.676+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef00054d0 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5ef402d050 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 10 client.17262 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fa85e79c60 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef00054d0 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f5ef4010430 con 0x55fa85ab6070 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 10 client.17262 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 20 client.17262 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a749f0 0x55fa85e7d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 4 client.17262 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa85dd45d0 con 0x55fa85a749f0 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.677+0000 7f5efe59c640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a749f0 0x55fa85e7d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.678+0000 7f5efe59c640 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a749f0 0x55fa85e7d210 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbf07c6ee33499a6 server_cookie=a5bdc06f825565ee in_seq=0 out_seq=0 2024-08-31T04:36:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.678+0000 7f5ee5ffb640 10 client.17262 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:24.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/880454288 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa85dd45d0 con 0x55fa85a749f0 2024-08-31T04:36:24.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5ee5ffb640 10 client.17262 handle_command_reply: tid=0 2024-08-31T04:36:24.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 client.17262 shutdown 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 msgr2=0x55fa85e77180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4013f20 tx=0x7f5ef4005f90 comp rx=0 tx=0).stop 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 shutdown_connections 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a749f0 0x55fa85e7d210 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85ab6070 0x55fa85e77180 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e6b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 --2- 172.21.15.2:0/880454288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85a8d1b0 0x55fa85e6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 >> 172.21.15.2:0/880454288 conn(0x55fa85aaa460 msgr2=0x55fa85e577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5ee5ffb640 0 client.17262 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 shutdown_connections 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.679+0000 7f5f0b157740 1 -- 172.21.15.2:0/880454288 wait complete. 2024-08-31T04:36:24.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.680+0000 7f5f0b157740 20 client.17262 trim_cache size 0 max 16384 2024-08-31T04:36:24.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1122492 10.56 MB/sec execute 464 sec latency 37.138 ms 2024-08-31T04:36:24.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 Processor -- start 2024-08-31T04:36:24.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 -- start start 2024-08-31T04:36:24.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e60bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b1610 con 0x55fa85a95390 2024-08-31T04:36:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001aeee0 con 0x55fa85ab6070 2024-08-31T04:36:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.693+0000 7f5f0b157740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001acd30 con 0x55fa85a8d1b0 2024-08-31T04:36:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37652/0 (socket says 172.21.15.2:37652) 2024-08-31T04:36:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 -- 172.21.15.2:0/768339674 learned_addr learned my addr 172.21.15.2:0/768339674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 -- 172.21.15.2:0/768339674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 msgr2=0x55fa85e60bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e60bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 -- 172.21.15.2:0/768339674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 msgr2=0x55fa85e680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 -- 172.21.15.2:0/768339674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa85e6d600 con 0x55fa85a95390 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.694+0000 7f5efe59c640 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009730 tx=0x7f5ef00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc1891d631e8adc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.695+0000 7f5ee7fff640 1 -- 172.21.15.2:0/768339674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000ed90 con 0x55fa85a95390 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.695+0000 7f5ee7fff640 1 -- 172.21.15.2:0/768339674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef0019900 con 0x55fa85a95390 2024-08-31T04:36:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.695+0000 7f5ee7fff640 1 -- 172.21.15.2:0/768339674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0024410 con 0x55fa85a95390 2024-08-31T04:36:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.697+0000 7f5f0b157740 1 -- 172.21.15.2:0/768339674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 msgr2=0x55fa85e77080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.697+0000 7f5f0b157740 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009730 tx=0x7f5ef00118d0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.704+0000 7f5f0b157740 1 -- 172.21.15.2:0/768339674 shutdown_connections 2024-08-31T04:36:24.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.704+0000 7f5f0b157740 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a95390 0x55fa85e77080 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.704+0000 7f5f0b157740 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.704+0000 7f5f0b157740 1 --2- 172.21.15.2:0/768339674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a8d1b0 0x55fa85e60bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.704+0000 7f5f0b157740 1 -- 172.21.15.2:0/768339674 >> 172.21.15.2:0/768339674 conn(0x55fa85aaa460 msgr2=0x55fa85e604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.710+0000 7f5f0b157740 1 -- 172.21.15.2:0/768339674 shutdown_connections 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.710+0000 7f5f0b157740 1 -- 172.21.15.2:0/768339674 wait complete. 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 -- start start 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 Processor -- start 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a8d1b0 0x55fa85e652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e61cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001ad3a0 con 0x55fa85a8d1b0 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001ae810 con 0x55fa85ab6070 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5efdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a8d1b0 0x55fa85e652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.711+0000 7f5f0b157740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001ada70 con 0x55fa85a95390 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.712+0000 7f5f0b157740 10 client.0 _ll_register_callbacks cb 0x7f5ef4013b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.712+0000 7f5efe59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.712+0000 7f5efe59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:45302/0 (socket says 172.21.15.2:45302) 2024-08-31T04:36:24.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.712+0000 7f5efe59c640 1 -- 172.21.15.2:0/2469542179 learned_addr learned my addr 172.21.15.2:0/2469542179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.715+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e61cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.718+0000 7f5efe59c640 1 -- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 msgr2=0x55fa85e61cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.718+0000 7f5efe59c640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e61cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.718+0000 7f5efe59c640 1 -- 172.21.15.2:0/2469542179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a8d1b0 msgr2=0x55fa85e652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.718+0000 7f5efe59c640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a8d1b0 0x55fa85e652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.718+0000 7f5efe59c640 1 -- 172.21.15.2:0/2469542179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa85e62440 con 0x55fa85a95390 2024-08-31T04:36:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.719+0000 7f5efe59c640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0000c00 tx=0x7f5ef000e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6add8e444406820 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.719+0000 7f5ee5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:36:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.720+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000ee50 con 0x55fa85a95390 2024-08-31T04:36:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.720+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f5ef0016040 con 0x55fa85a95390 2024-08-31T04:36:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.720+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef0019900 con 0x55fa85a95390 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5ef0019450 con 0x55fa85a95390 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 10 client.26773 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fa85e73e50 con 0x55fa85a95390 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef00195f0 con 0x55fa85a95390 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f5ef0005040 con 0x55fa85a95390 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 10 client.26773 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 10 client.26773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 20 client.26773 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a49da0 0x55fa85ee1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 4 client.26773 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:36:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.721+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5ef0019900 con 0x55fa85a49da0 2024-08-31T04:36:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.722+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a49da0 0x55fa85ee1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.728+0000 7f5efdd9b640 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a49da0 0x55fa85ee1f40 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f0cb7851bcf39b server_cookie=ab56f9a108e4487b in_seq=0 out_seq=0 2024-08-31T04:36:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.728+0000 7f5ee5ffb640 10 client.26773 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.734+0000 7f5ee5ffb640 1 -- 172.21.15.2:0/2469542179 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5ef0019900 con 0x55fa85a49da0 2024-08-31T04:36:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.734+0000 7f5ee5ffb640 10 client.26773 handle_command_reply: tid=0 2024-08-31T04:36:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.734+0000 7f5f0b157740 1 client.26773 shutdown 2024-08-31T04:36:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.734+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 msgr2=0x55fa85e61770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.734+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0000c00 tx=0x7f5ef000e8d0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 shutdown_connections 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55fa85a49da0 0x55fa85ee1f40 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fa85ab6070 0x55fa85e61cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa85a95390 0x55fa85e61770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 --2- 172.21.15.2:0/2469542179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa85a8d1b0 0x55fa85e652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5ee5ffb640 0 client.26773 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.737+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 >> 172.21.15.2:0/2469542179 conn(0x55fa85aaa460 msgr2=0x55fa85e5c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.738+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 shutdown_connections 2024-08-31T04:36:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.739+0000 7f5f0b157740 1 -- 172.21.15.2:0/2469542179 wait complete. 2024-08-31T04:36:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.739+0000 7f5f0b157740 20 client.26773 trim_cache size 0 max 16384 2024-08-31T04:36:24.741 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:36:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.743+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 msgr2=0x7f5ee80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.743+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 0x7f5ee80b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80ccd00 tx=0x7f5ef8003ef0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.743+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 msgr2=0x7f5f0019ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.743+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8005cc0 tx=0x7f5ef8031700 comp rx=0 tx=0).stop 2024-08-31T04:36:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 shutdown_connections 2024-08-31T04:36:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f5ee80b4ca0 0x7f5ee80b71b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f00108aa0 0x7f5f0019ba50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f00108150 0x7f5f0019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 --2- 172.21.15.2:0/1652307581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f00102810 0x7f5f0019afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 >> 172.21.15.2:0/1652307581 conn(0x7f5f000794d0 msgr2=0x7f5f00105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.744+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 shutdown_connections 2024-08-31T04:36:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:24.745+0000 7f5f04be2640 1 -- 172.21.15.2:0/1652307581 wait complete. 2024-08-31T04:36:24.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:24 smithi002 ceph-mon[18656]: pgmap v678: 129 pgs: 129 active+clean; 614 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 214 op/s 2024-08-31T04:36:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:24 smithi064 ceph-mon[22007]: pgmap v678: 129 pgs: 129 active+clean; 614 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 214 op/s 2024-08-31T04:36:25.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:24 smithi132 ceph-mon[22335]: pgmap v678: 129 pgs: 129 active+clean; 614 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 214 op/s 2024-08-31T04:36:25.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1123396 10.54 MB/sec execute 465 sec latency 107.914 ms 2024-08-31T04:36:26.569 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T04:36:26.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T04:36:26.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1125791 10.54 MB/sec execute 466 sec latency 26.465 ms 2024-08-31T04:36:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:26.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:26 smithi002 ceph-mon[18656]: pgmap v679: 129 pgs: 129 active+clean; 598 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2024-08-31T04:36:27.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:26 smithi064 ceph-mon[22007]: pgmap v679: 129 pgs: 129 active+clean; 598 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2024-08-31T04:36:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:26 smithi132 ceph-mon[22335]: pgmap v679: 129 pgs: 129 active+clean; 598 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 -- 172.21.15.2:0/3006167570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 msgr2=0x7f75e810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 --2- 172.21.15.2:0/3006167570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e810f370 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009ca0 tx=0x7f75e002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 -- 172.21.15.2:0/3006167570 shutdown_connections 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 --2- 172.21.15.2:0/3006167570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e810f370 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 --2- 172.21.15.2:0/3006167570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e8108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 --2- 172.21.15.2:0/3006167570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 -- 172.21.15.2:0/3006167570 >> 172.21.15.2:0/3006167570 conn(0x7f75e8079470 msgr2=0x7f75e8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 -- 172.21.15.2:0/3006167570 shutdown_connections 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.357+0000 7f75ee376640 1 -- 172.21.15.2:0/3006167570 wait complete. 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 Processor -- start 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 -- start start 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81127f0 con 0x7f75e8108b40 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75e8112670 con 0x7f75e81081f0 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ee376640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75e8112970 con 0x7f75e81028b0 2024-08-31T04:36:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.358+0000 7f75ec913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38336/0 (socket says 172.21.15.2:38336) 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51196/0 (socket says 172.21.15.2:51196) 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 -- 172.21.15.2:0/2223277230 learned_addr learned my addr 172.21.15.2:0/2223277230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e7fff640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:45590/0 (socket says 172.21.15.2:45590) 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 -- 172.21.15.2:0/2223277230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 msgr2=0x7f75e8199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 -- 172.21.15.2:0/2223277230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 msgr2=0x7f75e81996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 -- 172.21.15.2:0/2223277230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e819efd0 con 0x7f75e8108b40 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e7fff640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ec913640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f75e00098d0 tx=0x7f75e00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e57fa640 1 -- 172.21.15.2:0/2223277230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0003b70 con 0x7f75e8108b40 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e819f260 con 0x7f75e8108b40 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e57fa640 1 -- 172.21.15.2:0/2223277230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75e0003d10 con 0x7f75e8108b40 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75e57fa640 1 -- 172.21.15.2:0/2223277230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e002f9d0 con 0x7f75e8108b40 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.359+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e81a5ae0 con 0x7f75e8108b40 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.362+0000 7f75f48eb740 1 Processor -- start 2024-08-31T04:36:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75e57fa640 1 -- 172.21.15.2:0/2223277230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f75e002fb70 con 0x7f75e8108b40 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 -- start start 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e29670 0x55eec31f1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eec31665f0 con 0x55eec2e29670 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eec3155b80 con 0x55eec2e4a350 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75f48eb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eec3159b30 con 0x55eec2e21490 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51200/0 (socket says 172.21.15.2:51200) 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75e77fe640 1 -- 172.21.15.2:0/3199434430 learned_addr learned my addr 172.21.15.2:0/3199434430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.363+0000 7f75e77fe640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e29670 0x55eec31f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 -- 172.21.15.2:0/3199434430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 msgr2=0x55eec31f0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 -- 172.21.15.2:0/3199434430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e29670 msgr2=0x55eec31f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e29670 0x55eec31f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 -- 172.21.15.2:0/3199434430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec2eb5930 con 0x55eec2e21490 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e57fa640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 0x7f75d00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e77fe640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 0x7f75d00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e7fff640 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31f0cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75d800afc0 tx=0x7f75d800f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a9299bff34a72a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75e57fa640 1 -- 172.21.15.2:0/2223277230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f75e0106b00 con 0x7f75e8108b40 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75ce7fc640 1 -- 172.21.15.2:0/3199434430 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8005220 con 0x55eec2e21490 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75ce7fc640 1 -- 172.21.15.2:0/3199434430 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75d80047a0 con 0x55eec2e21490 2024-08-31T04:36:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.364+0000 7f75ce7fc640 1 -- 172.21.15.2:0/3199434430 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8010a80 con 0x55eec2e21490 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 -- 172.21.15.2:0/3199434430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 msgr2=0x55eec31f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 0x7f75d00b7260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0058c0 tx=0x7f75dc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31f0cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75d800afc0 tx=0x7f75d800f850 comp rx=0 tx=0).stop 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 -- 172.21.15.2:0/3199434430 shutdown_connections 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e29670 0x55eec31f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31f0cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 --2- 172.21.15.2:0/3199434430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec31f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.365+0000 7f75f48eb740 1 -- 172.21.15.2:0/3199434430 >> 172.21.15.2:0/3199434430 conn(0x55eec2e3e740 msgr2=0x55eec31ee670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.366+0000 7f75f48eb740 1 -- 172.21.15.2:0/3199434430 shutdown_connections 2024-08-31T04:36:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.366+0000 7f75f48eb740 1 -- 172.21.15.2:0/3199434430 wait complete. 2024-08-31T04:36:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.366+0000 7f75f48eb740 1 -- start start 2024-08-31T04:36:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.366+0000 7f75f48eb740 1 Processor -- start 2024-08-31T04:36:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31fe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eec2fb8890 con 0x55eec2e4a350 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eec30dc790 con 0x55eec2e29670 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eec32010c0 con 0x55eec2e21490 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75f48eb740 10 client.0 _ll_register_callbacks cb 0x55eec2e61ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38356/0 (socket says 172.21.15.2:38356) 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 -- 172.21.15.2:0/498962087 learned_addr learned my addr 172.21.15.2:0/498962087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75e7fff640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31fe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 -- 172.21.15.2:0/498962087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 msgr2=0x55eec31fe0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31fe0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 -- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 msgr2=0x55eec31fe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fe610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 -- 172.21.15.2:0/498962087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec3113f30 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75e77fe640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75ec913640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f75e00ccd10 tx=0x7f75e00cc890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e0039154968fc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.367+0000 7f75c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e00efe60 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f75e00c9010 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75d80047a0 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f75e00d15f0 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 10 client.17280 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55eec320cde0 con 0x55eec2e4a350 2024-08-31T04:36:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75d80047a0 con 0x55eec2e4a350 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f75e00b40d0 con 0x55eec2e4a350 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 10 client.17280 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 20 client.17280 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2e08cd0 0x55eec3210270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 4 client.17280 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.368+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eec3168540 con 0x55eec2e08cd0 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.369+0000 7f75e7fff640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2e08cd0 0x55eec3210270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.369+0000 7f75e7fff640 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2e08cd0 0x55eec3210270 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582f235e1cbab439 server_cookie=42de91cfb8f49fab in_seq=0 out_seq=0 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.369+0000 7f75c77fe640 10 client.17280 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75c77fe640 1 -- 172.21.15.2:0/498962087 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eec3168540 con 0x55eec2e08cd0 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75c77fe640 10 client.17280 handle_command_reply: tid=0 2024-08-31T04:36:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 client.17280 shutdown 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 msgr2=0x55eec320a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f75e00ccd10 tx=0x7f75e00cc890 comp rx=0 tx=0).stop 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 shutdown_connections 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2e08cd0 0x55eec3210270 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec320a3f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75c77fe640 0 client.17280 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 --2- 172.21.15.2:0/498962087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec31fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 >> 172.21.15.2:0/498962087 conn(0x55eec2e3e740 msgr2=0x55eec31ecc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 shutdown_connections 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 1 -- 172.21.15.2:0/498962087 wait complete. 2024-08-31T04:36:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.371+0000 7f75f48eb740 20 client.17280 trim_cache size 0 max 16384 2024-08-31T04:36:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 Processor -- start 2024-08-31T04:36:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 -- start start 2024-08-31T04:36:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec320a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec31fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81b1420 con 0x55eec2e4a350 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81aecf0 con 0x55eec2e29670 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75f48eb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81acb40 con 0x55eec2e21490 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec31fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51224/0 (socket says 172.21.15.2:51224) 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75e77fe640 1 -- 172.21.15.2:0/4293959178 learned_addr learned my addr 172.21.15.2:0/4293959178 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75e7fff640 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec320a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 -- 172.21.15.2:0/4293959178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 msgr2=0x55eec320a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec320a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 -- 172.21.15.2:0/4293959178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 msgr2=0x55eec31fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.391+0000 7f75ec913640 1 -- 172.21.15.2:0/4293959178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec31f35a0 con 0x55eec2e4a350 2024-08-31T04:36:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.392+0000 7f75ec913640 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec31fce90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f75e00c8e00 tx=0x7f75e00094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada6d1ee8fab4bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.392+0000 7f75cdffb640 1 -- 172.21.15.2:0/4293959178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e00eb070 con 0x55eec2e4a350 2024-08-31T04:36:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.392+0000 7f75cdffb640 1 -- 172.21.15.2:0/4293959178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75e0036040 con 0x55eec2e4a350 2024-08-31T04:36:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.392+0000 7f75cdffb640 1 -- 172.21.15.2:0/4293959178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e00efe60 con 0x55eec2e4a350 2024-08-31T04:36:27.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- 172.21.15.2:0/4293959178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 msgr2=0x55eec31fce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec31fce90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f75e00c8e00 tx=0x7f75e00094a0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- 172.21.15.2:0/4293959178 shutdown_connections 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e4a350 0x55eec31fce90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e29670 0x55eec31fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 --2- 172.21.15.2:0/4293959178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e21490 0x55eec320a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- 172.21.15.2:0/4293959178 >> 172.21.15.2:0/4293959178 conn(0x55eec2e3e740 msgr2=0x55eec31f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- 172.21.15.2:0/4293959178 shutdown_connections 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- 172.21.15.2:0/4293959178 wait complete. 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 -- start start 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.393+0000 7f75f48eb740 1 Processor -- start 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e29670 0x55eec3206d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec3201470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81ad1b0 con 0x55eec2e21490 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81ae620 con 0x55eec2e4a350 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81ad880 con 0x55eec2e29670 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75f48eb740 10 client.0 _ll_register_callbacks cb 0x7f75e0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38378/0 (socket says 172.21.15.2:38378) 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 -- 172.21.15.2:0/2448490966 learned_addr learned my addr 172.21.15.2:0/2448490966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75ec913640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec3201470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e29670 0x55eec3206d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 -- 172.21.15.2:0/2448490966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e29670 msgr2=0x55eec3206d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e29670 0x55eec3206d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 -- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 msgr2=0x55eec3201470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:27.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec3201470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75e7fff640 1 -- 172.21.15.2:0/2448490966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec3201c00 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.394+0000 7f75ec913640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec3201470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75e7fff640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f75d800aee0 tx=0x7f75d800ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0826ba542cc972e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8010770 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f75d8010910 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75e0036040 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f75d8010b10 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 10 client.17286 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55eec327b7d0 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75e0036040 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f75d8018ca0 con 0x55eec2e21490 2024-08-31T04:36:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 10 client.17286 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 20 client.17286 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2dde080 0x55eec327ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 4 client.17286 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.395+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eec3163fe0 con 0x55eec2dde080 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.396+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2dde080 0x55eec327ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.396+0000 7f75c77fe640 10 client.17286 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:27.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.396+0000 7f75e77fe640 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2dde080 0x55eec327ddf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9171c0e7c09adbcc server_cookie=f7ebbe6c4c9a614e in_seq=0 out_seq=0 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75c77fe640 1 -- 172.21.15.2:0/2448490966 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eec3163fe0 con 0x55eec2dde080 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75c77fe640 10 client.17286 handle_command_reply: tid=0 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75f48eb740 1 client.17286 shutdown 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 msgr2=0x55eec3206770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f75d800aee0 tx=0x7f75d800ad00 comp rx=0 tx=0).stop 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.398+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 shutdown_connections 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55eec2dde080 0x55eec327ddf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eec2e4a350 0x55eec3201470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eec2e29670 0x55eec3206d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 --2- 172.21.15.2:0/2448490966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eec2e21490 0x55eec3206770 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 >> 172.21.15.2:0/2448490966 conn(0x55eec2e3e740 msgr2=0x55eec31f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75c77fe640 0 client.17286 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 shutdown_connections 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 1 -- 172.21.15.2:0/2448490966 wait complete. 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75f48eb740 20 client.17286 trim_cache size 0 max 16384 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "010808f6-01e5-464b-a861-1ea86c41e41f", 2024-08-31T04:36:27.403 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-08-31T04:36:27.404 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:36:27.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 msgr2=0x7f75d00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 0x7f75d00b7260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0058c0 tx=0x7f75dc005f90 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 msgr2=0x7f75e819e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f75e00098d0 tx=0x7f75e00317b0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 shutdown_connections 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f75d00b4d50 0x7f75d00b7260 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e8108b40 0x7f75e819e960 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e81081f0 0x7f75e81996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 --2- 172.21.15.2:0/2223277230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75e81028b0 0x7f75e8199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.399+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 >> 172.21.15.2:0/2223277230 conn(0x7f75e8079470 msgr2=0x7f75e8106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.400+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 shutdown_connections 2024-08-31T04:36:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:27.400+0000 7f75ee376640 1 -- 172.21.15.2:0/2223277230 wait complete. 2024-08-31T04:36:27.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1126756 10.53 MB/sec execute 467 sec latency 105.802 ms 2024-08-31T04:36:28.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:36:28.501 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:36:28.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1129314 10.54 MB/sec execute 468 sec latency 26.180 ms 2024-08-31T04:36:28.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: pgmap v680: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub queued for path: / 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:28.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:28 smithi002 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 -- 172.21.15.2:0/1718263436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c075ea0 msgr2=0x7f221c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 --2- 172.21.15.2:0/1718263436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c075ea0 0x7f221c10f920 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2210009900 tx=0x7f221002a410 comp rx=0 tx=0).stop 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 -- 172.21.15.2:0/1718263436 shutdown_connections 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 --2- 172.21.15.2:0/1718263436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c075ea0 0x7f221c10f920 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 --2- 172.21.15.2:0/1718263436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c10fe60 0x7f221c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 --2- 172.21.15.2:0/1718263436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075550 0x7f221c075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 -- 172.21.15.2:0/1718263436 >> 172.21.15.2:0/1718263436 conn(0x7f221c07b5f0 msgr2=0x7f221c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.014+0000 7f222408c640 1 -- 172.21.15.2:0/1718263436 shutdown_connections 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.015+0000 7f222408c640 1 -- 172.21.15.2:0/1718263436 wait complete. 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.015+0000 7f222408c640 1 Processor -- start 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.015+0000 7f222408c640 1 -- start start 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c075550 0x7f221c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075ea0 0x7f221c19c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f221c115a10 con 0x7f221c10fe60 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f221c115890 con 0x7f221c075ea0 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f221c115b90 con 0x7f221c075550 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2221627640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075ea0 0x7f221c19c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38404/0 (socket says 172.21.15.2:38404) 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2221e28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c075550 0x7f221c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 -- 172.21.15.2:0/1280437870 learned_addr learned my addr 172.21.15.2:0/1280437870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 -- 172.21.15.2:0/1280437870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c075550 msgr2=0x7f221c19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c075550 0x7f221c19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 -- 172.21.15.2:0/1280437870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075ea0 msgr2=0x7f221c19c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075ea0 0x7f221c19c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 -- 172.21.15.2:0/1280437870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c1a2330 con 0x7f221c10fe60 2024-08-31T04:36:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f2222629640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f221400e970 tx=0x7f221400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f221affd640 1 -- 172.21.15.2:0/1280437870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221400ccc0 con 0x7f221c10fe60 2024-08-31T04:36:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.016+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221c1a2620 con 0x7f221c10fe60 2024-08-31T04:36:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.017+0000 7f221affd640 1 -- 172.21.15.2:0/1280437870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f221400ce60 con 0x7f221c10fe60 2024-08-31T04:36:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.017+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221c1a8d80 con 0x7f221c10fe60 2024-08-31T04:36:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.017+0000 7f221affd640 1 -- 172.21.15.2:0/1280437870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214010430 con 0x7f221c10fe60 2024-08-31T04:36:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.019+0000 7f222a601740 1 Processor -- start 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.019+0000 7f221affd640 1 -- 172.21.15.2:0/1280437870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2214004f90 con 0x7f221c10fe60 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 -- start start 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d48f070 0x560b8d8342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 0x560b8d834d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b8d7ab630 con 0x560b8d46e390 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560b8d79abc0 con 0x560b8d4661b0 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f222a601740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560b8d79eb70 con 0x560b8d48f070 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221627640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 0x560b8d834d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221627640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 0x560b8d834d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38412/0 (socket says 172.21.15.2:38412) 2024-08-31T04:36:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51268/0 (socket says 172.21.15.2:51268) 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221627640 1 -- 172.21.15.2:0/3047139284 learned_addr learned my addr 172.21.15.2:0/3047139284 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221627640 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d48f070 0x560b8d8342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 -- 172.21.15.2:0/3047139284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d48f070 msgr2=0x560b8d8342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d48f070 0x560b8d8342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 -- 172.21.15.2:0/3047139284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 msgr2=0x560b8d834d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 0x560b8d834d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f221affd640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 0x7f22040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.020+0000 7f2221e28640 1 -- 172.21.15.2:0/3047139284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8d4fa650 con 0x560b8d4661b0 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f221affd640 1 -- 172.21.15.2:0/1280437870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f22140e5d70 con 0x7f221c10fe60 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f2221627640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 0x7f22040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f2221e28640 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f220c009fa0 tx=0x7f220c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e83305b5baaf4747 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f2203fff640 1 -- 172.21.15.2:0/3047139284 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c003c30 con 0x560b8d4661b0 2024-08-31T04:36:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f2203fff640 1 -- 172.21.15.2:0/3047139284 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f220c003dd0 con 0x560b8d4661b0 2024-08-31T04:36:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.021+0000 7f2203fff640 1 -- 172.21.15.2:0/3047139284 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c00f9f0 con 0x560b8d4661b0 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- 172.21.15.2:0/3047139284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 msgr2=0x560b8d834800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f220c009fa0 tx=0x7f220c0118d0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f2221627640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 0x7f22040b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f22100096c0 tx=0x7f2210005780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- 172.21.15.2:0/3047139284 shutdown_connections 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d46e390 0x560b8d834d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d4661b0 0x560b8d834800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 --2- 172.21.15.2:0/3047139284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d48f070 0x560b8d8342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- 172.21.15.2:0/3047139284 >> 172.21.15.2:0/3047139284 conn(0x560b8d483460 msgr2=0x560b8d8321b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- 172.21.15.2:0/3047139284 shutdown_connections 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- 172.21.15.2:0/3047139284 wait complete. 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.022+0000 7f222a601740 1 -- start start 2024-08-31T04:36:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 Processor -- start 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d84bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b8d5fd700 con 0x560b8d4661b0 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560b8d721700 con 0x560b8d48f070 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560b8d842aa0 con 0x560b8d46e390 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f222a601740 10 client.0 _ll_register_callbacks cb 0x560b8d750dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2221e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2221e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38422/0 (socket says 172.21.15.2:38422) 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2221e28640 1 -- 172.21.15.2:0/4088614809 learned_addr learned my addr 172.21.15.2:0/4088614809 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2221627640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2222629640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d84bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.023+0000 7f2221e28640 1 -- 172.21.15.2:0/4088614809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 msgr2=0x560b8d83ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f2221e28640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f2221e28640 1 -- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 msgr2=0x560b8d84bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f2221e28640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d84bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f2221e28640 1 -- 172.21.15.2:0/4088614809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8d75a8b0 con 0x560b8d4661b0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f2221e28640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f220c004cf0 tx=0x7f220c004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f75099f3becfe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f22017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c028020 con 0x560b8d4661b0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f220c00f940 con 0x560b8d4661b0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f220c003dd0 con 0x560b8d4661b0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f220c033050 con 0x560b8d4661b0 2024-08-31T04:36:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f222a601740 10 client.17298 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560b8d84e880 con 0x560b8d4661b0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.024+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f220c003dd0 con 0x560b8d4661b0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f220c004620 con 0x560b8d4661b0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 10 client.17298 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 20 client.17298 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d44d9f0 0x560b8d851cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 4 client.17298 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b8d7ad580 con 0x560b8d44d9f0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f2221627640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d44d9f0 0x560b8d851cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f2221627640 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d44d9f0 0x560b8d851cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c39f1352f3fd85 server_cookie=299b974b2565caa8 in_seq=0 out_seq=0 2024-08-31T04:36:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.025+0000 7f22017fa640 10 client.17298 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f22017fa640 1 -- 172.21.15.2:0/4088614809 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b8d7ad580 con 0x560b8d44d9f0 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f22017fa640 10 client.17298 handle_command_reply: tid=0 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 client.17298 shutdown 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 msgr2=0x560b8d83fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f220c004cf0 tx=0x7f220c004d20 comp rx=0 tx=0).stop 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 shutdown_connections 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d44d9f0 0x560b8d851cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d84bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 --2- 172.21.15.2:0/4088614809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83fa20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f22017fa640 0 client.17298 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 >> 172.21.15.2:0/4088614809 conn(0x560b8d483460 msgr2=0x560b8d837450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.026+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 shutdown_connections 2024-08-31T04:36:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.027+0000 7f222a601740 1 -- 172.21.15.2:0/4088614809 wait complete. 2024-08-31T04:36:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.027+0000 7f222a601740 20 client.17298 trim_cache size 0 max 16384 2024-08-31T04:36:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.046+0000 7f222a601740 1 Processor -- start 2024-08-31T04:36:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.046+0000 7f222a601740 1 -- start start 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d8373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b5b60 con 0x560b8d4661b0 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b3430 con 0x560b8d48f070 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f222a601740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b1280 con 0x560b8d46e390 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38430/0 (socket says 172.21.15.2:38430) 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221e28640 1 -- 172.21.15.2:0/2283651190 learned_addr learned my addr 172.21.15.2:0/2283651190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2222629640 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d8373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 -- 172.21.15.2:0/2283651190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 msgr2=0x560b8d8373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d8373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 -- 172.21.15.2:0/2283651190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 msgr2=0x560b8d83e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 -- 172.21.15.2:0/2283651190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8d840350 con 0x560b8d46e390 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.047+0000 7f2221627640 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83e7e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2210009230 tx=0x7f2210041070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f86d0dfba001ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.048+0000 7f22037fe640 1 -- 172.21.15.2:0/2283651190 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210058070 con 0x560b8d46e390 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.048+0000 7f22037fe640 1 -- 172.21.15.2:0/2283651190 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22100044c0 con 0x560b8d46e390 2024-08-31T04:36:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.048+0000 7f22037fe640 1 -- 172.21.15.2:0/2283651190 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210035040 con 0x560b8d46e390 2024-08-31T04:36:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.048+0000 7f222a601740 1 -- 172.21.15.2:0/2283651190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 msgr2=0x560b8d83e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.048+0000 7f222a601740 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83e7e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2210009230 tx=0x7f2210041070 comp rx=0 tx=0).stop 2024-08-31T04:36:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- 172.21.15.2:0/2283651190 shutdown_connections 2024-08-31T04:36:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d48f070 0x560b8d8373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d46e390 0x560b8d83e7e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- 172.21.15.2:0/2283651190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d4661b0 0x560b8d83e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- 172.21.15.2:0/2283651190 >> 172.21.15.2:0/2283651190 conn(0x560b8d483460 msgr2=0x560b8d83ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- 172.21.15.2:0/2283651190 shutdown_connections 2024-08-31T04:36:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- 172.21.15.2:0/2283651190 wait complete. 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- start start 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 Processor -- start 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 0x560b8d848360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b18f0 con 0x560b8d48f070 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b2d60 con 0x560b8d46e390 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.049+0000 7f222a601740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f221c1b1fc0 con 0x560b8d4661b0 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f222a601740 10 client.0 _ll_register_callbacks cb 0x7f2214005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2222629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2222629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38444/0 (socket says 172.21.15.2:38444) 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:51310/0 (socket says 172.21.15.2:51310) 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2222629640 1 -- 172.21.15.2:0/4251893288 learned_addr learned my addr 172.21.15.2:0/4251893288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221e28640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 0x560b8d848360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 -- 172.21.15.2:0/4251893288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 msgr2=0x560b8d848360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 0x560b8d848360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 -- 172.21.15.2:0/4251893288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 msgr2=0x560b8d843da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 -- 172.21.15.2:0/4251893288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8d844390 con 0x560b8d46e390 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2222629640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221e28640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 0x560b8d848360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f2221627640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2210000c00 tx=0x7f2210005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b40c78036d074163 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f22017fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210035070 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b8d7a9020 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.050+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f2210005030 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2210058040 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 10 client.27014 fetch_fsmap learned FSMap version 32 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560b8d8bc2a0 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560b8d7a9020 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f221003d690 con 0x560b8d46e390 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 10 client.27014 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 10 client.27014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 20 client.27014 populate_metadata read hostname 'smithi002' 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d422da0 0x560b8d8be930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 4 client.27014 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b8d7a6760 con 0x560b8d422da0 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.051+0000 7f2221e28640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d422da0 0x560b8d8be930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.052+0000 7f2221e28640 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d422da0 0x560b8d8be930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2b4ca216bdbb3c server_cookie=d54eb5806fa4a3ef in_seq=0 out_seq=0 2024-08-31T04:36:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.052+0000 7f22017fa640 10 client.27014 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: pgmap v680: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub queued for path: / 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub summary: active paths [/] 2024-08-31T04:36:29.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:28 smithi132 ceph-mon[22335]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: pgmap v680: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub queued for path: / 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.412 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:28 smithi064 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f22017fa640 1 -- 172.21.15.2:0/4251893288 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x560b8d7a6760 con 0x560b8d422da0 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f22017fa640 10 client.27014 handle_command_reply: tid=0 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 client.27014 shutdown 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 msgr2=0x560b8d843860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2210000c00 tx=0x7f2210005e50 comp rx=0 tx=0).stop 2024-08-31T04:36:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 shutdown_connections 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x560b8d422da0 0x560b8d8be930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b8d48f070 0x560b8d843da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560b8d46e390 0x560b8d843860 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 --2- 172.21.15.2:0/4251893288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b8d4661b0 0x560b8d848360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f22017fa640 0 client.27014 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 >> 172.21.15.2:0/4251893288 conn(0x560b8d483460 msgr2=0x560b8d837120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.053+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 shutdown_connections 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222a601740 1 -- 172.21.15.2:0/4251893288 wait complete. 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222a601740 20 client.27014 trim_cache size 0 max 16384 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "010808f6-01e5-464b-a861-1ea86c41e41f": { 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "010808f6-01e5-464b-a861-1ea86c41e41f", 2024-08-31T04:36:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "010808f6-01e5-464b-a861-1ea86c41e41f": { 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:36:27.397738+0000", 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:36:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "66e2e486-38c0-4431-bffc-a4fe81855312": { 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:44.368541+0000", 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:36:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:36:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:36:29.426 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:36:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 msgr2=0x7f22040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 0x7f22040b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f22100096c0 tx=0x7f2210005780 comp rx=0 tx=0).stop 2024-08-31T04:36:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 msgr2=0x7f221c1a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f221400e970 tx=0x7f221400ed70 comp rx=0 tx=0).stop 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 shutdown_connections 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f22040b4ca0 0x7f22040b71b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f221c10fe60 0x7f221c1a1c00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221c075ea0 0x7f221c19c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 --2- 172.21.15.2:0/1280437870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f221c075550 0x7f221c19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 >> 172.21.15.2:0/1280437870 conn(0x7f221c07b5f0 msgr2=0x7f221c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 shutdown_connections 2024-08-31T04:36:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:36:29.054+0000 7f222408c640 1 -- 172.21.15.2:0/1280437870 wait complete. 2024-08-31T04:36:29.691 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1130380 10.53 MB/sec execute 469 sec latency 36.193 ms 2024-08-31T04:36:29.814 INFO:tasks.cephfs.filesystem:scrub status for tag:010808f6-01e5-464b-a861-1ea86c41e41f - {'path': '/', 'tag': '010808f6-01e5-464b-a861-1ea86c41e41f', 'options': 'recursive,force'} 2024-08-31T04:36:30.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1132060 10.52 MB/sec execute 470 sec latency 45.342 ms 2024-08-31T04:36:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:30 smithi064 ceph-mon[22007]: pgmap v681: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:36:31.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:30 smithi132 ceph-mon[22335]: pgmap v681: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:36:31.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:30 smithi002 ceph-mon[18656]: pgmap v681: 129 pgs: 129 active+clean; 585 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 182 op/s 2024-08-31T04:36:31.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1133526 10.52 MB/sec execute 471 sec latency 16.173 ms 2024-08-31T04:36:32.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1135438 10.52 MB/sec execute 472 sec latency 31.486 ms 2024-08-31T04:36:33.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:32 smithi064 ceph-mon[22007]: pgmap v682: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-08-31T04:36:33.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:32 smithi132 ceph-mon[22335]: pgmap v682: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-08-31T04:36:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:32 smithi002 ceph-mon[18656]: pgmap v682: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-08-31T04:36:33.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1136923 10.52 MB/sec execute 473 sec latency 15.723 ms 2024-08-31T04:36:34.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:33 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:36:34.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:33 smithi064 ceph-mon[22007]: scrub summary: idle 2024-08-31T04:36:34.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:33 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:36:34.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:33 smithi132 ceph-mon[22335]: scrub summary: idle 2024-08-31T04:36:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:33 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:36:34.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:33 smithi002 ceph-mon[18656]: scrub summary: idle 2024-08-31T04:36:34.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1138432 10.51 MB/sec execute 474 sec latency 39.616 ms 2024-08-31T04:36:35.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:34 smithi064 ceph-mon[22007]: pgmap v683: 129 pgs: 129 active+clean; 595 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:36:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:34 smithi132 ceph-mon[22335]: pgmap v683: 129 pgs: 129 active+clean; 595 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:36:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:34 smithi002 ceph-mon[18656]: pgmap v683: 129 pgs: 129 active+clean; 595 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2024-08-31T04:36:35.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1140320 10.51 MB/sec execute 475 sec latency 50.630 ms 2024-08-31T04:36:36.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1141720 10.50 MB/sec execute 476 sec latency 22.641 ms 2024-08-31T04:36:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:36 smithi064 ceph-mon[22007]: pgmap v684: 129 pgs: 129 active+clean; 600 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 197 op/s 2024-08-31T04:36:37.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:36 smithi132 ceph-mon[22335]: pgmap v684: 129 pgs: 129 active+clean; 600 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 197 op/s 2024-08-31T04:36:37.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:36 smithi002 ceph-mon[18656]: pgmap v684: 129 pgs: 129 active+clean; 600 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 197 op/s 2024-08-31T04:36:37.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1143833 10.51 MB/sec execute 477 sec latency 18.976 ms 2024-08-31T04:36:38.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1145169 10.50 MB/sec execute 478 sec latency 29.693 ms 2024-08-31T04:36:39.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:38 smithi064 ceph-mon[22007]: pgmap v685: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-08-31T04:36:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:38 smithi132 ceph-mon[22335]: pgmap v685: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-08-31T04:36:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:38 smithi002 ceph-mon[18656]: pgmap v685: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-08-31T04:36:39.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1147299 10.50 MB/sec execute 479 sec latency 39.334 ms 2024-08-31T04:36:40.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1148176 10.49 MB/sec execute 480 sec latency 68.463 ms 2024-08-31T04:36:41.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:40 smithi064 ceph-mon[22007]: pgmap v686: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-08-31T04:36:41.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:40 smithi132 ceph-mon[22335]: pgmap v686: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-08-31T04:36:41.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:40 smithi002 ceph-mon[18656]: pgmap v686: 129 pgs: 129 active+clean; 607 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-08-31T04:36:41.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1149746 10.48 MB/sec execute 481 sec latency 244.887 ms 2024-08-31T04:36:42.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1151392 10.48 MB/sec execute 482 sec latency 20.818 ms 2024-08-31T04:36:42.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:42 smithi002 ceph-mon[18656]: pgmap v687: 129 pgs: 129 active+clean; 608 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 169 op/s 2024-08-31T04:36:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:42 smithi064 ceph-mon[22007]: pgmap v687: 129 pgs: 129 active+clean; 608 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 169 op/s 2024-08-31T04:36:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:42 smithi132 ceph-mon[22335]: pgmap v687: 129 pgs: 129 active+clean; 608 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 169 op/s 2024-08-31T04:36:43.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1153334 10.48 MB/sec execute 483 sec latency 48.866 ms 2024-08-31T04:36:44.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1154918 10.48 MB/sec execute 484 sec latency 18.269 ms 2024-08-31T04:36:45.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:44 smithi064 ceph-mon[22007]: pgmap v688: 129 pgs: 129 active+clean; 619 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2024-08-31T04:36:45.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:44 smithi132 ceph-mon[22335]: pgmap v688: 129 pgs: 129 active+clean; 619 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2024-08-31T04:36:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:44 smithi002 ceph-mon[18656]: pgmap v688: 129 pgs: 129 active+clean; 619 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2024-08-31T04:36:45.692 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1156245 10.47 MB/sec execute 485 sec latency 68.828 ms 2024-08-31T04:36:46.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1158045 10.47 MB/sec execute 486 sec latency 46.297 ms 2024-08-31T04:36:47.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:46 smithi064 ceph-mon[22007]: pgmap v689: 129 pgs: 129 active+clean; 621 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-31T04:36:47.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:46 smithi132 ceph-mon[22335]: pgmap v689: 129 pgs: 129 active+clean; 621 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-31T04:36:47.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:46 smithi002 ceph-mon[18656]: pgmap v689: 129 pgs: 129 active+clean; 621 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-31T04:36:47.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1159433 10.46 MB/sec execute 487 sec latency 30.723 ms 2024-08-31T04:36:48.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1161560 10.47 MB/sec execute 488 sec latency 45.774 ms 2024-08-31T04:36:49.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:48 smithi064 ceph-mon[22007]: pgmap v690: 129 pgs: 129 active+clean; 629 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 212 op/s 2024-08-31T04:36:49.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:48 smithi132 ceph-mon[22335]: pgmap v690: 129 pgs: 129 active+clean; 629 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 212 op/s 2024-08-31T04:36:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:48 smithi002 ceph-mon[18656]: pgmap v690: 129 pgs: 129 active+clean; 629 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 212 op/s 2024-08-31T04:36:49.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1162930 10.46 MB/sec execute 489 sec latency 39.784 ms 2024-08-31T04:36:50.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1165017 10.46 MB/sec execute 490 sec latency 66.867 ms 2024-08-31T04:36:51.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:50 smithi064 ceph-mon[22007]: pgmap v691: 129 pgs: 129 active+clean; 630 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 168 op/s 2024-08-31T04:36:51.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:50 smithi132 ceph-mon[22335]: pgmap v691: 129 pgs: 129 active+clean; 630 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 168 op/s 2024-08-31T04:36:51.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:50 smithi002 ceph-mon[18656]: pgmap v691: 129 pgs: 129 active+clean; 630 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 168 op/s 2024-08-31T04:36:51.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1166007 10.45 MB/sec execute 491 sec latency 26.120 ms 2024-08-31T04:36:52.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1168386 10.45 MB/sec execute 492 sec latency 38.985 ms 2024-08-31T04:36:53.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:52 smithi064 ceph-mon[22007]: pgmap v692: 129 pgs: 129 active+clean; 631 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 181 op/s 2024-08-31T04:36:53.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:52 smithi132 ceph-mon[22335]: pgmap v692: 129 pgs: 129 active+clean; 631 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 181 op/s 2024-08-31T04:36:53.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:52 smithi002 ceph-mon[18656]: pgmap v692: 129 pgs: 129 active+clean; 631 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 181 op/s 2024-08-31T04:36:53.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1169370 10.44 MB/sec execute 493 sec latency 30.612 ms 2024-08-31T04:36:54.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1171564 10.45 MB/sec execute 494 sec latency 32.030 ms 2024-08-31T04:36:55.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:54 smithi064 ceph-mon[22007]: pgmap v693: 129 pgs: 129 active+clean; 637 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-08-31T04:36:55.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:54 smithi132 ceph-mon[22335]: pgmap v693: 129 pgs: 129 active+clean; 637 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-08-31T04:36:55.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:54 smithi002 ceph-mon[18656]: pgmap v693: 129 pgs: 129 active+clean; 637 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-08-31T04:36:55.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1172672 10.44 MB/sec execute 495 sec latency 31.988 ms 2024-08-31T04:36:56.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1174527 10.43 MB/sec execute 496 sec latency 31.117 ms 2024-08-31T04:36:57.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:56 smithi064 ceph-mon[22007]: pgmap v694: 129 pgs: 129 active+clean; 641 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 183 op/s 2024-08-31T04:36:57.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:56 smithi132 ceph-mon[22335]: pgmap v694: 129 pgs: 129 active+clean; 641 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 183 op/s 2024-08-31T04:36:57.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:56 smithi002 ceph-mon[18656]: pgmap v694: 129 pgs: 129 active+clean; 641 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 183 op/s 2024-08-31T04:36:57.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1176073 10.43 MB/sec execute 497 sec latency 22.233 ms 2024-08-31T04:36:58.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1178046 10.43 MB/sec execute 498 sec latency 29.467 ms 2024-08-31T04:36:58.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:36:58 smithi002 ceph-mon[18656]: pgmap v695: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.3 MiB/s wr, 224 op/s 2024-08-31T04:36:59.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:36:58 smithi064 ceph-mon[22007]: pgmap v695: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.3 MiB/s wr, 224 op/s 2024-08-31T04:36:59.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:36:58 smithi132 ceph-mon[22335]: pgmap v695: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.3 MiB/s wr, 224 op/s 2024-08-31T04:36:59.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1179665 10.43 MB/sec execute 499 sec latency 14.540 ms 2024-08-31T04:36:59.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T04:37:00.114 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- 172.21.15.2:0/2157871764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108aa0 msgr2=0x7f17d410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 --2- 172.21.15.2:0/2157871764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108aa0 0x7f17d410f2d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009ca0 tx=0x7f17cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- 172.21.15.2:0/2157871764 shutdown_connections 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 --2- 172.21.15.2:0/2157871764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108aa0 0x7f17d410f2d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 --2- 172.21.15.2:0/2157871764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108150 0x7f17d4108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 --2- 172.21.15.2:0/2157871764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d4103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- 172.21.15.2:0/2157871764 >> 172.21.15.2:0/2157871764 conn(0x7f17d4077a00 msgr2=0x7f17d4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- 172.21.15.2:0/2157871764 shutdown_connections 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- 172.21.15.2:0/2157871764 wait complete. 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 Processor -- start 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.661+0000 7f17d9d90640 1 -- start start 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 0x7f17d419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4113880 con 0x7f17d4108150 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4113700 con 0x7f17d4102f20 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d9d90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4113a00 con 0x7f17d4108aa0 2024-08-31T04:37:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54680/0 (socket says 172.21.15.2:54680) 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17cbfff640 1 -- 172.21.15.2:0/4207248544 learned_addr learned my addr 172.21.15.2:0/4207248544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d3fff640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 0x7f17d419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 -- 172.21.15.2:0/4207248544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 msgr2=0x7f17d419fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 0x7f17d419fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 -- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 msgr2=0x7f17d419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d37fe640 1 -- 172.21.15.2:0/4207248544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d41a01c0 con 0x7f17d4102f20 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17d3fff640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 0x7f17d419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.662+0000 7f17cbfff640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d37fe640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d419a250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009bc0 tx=0x7f17c400b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d17fa640 1 -- 172.21.15.2:0/4207248544 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c401e070 con 0x7f17d4102f20 2024-08-31T04:37:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d17fa640 1 -- 172.21.15.2:0/4207248544 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c40198c0 con 0x7f17d4102f20 2024-08-31T04:37:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d17fa640 1 -- 172.21.15.2:0/4207248544 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40187d0 con 0x7f17d4102f20 2024-08-31T04:37:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d41a04b0 con 0x7f17d4102f20 2024-08-31T04:37:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.663+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d410fc90 con 0x7f17d4102f20 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17d17fa640 1 -- 172.21.15.2:0/4207248544 <== mon.2 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f17c4021070 con 0x7f17d4102f20 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 Processor -- start 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 -- start start 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaeed1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeed1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bcaee48630 con 0x55bcaeb0b390 2024-08-31T04:37:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bcaee37bc0 con 0x55bcaeb031b0 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.666+0000 7f17e0305740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55bcaee3bb70 con 0x55bcaeb2c070 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeed1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48236/0 (socket says 172.21.15.2:48236) 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 -- 172.21.15.2:0/1993527625 learned_addr learned my addr 172.21.15.2:0/1993527625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d3fff640 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaeed1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d17fa640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 0x7f17c00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 -- 172.21.15.2:0/1993527625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 msgr2=0x55bcaeed1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaeed1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 -- 172.21.15.2:0/1993527625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 msgr2=0x55bcaeed1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeed1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 -- 172.21.15.2:0/1993527625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcaeb97650 con 0x55bcaeb031b0 2024-08-31T04:37:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d3fff640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 0x7f17c00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17d37fe640 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f17c40e62e0 tx=0x7f17c40c0eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60549d6e250676da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.667+0000 7f17c9ffb640 1 -- 172.21.15.2:0/1993527625 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40af380 con 0x55bcaeb031b0 2024-08-31T04:37:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.668+0000 7f17c9ffb640 1 -- 172.21.15.2:0/1993527625 <== mon.2 v2:172.21.15.64:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c40db430 con 0x55bcaeb031b0 2024-08-31T04:37:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.668+0000 7f17c9ffb640 1 -- 172.21.15.2:0/1993527625 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c407d100 con 0x55bcaeb031b0 2024-08-31T04:37:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.668+0000 7f17d17fa640 1 -- 172.21.15.2:0/4207248544 <== mon.2 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f17c40e90c0 con 0x7f17d4102f20 2024-08-31T04:37:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 -- 172.21.15.2:0/1993527625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 msgr2=0x55bcaeed1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17d3fff640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 0x7f17c00b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f17cc004af0 tx=0x7f17cc0095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f17c40e62e0 tx=0x7f17c40c0eb0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 -- 172.21.15.2:0/1993527625 shutdown_connections 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeed1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb031b0 0x55bcaeed1840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 --2- 172.21.15.2:0/1993527625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaeed1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 -- 172.21.15.2:0/1993527625 >> 172.21.15.2:0/1993527625 conn(0x55bcaeb20460 msgr2=0x55bcaeecf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 -- 172.21.15.2:0/1993527625 shutdown_connections 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.669+0000 7f17e0305740 1 -- 172.21.15.2:0/1993527625 wait complete. 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 -- start start 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 Processor -- start 2024-08-31T04:37:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb2c070 0x55bcaeedd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeee8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bcaec9a700 con 0x55bcaeb2c070 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48244/0 (socket says 172.21.15.2:48244) 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17d37fe640 1 -- 172.21.15.2:0/126152951 learned_addr learned my addr 172.21.15.2:0/126152951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bcaedbe700 con 0x55bcaeb0b390 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55bcaeedfa80 con 0x55bcaeaea9f0 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.670+0000 7f17e0305740 10 client.0 _ll_register_callbacks cb 0x55bcaededdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17cbfff640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb2c070 0x55bcaeedd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d3fff640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeee8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 -- 172.21.15.2:0/126152951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 msgr2=0x55bcaeee8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeee8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 -- 172.21.15.2:0/126152951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb2c070 msgr2=0x55bcaeedd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb2c070 0x55bcaeedd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcaedf78b0 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17d37fe640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17c40af2b0 tx=0x7f17c40db340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e777edd349e877 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40aed20 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f17c40ec720 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.671+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bcaee4a580 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f17c40aef00 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 10 client.27026 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcaeeeb950 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c40d20b0 con 0x55bcaeb0b390 2024-08-31T04:37:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f17c40e6620 con 0x55bcaeb0b390 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 10 client.27026 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 10 client.27026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 20 client.27026 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaeabfda0 0x55bcaeeeecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 4 client.27026 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcaee4a580 con 0x55bcaeabfda0 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.672+0000 7f17cbfff640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaeabfda0 0x55bcaeeeecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.673+0000 7f17b2ffd640 10 client.27026 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:00.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.673+0000 7f17cbfff640 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaeabfda0 0x55bcaeeeecb0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710e9b42a7ada4ef server_cookie=65492edeba2517f4 in_seq=0 out_seq=0 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.674+0000 7f17b2ffd640 1 -- 172.21.15.2:0/126152951 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcaee4a580 con 0x55bcaeabfda0 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.674+0000 7f17b2ffd640 10 client.27026 handle_command_reply: tid=0 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.674+0000 7f17e0305740 1 client.27026 shutdown 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 msgr2=0x55bcaeedcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17c40af2b0 tx=0x7f17c40db340 comp rx=0 tx=0).stop 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 shutdown_connections 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaeabfda0 0x55bcaeeeecb0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb2c070 0x55bcaeedd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeee8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 --2- 172.21.15.2:0/126152951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb0b390 0x55bcaeedcb40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 >> 172.21.15.2:0/126152951 conn(0x55bcaeb20460 msgr2=0x55bcaeed2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17b2ffd640 0 client.27026 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:00.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 shutdown_connections 2024-08-31T04:37:00.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 1 -- 172.21.15.2:0/126152951 wait complete. 2024-08-31T04:37:00.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.675+0000 7f17e0305740 20 client.27026 trim_cache size 0 max 16384 2024-08-31T04:37:00.693 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1181061 10.42 MB/sec execute 500 sec latency 137.489 ms 2024-08-31T04:37:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 Processor -- start 2024-08-31T04:37:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 -- start start 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeedea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 0x55bcaeed2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.697+0000 7f17e0305740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17d41a8eb0 con 0x55bcaeb0b390 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17e0305740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4075010 con 0x55bcaeb2c070 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17e0305740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4072e60 con 0x55bcaeaea9f0 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.2:33098/0 (socket says 172.21.15.2:33098) 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 -- 172.21.15.2:0/876565533 learned_addr learned my addr 172.21.15.2:0/876565533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d3fff640 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 0x55bcaeed2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 -- 172.21.15.2:0/876565533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 msgr2=0x55bcaeed2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 0x55bcaeed2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 -- 172.21.15.2:0/876565533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 msgr2=0x55bcaeedea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeedea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 -- 172.21.15.2:0/876565533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcaeedceb0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d3fff640 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 0x55bcaeed2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.698+0000 7f17d37fe640 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17c40af4f0 tx=0x7f17c40c0eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8685c4e4d66e2d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.701+0000 7f17c97fa640 1 -- 172.21.15.2:0/876565533 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40b5110 con 0x55bcaeaea9f0 2024-08-31T04:37:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.701+0000 7f17c97fa640 1 -- 172.21.15.2:0/876565533 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c40d20d0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.701+0000 7f17c97fa640 1 -- 172.21.15.2:0/876565533 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40b81d0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 -- 172.21.15.2:0/876565533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 msgr2=0x55bcaeed82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17c40af4f0 tx=0x7f17c40c0eb0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 -- 172.21.15.2:0/876565533 shutdown_connections 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaeedea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeb2c070 0x55bcaeed2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 --2- 172.21.15.2:0/876565533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeaea9f0 0x55bcaeed82f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.702+0000 7f17e0305740 1 -- 172.21.15.2:0/876565533 >> 172.21.15.2:0/876565533 conn(0x55bcaeb20460 msgr2=0x55bcaeed2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.703+0000 7f17e0305740 1 -- 172.21.15.2:0/876565533 shutdown_connections 2024-08-31T04:37:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.703+0000 7f17e0305740 1 -- 172.21.15.2:0/876565533 wait complete. 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.703+0000 7f17e0305740 1 -- start start 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 Processor -- start 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaef56310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaef60c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17d40734d0 con 0x55bcaeb0b390 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4074940 con 0x55bcaeaea9f0 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17e0305740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4073ba0 con 0x55bcaeb2c070 2024-08-31T04:37:00.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:48264/0 (socket says 172.21.15.2:48264) 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17d37fe640 1 -- 172.21.15.2:0/3025915101 learned_addr learned my addr 172.21.15.2:0/3025915101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.704+0000 7f17d3fff640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaef60c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17e0305740 10 client.0 _ll_register_callbacks cb 0x7f17bc009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17cbfff640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaef56310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 -- 172.21.15.2:0/3025915101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 msgr2=0x55bcaef60c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaef60c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 -- 172.21.15.2:0/3025915101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 msgr2=0x55bcaef56310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaef56310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 -- 172.21.15.2:0/3025915101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcaef61190 con 0x55bcaeaea9f0 2024-08-31T04:37:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17d37fe640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17c400bb90 tx=0x7f17c40e68b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d13dc8511966e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.705+0000 7f17b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mon.2 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40b5110 con 0x55bcaeaea9f0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mon.2 v2:172.21.15.64:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f17c4019410 con 0x55bcaeaea9f0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c40d20d0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mon.2 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f17c40b8660 con 0x55bcaeaea9f0 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 10 client.27032 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcaef61190 con 0x55bcaeaea9f0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mon.2 v2:172.21.15.64:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c40af0c0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mon.2 v2:172.21.15.64:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f17c40c47c0 con 0x55bcaeaea9f0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 10 client.27032 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 10 client.27032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 20 client.27032 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaef627a0 0x55bcaef64bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 4 client.27032 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.706+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f17c40d20d0 con 0x55bcaef627a0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.707+0000 7f17cbfff640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaef627a0 0x55bcaef64bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.707+0000 7f17b2ffd640 10 client.27032 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.707+0000 7f17cbfff640 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaef627a0 0x55bcaef64bc0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9742977cccfd43b server_cookie=b2b3dd5e3247dbaa in_seq=0 out_seq=0 2024-08-31T04:37:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17b2ffd640 1 -- 172.21.15.2:0/3025915101 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x7f17c40d20d0 con 0x55bcaef627a0 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17b2ffd640 10 client.27032 handle_command_reply: tid=0 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 client.27032 shutdown 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 msgr2=0x55bcaef55dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17c400bb90 tx=0x7f17c40e68b0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 shutdown_connections 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x55bcaef627a0 0x55bcaef64bc0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcaeb0b390 0x55bcaef56310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17b2ffd640 0 client.27032 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bcaeb2c070 0x55bcaef60c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 --2- 172.21.15.2:0/3025915101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcaeaea9f0 0x55bcaef55dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.708+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 >> 172.21.15.2:0/3025915101 conn(0x55bcaeb20460 msgr2=0x55bcaeede800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.709+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 shutdown_connections 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.709+0000 7f17e0305740 1 -- 172.21.15.2:0/3025915101 wait complete. 2024-08-31T04:37:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.709+0000 7f17e0305740 20 client.27032 trim_cache size 0 max 16384 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "010808f6-01e5-464b-a861-1ea86c41e41f": { 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:36:27.397738+0000", 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.715 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "305858c7-0009-45a1-9134-382eb2814473": { 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:01.507341+0000", 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "7661bd8a-eb71-4899-bea8-182e99f6e528": { 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:30:40.565440+0000", 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "66e2e486-38c0-4431-bffc-a4fe81855312": { 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:35:44.368541+0000", 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.717 INFO:teuthology.orchestra.run.smithi002.stdout: "7b5d3b28-13b2-4f11-9bb0-a67dbb62e1aa": { 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:26:20.685665+0000", 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "3cbd64fc-e3a0-4f9a-9947-de6a8dfeb491": { 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:34:17.084177+0000", 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.718 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "ae485ec2-e173-4061-b0ea-b4326eeb8680": { 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:45.758958+0000", 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "7c71db2e-ff2d-4279-a140-18e89b19cf24": { 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:25:37.830520+0000", 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "634fff1a-aaca-4743-94d1-27a415c30abd": { 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:27:02.699825+0000", 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "d72f184e-1910-4c91-8ce9-7ba478537461": { 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:06.772712+0000", 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "7be2b730-d0a5-4d56-bf6c-4616345a7b27": { 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:12.374213+0000", 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "9a7db9f4-8e9d-4bc7-8bcb-816c0119bbf1": { 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:28:29.453078+0000", 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "d91ddbc8-0266-4a94-ba7d-bb4c64cee66d": { 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:29:56.781320+0000", 2024-08-31T04:37:00.722 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "109ab462-ff90-4306-b2e5-e84968c31aa5": { 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:31:23.699574+0000", 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.723 INFO:teuthology.orchestra.run.smithi002.stdout: "4539a698-1514-4b64-8024-440ec6b51908": { 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:32:50.114854+0000", 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "04849146-1ea3-4a8d-b037-ce03f237fdd7": { 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-08-31T04:33:34.375989+0000", 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-08-31T04:37:00.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:00.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 msgr2=0x7f17c00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 0x7f17c00b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f17cc004af0 tx=0x7f17cc0095c0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 msgr2=0x7f17d419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d419a250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009bc0 tx=0x7f17c400b690 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 shutdown_connections 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f17c00b4d20 0x7f17c00b7230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17d4108150 0x7f17d419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17d4108aa0 0x7f17d419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 --2- 172.21.15.2:0/4207248544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d4102f20 0x7f17d419a250 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009bc0 tx=0x7f17c400b690 comp rx=0 tx=0).stop 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 >> 172.21.15.2:0/4207248544 conn(0x7f17d4077a00 msgr2=0x7f17d41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 shutdown_connections 2024-08-31T04:37:00.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:00.710+0000 7f17d9d90640 1 -- 172.21.15.2:0/4207248544 wait complete. 2024-08-31T04:37:00.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:37:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:[1181251] write failed on handle 13173 (Resource temporarily unavailable) 2024-08-31T04:37:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:Child failed with status 1 2024-08-31T04:37:00.783 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-08-31T04:37:00.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T04:37:00.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:00 smithi002 ceph-mon[18656]: pgmap v696: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 187 op/s 2024-08-31T04:37:01.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:00 smithi064 ceph-mon[22007]: pgmap v696: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 187 op/s 2024-08-31T04:37:01.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:00 smithi132 ceph-mon[22335]: pgmap v696: 129 pgs: 129 active+clean; 603 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 187 op/s 2024-08-31T04:37:01.139 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-31T04:37:01.311 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fae87f6759af473b9a33c5346455ff1f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-31T04:37:01.314 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-31T04:37:01.325 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-31T04:37:01.325 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T04:37:01.326 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:37:01.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-31T04:37:01.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-31T04:37:01.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T04:37:01.561 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T04:37:01.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:37:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 -- 172.21.15.2:0/188890101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca8108090 msgr2=0x7f4ca81084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 --2- 172.21.15.2:0/188890101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca8108090 0x7f4ca81084a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009900 tx=0x7f4c9c02a410 comp rx=0 tx=0).stop 2024-08-31T04:37:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 -- 172.21.15.2:0/188890101 shutdown_connections 2024-08-31T04:37:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 --2- 172.21.15.2:0/188890101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca8108090 0x7f4ca81084a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 --2- 172.21.15.2:0/188890101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca81089e0 0x7f4ca810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 --2- 172.21.15.2:0/188890101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 0x7f4ca8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 -- 172.21.15.2:0/188890101 >> 172.21.15.2:0/188890101 conn(0x7f4ca80fe160 msgr2=0x7f4ca81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 -- 172.21.15.2:0/188890101 shutdown_connections 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 -- 172.21.15.2:0/188890101 wait complete. 2024-08-31T04:37:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.577+0000 7f4cade9d640 1 Processor -- start 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 -- start start 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 0x7f4ca80fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca8108090 0x7f4ca80febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8112670 con 0x7f4ca81089e0 2024-08-31T04:37:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca81124f0 con 0x7f4ca8102760 2024-08-31T04:37:01.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4cade9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca81127f0 con 0x7f4ca8108090 2024-08-31T04:37:01.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 0x7f4ca80fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54736/0 (socket says 172.21.15.2:54736) 2024-08-31T04:37:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 -- 172.21.15.2:0/149259030 learned_addr learned my addr 172.21.15.2:0/149259030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca6ffd640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca8108090 0x7f4ca80febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 -- 172.21.15.2:0/149259030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca8108090 msgr2=0x7f4ca80febd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca8108090 0x7f4ca80febd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 -- 172.21.15.2:0/149259030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 msgr2=0x7f4ca80fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 0x7f4ca80fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.578+0000 7f4ca7fff640 1 -- 172.21.15.2:0/149259030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81a8470 con 0x7f4ca81089e0 2024-08-31T04:37:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4ca7fff640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000eb10 tx=0x7f4ca000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0004b20 con 0x7f4ca81089e0 2024-08-31T04:37:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81a8760 con 0x7f4ca81089e0 2024-08-31T04:37:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ca0004cc0 con 0x7f4ca81089e0 2024-08-31T04:37:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0010690 con 0x7f4ca81089e0 2024-08-31T04:37:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.579+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca81a8cd0 con 0x7f4ca81089e0 2024-08-31T04:37:01.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.580+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca8102b70 con 0x7f4ca81089e0 2024-08-31T04:37:01.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.582+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4ca0005000 con 0x7f4ca81089e0 2024-08-31T04:37:01.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.582+0000 7f4ca4ff9640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 0x7f4c900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.582+0000 7f4ca77fe640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 0x7f4c900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.583+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f4ca00e6070 con 0x7f4ca81089e0 2024-08-31T04:37:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.583+0000 7f4ca77fe640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 0x7f4c900b71e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4ca81000e0 tx=0x7f4c9800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.586+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4ca0056130 con 0x7f4ca81089e0 2024-08-31T04:37:01.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.806+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4ca8106fa0 con 0x7f4c900b4cd0 2024-08-31T04:37:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.816+0000 7f4ca4ff9640 1 -- 172.21.15.2:0/149259030 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f4ca8106fa0 con 0x7f4c900b4cd0 2024-08-31T04:37:01.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T04:25:37", "first": "2024-08-31T04:26:00", "last": "2024-08-31T04:37:00", "last_pruned": "2024-08-31T04:37:00", "created_count": 12, "pruned_count": 6, "active": true} 2024-08-31T04:37:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 msgr2=0x7f4c900b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 0x7f4c900b71e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4ca81000e0 tx=0x7f4c9800b390 comp rx=0 tx=0).stop 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 msgr2=0x7f4ca80ff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000eb10 tx=0x7f4ca000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 shutdown_connections 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f4c900b4cd0 0x7f4c900b71e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ca81089e0 0x7f4ca80ff110 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca8108090 0x7f4ca80febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.818+0000 7f4cade9d640 1 --2- 172.21.15.2:0/149259030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca8102760 0x7f4ca80fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.819+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 >> 172.21.15.2:0/149259030 conn(0x7f4ca80fe160 msgr2=0x7f4ca806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:01.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.819+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 shutdown_connections 2024-08-31T04:37:01.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.819+0000 7f4cade9d640 1 -- 172.21.15.2:0/149259030 wait complete. 2024-08-31T04:37:01.823 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:01.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T04:37:01.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 -- 172.21.15.2:0/3133317617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44810db10 msgr2=0x7fb448110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 --2- 172.21.15.2:0/3133317617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44810db10 0x7fb448110000 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb440009ca0 tx=0x7fb44002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 -- 172.21.15.2:0/3133317617 shutdown_connections 2024-08-31T04:37:01.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 --2- 172.21.15.2:0/3133317617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44810db10 0x7fb448110000 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 --2- 172.21.15.2:0/3133317617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb448105000 0x7fb44810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 --2- 172.21.15.2:0/3133317617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 0x7fb448104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 -- 172.21.15.2:0/3133317617 >> 172.21.15.2:0/3133317617 conn(0x7fb4480fe160 msgr2=0x7fb4481005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 -- 172.21.15.2:0/3133317617 shutdown_connections 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.985+0000 7fb450562640 1 -- 172.21.15.2:0/3133317617 wait complete. 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 Processor -- start 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 -- start start 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 0x7fb44819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb44810db10 0x7fb44819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481137a0 con 0x7fb448105000 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb448113620 con 0x7fb4481046b0 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb450562640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb448113920 con 0x7fb44810db10 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54766/0 (socket says 172.21.15.2:54766) 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 -- 172.21.15.2:0/2573928575 learned_addr learned my addr 172.21.15.2:0/2573928575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:01.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44e2fe640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 0x7fb44819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44eaff640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb44810db10 0x7fb44819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 -- 172.21.15.2:0/2573928575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb44810db10 msgr2=0x7fb44819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb44810db10 0x7fb44819f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 -- 172.21.15.2:0/2573928575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 msgr2=0x7fb44819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.986+0000 7fb44dafd640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 0x7fb44819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb44dafd640 1 -- 172.21.15.2:0/2573928575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481a0090 con 0x7fb448105000 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb44dafd640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c970 tx=0x7fb43800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:01.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438004220 con 0x7fb448105000 2024-08-31T04:37:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4380043c0 con 0x7fb448105000 2024-08-31T04:37:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481a0380 con 0x7fb448105000 2024-08-31T04:37:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438004a00 con 0x7fb448105000 2024-08-31T04:37:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.987+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481a6b10 con 0x7fb448105000 2024-08-31T04:37:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.988+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448104ac0 con 0x7fb448105000 2024-08-31T04:37:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.990+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb4380079b0 con 0x7fb448105000 2024-08-31T04:37:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.990+0000 7fb43f7fe640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.990+0000 7fb44e2fe640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.990+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7fb4380e5c00 con 0x7fb448105000 2024-08-31T04:37:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.991+0000 7fb44e2fe640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 0x7fb4340b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb444005fd0 tx=0x7fb444005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:01.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:01.993+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb438014030 con 0x7fb448105000 2024-08-31T04:37:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.208+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 --> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb4481012f0 con 0x7fb4340b4ca0 2024-08-31T04:37:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.218+0000 7fb43f7fe640 1 -- 172.21.15.2:0/2573928575 <== mgr.14220 v2:172.21.15.2:6800/1444417427 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb4481012f0 con 0x7fb4340b4ca0 2024-08-31T04:37:02.219 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 msgr2=0x7fb4340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 0x7fb4340b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb444005fd0 tx=0x7fb444005850 comp rx=0 tx=0).stop 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 msgr2=0x7fb44819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c970 tx=0x7fb43800ce30 comp rx=0 tx=0).stop 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 shutdown_connections 2024-08-31T04:37:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb448105000 0x7fb44819a700 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb44810db10 0x7fb44819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 --2- 172.21.15.2:0/2573928575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4481046b0 0x7fb44819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 >> 172.21.15.2:0/2573928575 conn(0x7fb4480fe160 msgr2=0x7fb448100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 shutdown_connections 2024-08-31T04:37:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.220+0000 7fb450562640 1 -- 172.21.15.2:0/2573928575 wait complete. 2024-08-31T04:37:02.233 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-31T04:37:02.243 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-31T04:37:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 -- 172.21.15.2:0/1913335878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f81050a0 msgr2=0x7f14f810d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/1913335878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f81050a0 0x7f14f810d6e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009900 tx=0x7f14ec02a410 comp rx=0 tx=0).stop 2024-08-31T04:37:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 -- 172.21.15.2:0/1913335878 shutdown_connections 2024-08-31T04:37:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/1913335878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f81050a0 0x7f14f810d6e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/1913335878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f810dc20 0x7f14f81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/1913335878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 0x7f14f8104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 -- 172.21.15.2:0/1913335878 >> 172.21.15.2:0/1913335878 conn(0x7f14f8079470 msgr2=0x7f14f8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 -- 172.21.15.2:0/1913335878 shutdown_connections 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.576+0000 7f14fd8ca640 1 -- 172.21.15.2:0/1913335878 wait complete. 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.577+0000 7f14fd8ca640 1 Processor -- start 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.577+0000 7f14fd8ca640 1 -- start start 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 0x7f14f819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f81050a0 0x7f14f819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14f81137f0 con 0x7f14f810dc20 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8113670 con 0x7f14f8104670 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14fd8ca640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8113970 con 0x7f14f81050a0 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54792/0 (socket says 172.21.15.2:54792) 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 -- 172.21.15.2:0/2259788768 learned_addr learned my addr 172.21.15.2:0/2259788768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f6ffd640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 0x7f14f819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f67fc640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f81050a0 0x7f14f819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 -- 172.21.15.2:0/2259788768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f81050a0 msgr2=0x7f14f819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f81050a0 0x7f14f819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 -- 172.21.15.2:0/2259788768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 msgr2=0x7f14f819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 0x7f14f819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.578+0000 7f14f77fe640 1 -- 172.21.15.2:0/2259788768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f81a0210 con 0x7f14f810dc20 2024-08-31T04:37:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14f77fe640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f14f000cad0 tx=0x7f14f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f000ae20 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f0005020 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f81a0500 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f000f6b0 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.579+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81a6c60 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.580+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f806bf10 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.581+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f14f00051d0 con 0x7f14f810dc20 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.582+0000 7f14fc8c8640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 0x7f14e00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.582+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9664+0+0 (secure 0 0 0) 0x7f14f00e5d60 con 0x7f14f810dc20 2024-08-31T04:37:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.582+0000 7f14f6ffd640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 0x7f14e00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.582+0000 7f14f6ffd640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 0x7f14e00b71b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009bd0 tx=0x7f14e8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.585+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f14f0014030 con 0x7f14f810dc20 2024-08-31T04:37:02.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.859+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14f8104a80 con 0x7f14f810dc20 2024-08-31T04:37:02.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:02 smithi002 ceph-mon[18656]: pgmap v697: 129 pgs: 129 active+clean; 588 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-08-31T04:37:02.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:02 smithi002 ceph-mon[18656]: from='client.17325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:02.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.859+0000 7f14fc8c8640 1 -- 172.21.15.2:0/2259788768 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11897 (secure 0 0 0) 0x7f14f8104a80 con 0x7f14f810dc20 2024-08-31T04:37:02.862 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:02.862 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-08-31T04:36:19:632791+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:36:18.731960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:37:02.862 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-08-31T04:37:02.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 msgr2=0x7f14e00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 0x7f14e00b71b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009bd0 tx=0x7f14e8005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 msgr2=0x7f14f819fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f14f000cad0 tx=0x7f14f000cf90 comp rx=0 tx=0).stop 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 shutdown_connections 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14e00b4ca0 0x7f14e00b71b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14f810dc20 0x7f14f819fae0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f81050a0 0x7f14f819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 --2- 172.21.15.2:0/2259788768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14f8104670 0x7f14f819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:02.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 >> 172.21.15.2:0/2259788768 conn(0x7f14f8079470 msgr2=0x7f14f8100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:02.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 shutdown_connections 2024-08-31T04:37:02.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:02.862+0000 7f14fd8ca640 1 -- 172.21.15.2:0/2259788768 wait complete. 2024-08-31T04:37:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:02 smithi064 ceph-mon[22007]: pgmap v697: 129 pgs: 129 active+clean; 588 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-08-31T04:37:03.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:02 smithi064 ceph-mon[22007]: from='client.17325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:03.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:02 smithi132 ceph-mon[22335]: pgmap v697: 129 pgs: 129 active+clean; 588 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-08-31T04:37:03.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:02 smithi132 ceph-mon[22335]: from='client.17325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:03.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T04:37:03.861 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:03.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:03 smithi002 ceph-mon[18656]: from='client.17331 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:03.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:03 smithi002 ceph-mon[18656]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T04:37:03.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:03 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2259788768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:03 smithi064 ceph-mon[22007]: from='client.17331 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:03 smithi064 ceph-mon[22007]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T04:37:04.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:03 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2259788768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:03 smithi132 ceph-mon[22335]: from='client.17331 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:03 smithi132 ceph-mon[22335]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T04:37:04.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:03 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2259788768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 -- 172.21.15.2:0/205345617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 msgr2=0x7f14a81100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 --2- 172.21.15.2:0/205345617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a81100c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009ca0 tx=0x7f14a002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 -- 172.21.15.2:0/205345617 shutdown_connections 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 --2- 172.21.15.2:0/205345617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a81100c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 --2- 172.21.15.2:0/205345617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 0x7f14a810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 --2- 172.21.15.2:0/205345617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 0x7f14a8104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 -- 172.21.15.2:0/205345617 >> 172.21.15.2:0/205345617 conn(0x7f14a80794e0 msgr2=0x7f14a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 -- 172.21.15.2:0/205345617 shutdown_connections 2024-08-31T04:37:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 -- 172.21.15.2:0/205345617 wait complete. 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.338+0000 7f14afd9c640 1 Processor -- start 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 -- start start 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 0x7f14a819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 0x7f14a819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8113850 con 0x7f14a810dbb0 2024-08-31T04:37:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81136d0 con 0x7f14a8104600 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14afd9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81139d0 con 0x7f14a8105030 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54802/0 (socket says 172.21.15.2:54802) 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 -- 172.21.15.2:0/620369878 learned_addr learned my addr 172.21.15.2:0/620369878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14adb38640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 0x7f14a819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ad337640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 0x7f14a819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 -- 172.21.15.2:0/620369878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 msgr2=0x7f14a819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 0x7f14a819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 -- 172.21.15.2:0/620369878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 msgr2=0x7f14a819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 0x7f14a819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.339+0000 7f14ae339640 1 -- 172.21.15.2:0/620369878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a81a01f0 con 0x7f14a810dbb0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f14ae339640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f14a0005cc0 tx=0x7f14a002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f149effd640 1 -- 172.21.15.2:0/620369878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a0003bf0 con 0x7f14a810dbb0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a81a0480 con 0x7f14a810dbb0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a81a6c40 con 0x7f14a810dbb0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f149effd640 1 -- 172.21.15.2:0/620369878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14a0003d90 con 0x7f14a810dbb0 2024-08-31T04:37:04.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.340+0000 7f149effd640 1 -- 172.21.15.2:0/620369878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a002fbc0 con 0x7f14a810dbb0 2024-08-31T04:37:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.342+0000 7f14b6311740 1 Processor -- start 2024-08-31T04:37:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.342+0000 7f149effd640 1 -- 172.21.15.2:0/620369878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f14a002fd60 con 0x7f14a810dbb0 2024-08-31T04:37:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 -- start start 2024-08-31T04:37:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f7496890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f7496dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5635f740d680 con 0x5635f70f1070 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5635f73fcc10 con 0x5635f70d0390 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14b6311740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635f7400bc0 con 0x5635f70c81b0 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54808/0 (socket says 172.21.15.2:54808) 2024-08-31T04:37:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 -- 172.21.15.2:0/1677830160 learned_addr learned my addr 172.21.15.2:0/1677830160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f7496dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f149effd640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 0x7f14940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14adb38640 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f7496890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 -- 172.21.15.2:0/1677830160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 msgr2=0x5635f7496890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f7496890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 -- 172.21.15.2:0/1677830160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 msgr2=0x5635f7496dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f7496dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.343+0000 7f14ad337640 1 -- 172.21.15.2:0/1677830160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f715c650 con 0x5635f70f1070 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f149effd640 1 -- 172.21.15.2:0/620369878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f14a0106e70 con 0x7f14a810dbb0 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f14ae339640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 0x7f14940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f14ad337640 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f149800cfd0 tx=0x7f149800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245f0147a11e9dc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f1493fff640 1 -- 172.21.15.2:0/1677830160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498018030 con 0x5635f70f1070 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f1493fff640 1 -- 172.21.15.2:0/1677830160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14980054d0 con 0x5635f70f1070 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.344+0000 7f1493fff640 1 -- 172.21.15.2:0/1677830160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149800d550 con 0x5635f70f1070 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 -- 172.21.15.2:0/1677830160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 msgr2=0x5635f7496350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f149800cfd0 tx=0x7f149800c560 comp rx=0 tx=0).stop 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14ae339640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 0x7f14940b7230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f14a00cd020 tx=0x7f14a00993a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 -- 172.21.15.2:0/1677830160 shutdown_connections 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f7496dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f7496890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 --2- 172.21.15.2:0/1677830160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f7496350 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 -- 172.21.15.2:0/1677830160 >> 172.21.15.2:0/1677830160 conn(0x5635f70e5460 msgr2=0x5635f7494240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 -- 172.21.15.2:0/1677830160 shutdown_connections 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.345+0000 7f14b6311740 1 -- 172.21.15.2:0/1677830160 wait complete. 2024-08-31T04:37:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 -- start start 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 Processor -- start 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5635f725f700 con 0x5635f70f1070 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5635f7383750 con 0x5635f70d0390 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635f74a4b30 con 0x5635f70c81b0 2024-08-31T04:37:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14b6311740 10 client.0 _ll_register_callbacks cb 0x5635f73b2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54816/0 (socket says 172.21.15.2:54816) 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14ad337640 1 -- 172.21.15.2:0/3999356508 learned_addr learned my addr 172.21.15.2:0/3999356508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14adb38640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.346+0000 7f14ad337640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 -- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 msgr2=0x5635f74a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 -- 172.21.15.2:0/3999356508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 msgr2=0x5635f74a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 -- 172.21.15.2:0/3999356508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f73bc900 con 0x5635f70f1070 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14ad337640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x5635f74a42c0 tx=0x7f1498014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd99937c64f04f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498018070 con 0x5635f70f1070 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f14980046c0 con 0x5635f70f1070 2024-08-31T04:37:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14980054d0 con 0x5635f70f1070 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1498004d50 con 0x5635f70f1070 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14b6311740 10 client.17349 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.347+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5635f74b08d0 con 0x5635f70f1070 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14980054d0 con 0x5635f70f1070 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f149801c5a0 con 0x5635f70f1070 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 10 client.17349 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 10 client.17349 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 20 client.17349 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f70af9f0 0x5635f74b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 4 client.17349 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635f740f5d0 con 0x5635f70af9f0 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.348+0000 7f14adb38640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f70af9f0 0x5635f74b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.349+0000 7f14adb38640 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f70af9f0 0x5635f74b3c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2df5149d3264fed2 server_cookie=419a11454d6096d5 in_seq=0 out_seq=0 2024-08-31T04:37:04.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.349+0000 7f14917fa640 10 client.17349 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:37:04.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.349+0000 7f14917fa640 1 -- 172.21.15.2:0/3999356508 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635f740f5d0 con 0x5635f70af9f0 2024-08-31T04:37:04.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.349+0000 7f14917fa640 10 client.17349 handle_command_reply: tid=0 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.349+0000 7f14b6311740 1 client.17349 shutdown 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 msgr2=0x5635f74adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x5635f74a42c0 tx=0x7f1498014040 comp rx=0 tx=0).stop 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 shutdown_connections 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f70af9f0 0x5635f74b3c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74adeb0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 --2- 172.21.15.2:0/3999356508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14917fa640 0 client.17349 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 >> 172.21.15.2:0/3999356508 conn(0x5635f70e5460 msgr2=0x5635f74994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 shutdown_connections 2024-08-31T04:37:04.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 1 -- 172.21.15.2:0/3999356508 wait complete. 2024-08-31T04:37:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.350+0000 7f14b6311740 20 client.17349 trim_cache size 0 max 16384 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 Processor -- start 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 -- start start 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 0x5635f74a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70f1070 0x5635f7493d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f148c012c90 con 0x5635f70d0390 2024-08-31T04:37:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f148c010560 con 0x5635f70c81b0 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14b6311740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f148c00e3d0 con 0x5635f70f1070 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14adb38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14adb38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54820/0 (socket says 172.21.15.2:54820) 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.363+0000 7f14adb38640 1 -- 172.21.15.2:0/3133676909 learned_addr learned my addr 172.21.15.2:0/3133676909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14ad337640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 0x5635f74a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14ad337640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70f1070 0x5635f7493d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 -- 172.21.15.2:0/3133676909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70f1070 msgr2=0x5635f7493d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70f1070 0x5635f7493d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 -- 172.21.15.2:0/3133676909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 msgr2=0x5635f74a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 0x5635f74a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 -- 172.21.15.2:0/3133676909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f7498be0 con 0x5635f70d0390 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14ad337640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 0x5635f74a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14adb38640 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f14a4004590 tx=0x7f14a4004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cab9fb87c62257 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14937fe640 1 -- 172.21.15.2:0/3133676909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003b20 con 0x5635f70d0390 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14937fe640 1 -- 172.21.15.2:0/3133676909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14a40054d0 con 0x5635f70d0390 2024-08-31T04:37:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.364+0000 7f14937fe640 1 -- 172.21.15.2:0/3133676909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004d60 con 0x5635f70d0390 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- 172.21.15.2:0/3133676909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 msgr2=0x5635f7493810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f14a4004590 tx=0x7f14a4004130 comp rx=0 tx=0).stop 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- 172.21.15.2:0/3133676909 shutdown_connections 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70d0390 0x5635f7493810 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70f1070 0x5635f7493d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 --2- 172.21.15.2:0/3133676909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70c81b0 0x5635f74a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- 172.21.15.2:0/3133676909 >> 172.21.15.2:0/3133676909 conn(0x5635f70e5460 msgr2=0x5635f74a2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- 172.21.15.2:0/3133676909 shutdown_connections 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- 172.21.15.2:0/3133676909 wait complete. 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 -- start start 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.365+0000 7f14b6311740 1 Processor -- start 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f148c00ea20 con 0x5635f70f1070 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f148c00fe90 con 0x5635f70d0390 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f148c00f0f0 con 0x5635f70c81b0 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14b6311740 10 client.0 _ll_register_callbacks cb 0x7f149800ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54826/0 (socket says 172.21.15.2:54826) 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 -- 172.21.15.2:0/1757571328 learned_addr learned my addr 172.21.15.2:0/1757571328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14adb38640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 -- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 msgr2=0x5635f74a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 -- 172.21.15.2:0/1757571328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 msgr2=0x5635f74a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.366+0000 7f14ad337640 1 -- 172.21.15.2:0/1757571328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f7521900 con 0x5635f70f1070 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14ad337640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1498005ab0 tx=0x7f1498004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406f554698d30292 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:37:04.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498018040 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f14980055f0 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14a40054d0 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1498041050 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 10 client.17355 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5635f7522ac0 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14a40054d0 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f149800d8c0 con 0x5635f70f1070 2024-08-31T04:37:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 10 client.17355 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 10 client.17355 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 20 client.17355 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f7084da0 0x5635f75251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 4 client.17355 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.367+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 --> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635f740b070 con 0x5635f7084da0 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.368+0000 7f14adb38640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f7084da0 0x5635f75251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.368+0000 7f14adb38640 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f7084da0 0x5635f75251f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=839bda28cbb21bbf server_cookie=4a8708fd24a3632d in_seq=0 out_seq=0 2024-08-31T04:37:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.368+0000 7f14917fa640 10 client.17355 ms_handle_connect on v2:172.21.15.132:6838/1468403629 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14917fa640 1 -- 172.21.15.2:0/1757571328 <== mds.2 v2:172.21.15.132:6838/1468403629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635f740b070 con 0x5635f7084da0 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14917fa640 10 client.17355 handle_command_reply: tid=0 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 client.17355 shutdown 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 msgr2=0x5635f74a67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1498005ab0 tx=0x7f1498004bb0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 shutdown_connections 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:6838/1468403629,v1:172.21.15.132:6839/1468403629] conn(0x5635f7084da0 0x5635f75251f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635f70f1070 0x5635f74a67b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635f70d0390 0x5635f74a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 --2- 172.21.15.2:0/1757571328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635f70c81b0 0x5635f74a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 >> 172.21.15.2:0/1757571328 conn(0x5635f70e5460 msgr2=0x5635f74a2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14917fa640 0 client.17355 ms_handle_reset on v2:172.21.15.132:6838/1468403629 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 shutdown_connections 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 1 -- 172.21.15.2:0/1757571328 wait complete. 2024-08-31T04:37:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.369+0000 7f14b6311740 20 client.17355 trim_cache size 0 max 16384 2024-08-31T04:37:04.381 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:37:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 msgr2=0x7f14940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 0x7f14940b7230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f14a00cd020 tx=0x7f14a00993a0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 msgr2=0x7f14a819fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f14a0005cc0 tx=0x7f14a002f380 comp rx=0 tx=0).stop 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 shutdown_connections 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f14940b4d20 0x7f14940b7230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a810dbb0 0x7f14a819fac0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a8105030 0x7f14a819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 --2- 172.21.15.2:0/620369878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14a8104600 0x7f14a819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 >> 172.21.15.2:0/620369878 conn(0x7f14a80794e0 msgr2=0x7f14a80ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 shutdown_connections 2024-08-31T04:37:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:04.370+0000 7f14afd9c640 1 -- 172.21.15.2:0/620369878 wait complete. 2024-08-31T04:37:04.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:04 smithi002 ceph-mon[18656]: pgmap v699: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-08-31T04:37:05.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T04:37:05.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:04 smithi064 ceph-mon[22007]: pgmap v699: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-08-31T04:37:05.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:04 smithi132 ceph-mon[22335]: pgmap v699: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-08-31T04:37:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:05.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- 172.21.15.2:0/552657708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14109290 msgr2=0x7fdd141096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 --2- 172.21.15.2:0/552657708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14109290 0x7fdd141096a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009900 tx=0x7fdcfc02a410 comp rx=0 tx=0).stop 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- 172.21.15.2:0/552657708 shutdown_connections 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 --2- 172.21.15.2:0/552657708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14109290 0x7fdd141096a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 --2- 172.21.15.2:0/552657708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109be0 0x7fdd14110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 --2- 172.21.15.2:0/552657708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14103950 0x7fdd14103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- 172.21.15.2:0/552657708 >> 172.21.15.2:0/552657708 conn(0x7fdd140ff3a0 msgr2=0x7fdd141017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- 172.21.15.2:0/552657708 shutdown_connections 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- 172.21.15.2:0/552657708 wait complete. 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 Processor -- start 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.938+0000 7fdd1a293640 1 -- start start 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 0x7fdd1419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 0x7fdd1419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141138a0 con 0x7fdd14103950 2024-08-31T04:37:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14113720 con 0x7fdd14109be0 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd1a293640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14113a20 con 0x7fdd14109290 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60352/0 (socket says 172.21.15.2:60352) 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 -- 172.21.15.2:0/3850296575 learned_addr learned my addr 172.21.15.2:0/3850296575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd137fe640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 0x7fdd1419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd18830640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 0x7fdd1419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 -- 172.21.15.2:0/3850296575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 msgr2=0x7fdd1419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 0x7fdd1419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 -- 172.21.15.2:0/3850296575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 msgr2=0x7fdd1419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 0x7fdd1419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd13fff640 1 -- 172.21.15.2:0/3850296575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd141a01e0 con 0x7fdd14103950 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd137fe640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 0x7fdd1419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.939+0000 7fdd18830640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 0x7fdd1419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400d950 tx=0x7fdd0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd117fa640 1 -- 172.21.15.2:0/3850296575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04017070 con 0x7fdd14103950 2024-08-31T04:37:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd141a04d0 con 0x7fdd14103950 2024-08-31T04:37:05.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd117fa640 1 -- 172.21.15.2:0/3850296575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd04009c30 con 0x7fdd14103950 2024-08-31T04:37:05.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd117fa640 1 -- 172.21.15.2:0/3850296575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400f620 con 0x7fdd14103950 2024-08-31T04:37:05.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.940+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd141a6c30 con 0x7fdd14103950 2024-08-31T04:37:05.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.942+0000 7fdd20808740 1 Processor -- start 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 -- start start 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd117fa640 1 -- 172.21.15.2:0/3850296575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdd04010460 con 0x7fdd14103950 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 0x55a14f39f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f39fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a14f316680 con 0x55a14effa070 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a14f305c10 con 0x55a14efd9390 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd20808740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a14f309bc0 con 0x55a14efd11b0 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60360/0 (socket says 172.21.15.2:60360) 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 -- 172.21.15.2:0/3660865709 learned_addr learned my addr 172.21.15.2:0/3660865709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd137fe640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f39fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 0x55a14f39f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 -- 172.21.15.2:0/3660865709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 msgr2=0x55a14f39f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 0x55a14f39f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 -- 172.21.15.2:0/3660865709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 msgr2=0x55a14f39fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f39fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd18830640 1 -- 172.21.15.2:0/3660865709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a14f065650 con 0x55a14effa070 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.943+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 0x55a14f39f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd18830640 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00f410 tx=0x7fdd0c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c53f8d428bde9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd0a7fc640 1 -- 172.21.15.2:0/3660865709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c015070 con 0x55a14effa070 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd0a7fc640 1 -- 172.21.15.2:0/3660865709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c011bb0 con 0x55a14effa070 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd0a7fc640 1 -- 172.21.15.2:0/3660865709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c010c10 con 0x55a14effa070 2024-08-31T04:37:05.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd117fa640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 0x7fdd000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 0x7fdd000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.944+0000 7fdd117fa640 1 -- 172.21.15.2:0/3850296575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fdd040e5720 con 0x7fdd14103950 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- 172.21.15.2:0/3660865709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 msgr2=0x55a14f39f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd13fff640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 0x7fdd000b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdd040e2a50 tx=0x7fdd04010cb0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00f410 tx=0x7fdd0c00f8d0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- 172.21.15.2:0/3660865709 shutdown_connections 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f39fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd11b0 0x55a14f39f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 --2- 172.21.15.2:0/3660865709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f39f310 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- 172.21.15.2:0/3660865709 >> 172.21.15.2:0/3660865709 conn(0x55a14efee460 msgr2=0x55a14f39d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- 172.21.15.2:0/3660865709 shutdown_connections 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- 172.21.15.2:0/3660865709 wait complete. 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.945+0000 7fdd20808740 1 -- start start 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 Processor -- start 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a14f168700 con 0x55a14efd11b0 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a14f28c750 con 0x55a14efd9390 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a14f3b1e50 con 0x55a14effa070 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd20808740 10 client.0 _ll_register_callbacks cb 0x55a14f2bbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60374/0 (socket says 172.21.15.2:60374) 2024-08-31T04:37:05.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 -- 172.21.15.2:0/108411648 learned_addr learned my addr 172.21.15.2:0/108411648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 -- 172.21.15.2:0/108411648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 msgr2=0x55a14f3bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3bb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 -- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 msgr2=0x55a14f3af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd18830640 1 -- 172.21.15.2:0/108411648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14f2c5900 con 0x55a14efd11b0 2024-08-31T04:37:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.946+0000 7fdd137fe640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdd18830640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c010950 tx=0x7fdd0c010410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c83c858eda149f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c015050 con 0x55a14efd11b0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd0c011bb0 con 0x55a14efd11b0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fdd0c0109f0 con 0x55a14efd11b0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd0c004e50 con 0x55a14efd11b0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdd20808740 10 client.17367 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a14f3bdc00 con 0x55a14efd11b0 2024-08-31T04:37:05.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c011bb0 con 0x55a14efd11b0 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.947+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fdd0c005240 con 0x55a14efd11b0 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 10 client.17367 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 10 client.17367 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 20 client.17367 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14efb89f0 0x55a14f3c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 4 client.17367 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a14f3185d0 con 0x55a14efb89f0 2024-08-31T04:37:05.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd137fe640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14efb89f0 0x55a14f3c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdd137fe640 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14efb89f0 0x55a14f3c1010 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76357aab093cb7ed server_cookie=ab9686b02071bc12 in_seq=0 out_seq=0 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.948+0000 7fdcf37fe640 10 client.17367 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdcf37fe640 1 -- 172.21.15.2:0/108411648 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a14f3185d0 con 0x55a14efb89f0 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdcf37fe640 10 client.17367 handle_command_reply: tid=0 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 client.17367 shutdown 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 msgr2=0x55a14f3aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c010950 tx=0x7fdd0c010410 comp rx=0 tx=0).stop 2024-08-31T04:37:05.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 shutdown_connections 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14efb89f0 0x55a14f3c1010 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 --2- 172.21.15.2:0/108411648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3aee30 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdcf37fe640 0 client.17367 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 >> 172.21.15.2:0/108411648 conn(0x55a14efee460 msgr2=0x55a14f39b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 shutdown_connections 2024-08-31T04:37:05.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 1 -- 172.21.15.2:0/108411648 wait complete. 2024-08-31T04:37:05.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.949+0000 7fdd20808740 20 client.17367 trim_cache size 0 max 16384 2024-08-31T04:37:05.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.962+0000 7fdd20808740 1 Processor -- start 2024-08-31T04:37:05.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.962+0000 7fdd20808740 1 -- start start 2024-08-31T04:37:05.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd11b0 0x55a14f398230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd9390 0x55a14f3ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b1800 con 0x55a14effa070 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141af0d0 con 0x55a14efd11b0 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd20808740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141acf40 con 0x55a14efd9390 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60386/0 (socket says 172.21.15.2:60386) 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 -- 172.21.15.2:0/990267446 learned_addr learned my addr 172.21.15.2:0/990267446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd11b0 0x55a14f398230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd137fe640 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd9390 0x55a14f3ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 -- 172.21.15.2:0/990267446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd9390 msgr2=0x55a14f3ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd9390 0x55a14f3ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 -- 172.21.15.2:0/990267446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd11b0 msgr2=0x55a14f398230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd11b0 0x55a14f398230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 -- 172.21.15.2:0/990267446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a14f3b19e0 con 0x55a14effa070 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.963+0000 7fdd18830640 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c013000 tx=0x7fdd0c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcad1a425e99054 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd09ffb640 1 -- 172.21.15.2:0/990267446 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c011bb0 con 0x55a14effa070 2024-08-31T04:37:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd09ffb640 1 -- 172.21.15.2:0/990267446 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c0119b0 con 0x55a14effa070 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd09ffb640 1 -- 172.21.15.2:0/990267446 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c010d00 con 0x55a14effa070 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 -- 172.21.15.2:0/990267446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 msgr2=0x55a14f3adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c013000 tx=0x7fdd0c01c040 comp rx=0 tx=0).stop 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 -- 172.21.15.2:0/990267446 shutdown_connections 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14effa070 0x55a14f3adbf0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14efd9390 0x55a14f3ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 --2- 172.21.15.2:0/990267446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd11b0 0x55a14f398230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 -- 172.21.15.2:0/990267446 >> 172.21.15.2:0/990267446 conn(0x55a14efee460 msgr2=0x55a14f3a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 -- 172.21.15.2:0/990267446 shutdown_connections 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.964+0000 7fdd20808740 1 -- 172.21.15.2:0/990267446 wait complete. 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 -- start start 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 Processor -- start 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3b7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141ad590 con 0x55a14efd11b0 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141aea00 con 0x55a14efd9390 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141adc60 con 0x55a14effa070 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd20808740 10 client.0 _ll_register_callbacks cb 0x7fdcfc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.965+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60392/0 (socket says 172.21.15.2:60392) 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 -- 172.21.15.2:0/2181001915 learned_addr learned my addr 172.21.15.2:0/2181001915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd137fe640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 -- 172.21.15.2:0/2181001915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 msgr2=0x55a14f3b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 -- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 msgr2=0x55a14f3b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 -- 172.21.15.2:0/2181001915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14f3b7d20 con 0x55a14efd11b0 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd18830640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c006010 tx=0x7fdd0c009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86711ad43d6e92ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdcf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:37:05.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c011700 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fdd0c010a80 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd0c0119b0 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd0c010ca0 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd20808740 10 client.17373 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.966+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a14f42bc50 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c0119b0 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fdd0c036040 con 0x55a14efd11b0 2024-08-31T04:37:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 10 client.17373 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 10 client.17373 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T04:37:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 20 client.17373 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14ef8dda0 0x55a14f42e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 4 client.17373 mds_command: new command op to 24671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:37:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 --> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a14f314070 con 0x55a14ef8dda0 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.967+0000 7fdd137fe640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14ef8dda0 0x55a14f42e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd137fe640 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14ef8dda0 0x55a14f42e250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58329dece5734e93 server_cookie=616c3c828c41f166 in_seq=0 out_seq=0 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdcf37fe640 10 client.17373 ms_handle_connect on v2:172.21.15.64:6836/2463382536 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdcf37fe640 1 -- 172.21.15.2:0/2181001915 <== mds.1 v2:172.21.15.64:6836/2463382536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a14f314070 con 0x55a14ef8dda0 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdcf37fe640 10 client.17373 handle_command_reply: tid=0 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 client.17373 shutdown 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 msgr2=0x55a14f3b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c006010 tx=0x7fdd0c009ea0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 shutdown_connections 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a14effa070 0x55a14f3b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a14efd9390 0x55a14f3b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.64:6836/2463382536,v1:172.21.15.64:6837/2463382536] conn(0x55a14ef8dda0 0x55a14f42e250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 --2- 172.21.15.2:0/2181001915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a14efd11b0 0x55a14f3b70f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdcf37fe640 0 client.17373 ms_handle_reset on v2:172.21.15.64:6836/2463382536 2024-08-31T04:37:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 >> 172.21.15.2:0/2181001915 conn(0x55a14efee460 msgr2=0x55a14f39cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 shutdown_connections 2024-08-31T04:37:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 1 -- 172.21.15.2:0/2181001915 wait complete. 2024-08-31T04:37:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.968+0000 7fdd20808740 20 client.17373 trim_cache size 0 max 16384 2024-08-31T04:37:05.981 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:37:05.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 msgr2=0x7fdd000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 0x7fdd000b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdd040e2a50 tx=0x7fdd04010cb0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 msgr2=0x7fdd1419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400d950 tx=0x7fdd0400de10 comp rx=0 tx=0).stop 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 shutdown_connections 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd14109be0 0x7fdd1419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd14109290 0x7fdd1419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdd000b4ca0 0x7fdd000b71b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 --2- 172.21.15.2:0/3850296575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd14103950 0x7fdd1419a270 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:05.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 >> 172.21.15.2:0/3850296575 conn(0x7fdd140ff3a0 msgr2=0x7fdd141017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:05.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 shutdown_connections 2024-08-31T04:37:05.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:05.969+0000 7fdd1a293640 1 -- 172.21.15.2:0/3850296575 wait complete. 2024-08-31T04:37:07.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:06 smithi064 ceph-mon[22007]: pgmap v700: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:37:07.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:06 smithi132 ceph-mon[22335]: pgmap v700: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:37:07.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:06 smithi002 ceph-mon[18656]: pgmap v700: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T04:37:07.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T04:37:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:07.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 -- 172.21.15.2:0/3081613628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 msgr2=0x7fb2a0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/3081613628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a0103d10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb290009ca0 tx=0x7fb29002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 -- 172.21.15.2:0/3081613628 shutdown_connections 2024-08-31T04:37:07.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/3081613628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109b90 0x7fb2a01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/3081613628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109240 0x7fb2a0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/3081613628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a0103d10 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 -- 172.21.15.2:0/3081613628 >> 172.21.15.2:0/3081613628 conn(0x7fb2a007b5f0 msgr2=0x7fb2a007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 -- 172.21.15.2:0/3081613628 shutdown_connections 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.898+0000 7fb2a7c53640 1 -- 172.21.15.2:0/3081613628 wait complete. 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 Processor -- start 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 -- start start 2024-08-31T04:37:07.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109240 0x7fb2a019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109b90 0x7fb2a019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0113850 con 0x7fb2a0103900 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01136d0 con 0x7fb2a0109b90 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a7c53640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01139d0 con 0x7fb2a0109240 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.899+0000 7fb2a59ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60406/0 (socket says 172.21.15.2:60406) 2024-08-31T04:37:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 -- 172.21.15.2:0/4244089143 learned_addr learned my addr 172.21.15.2:0/4244089143 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109240 0x7fb2a019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109b90 0x7fb2a019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 -- 172.21.15.2:0/4244089143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109240 msgr2=0x7fb2a019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109240 0x7fb2a019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 -- 172.21.15.2:0/4244089143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109b90 msgr2=0x7fb2a019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109b90 0x7fb2a019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 -- 172.21.15.2:0/4244089143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a01a01f0 con 0x7fb2a0103900 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb290006010 tx=0x7fb2900319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb29effd640 1 -- 172.21.15.2:0/4244089143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290003bf0 con 0x7fb2a0103900 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a01a0480 con 0x7fb2a0103900 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb29effd640 1 -- 172.21.15.2:0/4244089143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb290003d90 con 0x7fb2a0103900 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb29effd640 1 -- 172.21.15.2:0/4244089143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29002fc20 con 0x7fb2a0103900 2024-08-31T04:37:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.900+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a01a6c40 con 0x7fb2a0103900 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.903+0000 7fb2ae1c8740 1 Processor -- start 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.903+0000 7fb2ae1c8740 1 -- start start 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.903+0000 7fb29effd640 1 -- 172.21.15.2:0/4244089143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb2900046a0 con 0x7fb2a0103900 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e284b070 0x5634e2bf0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e28221b0 0x5634e2bf0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5634e2b67680 con 0x5634e282a390 2024-08-31T04:37:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5634e2b56c10 con 0x5634e284b070 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5634e2b5abc0 con 0x5634e28221b0 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60414/0 (socket says 172.21.15.2:60414) 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1326904149 learned_addr learned my addr 172.21.15.2:0/1326904149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e284b070 0x5634e2bf0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e28221b0 0x5634e2bf0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1326904149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e28221b0 msgr2=0x5634e2bf0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e28221b0 0x5634e2bf0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1326904149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e284b070 msgr2=0x5634e2bf0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e284b070 0x5634e2bf0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1326904149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e28b6650 con 0x5634e282a390 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.904+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bca0 tx=0x7fb2940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e16bb77b48befb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb287fff640 1 -- 172.21.15.2:0/1326904149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29401c680 con 0x5634e282a390 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb29effd640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 0x7fb2880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb287fff640 1 -- 172.21.15.2:0/1326904149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb29400be50 con 0x5634e282a390 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb287fff640 1 -- 172.21.15.2:0/1326904149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294011c30 con 0x5634e282a390 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 0x7fb2880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb29effd640 1 -- 172.21.15.2:0/4244089143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fb290106ed0 con 0x7fb2a0103900 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1326904149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 msgr2=0x5634e2bf0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 0x7fb2880b71b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb298005fd0 tx=0x7fb298005f60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.905+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bca0 tx=0x7fb2940107a0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1326904149 shutdown_connections 2024-08-31T04:37:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2bf0d90 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e28221b0 0x5634e2bf0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1326904149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e284b070 0x5634e2bf0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1326904149 >> 172.21.15.2:0/1326904149 conn(0x5634e283f460 msgr2=0x5634e2bee200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1326904149 shutdown_connections 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1326904149 wait complete. 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.906+0000 7fb2ae1c8740 1 -- start start 2024-08-31T04:37:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 Processor -- start 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bfbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2c07de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5634e29b9700 con 0x5634e284b070 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5634e2add750 con 0x5634e28221b0 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5634e2bfeaf0 con 0x5634e282a390 2024-08-31T04:37:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2ae1c8740 10 client.0 _ll_register_callbacks cb 0x5634e2b0ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2a61f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2c07de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2a61f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2c07de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60422/0 (socket says 172.21.15.2:60422) 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.907+0000 7fb2a61f0640 1 -- 172.21.15.2:0/1107802496 learned_addr learned my addr 172.21.15.2:0/1107802496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bfbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 msgr2=0x5634e2bfba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1107802496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 msgr2=0x5634e2c07de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2c07de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 -- 172.21.15.2:0/1107802496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e2b16900 con 0x5634e282a390 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bfbfb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bca0 tx=0x7fb294011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4de32cadc3c0aee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2857fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29402b060 con 0x5634e282a390 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fb294005040 con 0x5634e282a390 2024-08-31T04:37:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.908+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb29400be50 con 0x5634e282a390 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb294032050 con 0x5634e282a390 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 10 client.26869 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5634e2c0a8a0 con 0x5634e282a390 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb29400be50 con 0x5634e282a390 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fb294025070 con 0x5634e282a390 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 10 client.26869 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 10 client.26869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 20 client.26869 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e28099f0 0x5634e2c0dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 4 client.26869 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.909+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634e2b695d0 con 0x5634e28099f0 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.910+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e28099f0 0x5634e2c0dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.910+0000 7fb2857fa640 10 client.26869 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.910+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e28099f0 0x5634e2c0dcb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8521cdaac83e719 server_cookie=1b49d492ab1f0923 in_seq=0 out_seq=0 2024-08-31T04:37:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2857fa640 1 -- 172.21.15.2:0/1107802496 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5634e2b695d0 con 0x5634e28099f0 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2857fa640 10 client.26869 handle_command_reply: tid=0 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 client.26869 shutdown 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 msgr2=0x5634e2bfbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bfbfb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bca0 tx=0x7fb294011670 comp rx=0 tx=0).stop 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 shutdown_connections 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e28099f0 0x5634e2c0dcb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2c07de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bfbfb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/1107802496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2857fa640 0 client.26869 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 >> 172.21.15.2:0/1107802496 conn(0x5634e283f460 msgr2=0x5634e2bf34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 shutdown_connections 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.911+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/1107802496 wait complete. 2024-08-31T04:37:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.912+0000 7fb2ae1c8740 20 client.26869 trim_cache size 0 max 16384 2024-08-31T04:37:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 Processor -- start 2024-08-31T04:37:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 -- start start 2024-08-31T04:37:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bf3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01b39a0 con 0x5634e284b070 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01b1270 con 0x5634e28221b0 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01af0e0 con 0x5634e282a390 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2a61f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2a61f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60432/0 (socket says 172.21.15.2:60432) 2024-08-31T04:37:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2a61f0640 1 -- 172.21.15.2:0/138627096 learned_addr learned my addr 172.21.15.2:0/138627096 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.925+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bf3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 -- 172.21.15.2:0/138627096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 msgr2=0x5634e2bf3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bf3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 -- 172.21.15.2:0/138627096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 msgr2=0x5634e2bfbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 -- 172.21.15.2:0/138627096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e2bfe5a0 con 0x5634e284b070 2024-08-31T04:37:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb298010460 tx=0x7fb298010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9179ab8fcff8a864 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2877fe640 1 -- 172.21.15.2:0/138627096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29802b070 con 0x5634e284b070 2024-08-31T04:37:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2877fe640 1 -- 172.21.15.2:0/138627096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb29801bd20 con 0x5634e284b070 2024-08-31T04:37:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.926+0000 7fb2877fe640 1 -- 172.21.15.2:0/138627096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298026d10 con 0x5634e284b070 2024-08-31T04:37:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/138627096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 msgr2=0x5634e2bf3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb298010460 tx=0x7fb298010000 comp rx=0 tx=0).stop 2024-08-31T04:37:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/138627096 shutdown_connections 2024-08-31T04:37:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e284b070 0x5634e2bf3950 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e282a390 0x5634e2bf3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/138627096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2bfbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/138627096 >> 172.21.15.2:0/138627096 conn(0x5634e283f460 msgr2=0x5634e2bfb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/138627096 shutdown_connections 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/138627096 wait complete. 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.927+0000 7fb2ae1c8740 1 -- start start 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 Processor -- start 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2c0ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e284b070 0x5634e2c0f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01af730 con 0x5634e282a390 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01b0ba0 con 0x5634e28221b0 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a01afe00 con 0x5634e284b070 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2ae1c8740 10 client.0 _ll_register_callbacks cb 0x7fb29400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60438/0 (socket says 172.21.15.2:60438) 2024-08-31T04:37:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 -- 172.21.15.2:0/9470123 learned_addr learned my addr 172.21.15.2:0/9470123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2c0ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a61f0640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e284b070 0x5634e2c0f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 -- 172.21.15.2:0/9470123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e284b070 msgr2=0x5634e2c0f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e284b070 0x5634e2c0f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 -- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 msgr2=0x5634e2c0ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2c0ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.928+0000 7fb2a51ee640 1 -- 172.21.15.2:0/9470123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e2c77590 con 0x5634e282a390 2024-08-31T04:37:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2a51ee640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bbf0 tx=0x7fb29401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686398e7a40a5cbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29403a070 con 0x5634e282a390 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fb29400b710 con 0x5634e282a390 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb29801bd20 con 0x5634e282a390 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb294046050 con 0x5634e282a390 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2ae1c8740 10 client.17391 fetch_fsmap learned FSMap version 32 2024-08-31T04:37:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5634e2c78810 con 0x5634e282a390 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb29801bd20 con 0x5634e282a390 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.929+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fb294025040 con 0x5634e282a390 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 10 client.17391 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 20 client.17391 populate_metadata read hostname 'smithi002' 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e27deda0 0x5634e2c7af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 4 client.17391 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T04:37:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 --> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634e2b65070 con 0x5634e27deda0 2024-08-31T04:37:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e27deda0 0x5634e2c7af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2857fa640 10 client.17391 ms_handle_connect on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2a59ef640 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e27deda0 0x5634e2c7af10 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673b3baf26ab7fb8 server_cookie=567752db0de56398 in_seq=0 out_seq=0 2024-08-31T04:37:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2857fa640 1 -- 172.21.15.2:0/9470123 <== mds.0 v2:172.21.15.64:6838/574572481 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634e2b65070 con 0x5634e27deda0 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.930+0000 7fb2857fa640 10 client.17391 handle_command_reply: tid=0 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 client.17391 shutdown 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 msgr2=0x5634e2c0f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb29400bbf0 tx=0x7fb29401c4d0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 shutdown_connections 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:6838/574572481,v1:172.21.15.64:6839/574572481] conn(0x5634e27deda0 0x5634e2c7af10 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5634e282a390 0x5634e2c0f370 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5634e284b070 0x5634e2c0f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 --2- 172.21.15.2:0/9470123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634e28221b0 0x5634e2c0ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 >> 172.21.15.2:0/9470123 conn(0x5634e283f460 msgr2=0x5634e2bf9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2857fa640 0 client.17391 ms_handle_reset on v2:172.21.15.64:6838/574572481 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 shutdown_connections 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 1 -- 172.21.15.2:0/9470123 wait complete. 2024-08-31T04:37:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2ae1c8740 20 client.17391 trim_cache size 0 max 16384 2024-08-31T04:37:07.955 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-08-31T04:37:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 msgr2=0x7fb2880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 0x7fb2880b71b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb298005fd0 tx=0x7fb298005f60 comp rx=0 tx=0).stop 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 msgr2=0x7fb2a019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.931+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb290006010 tx=0x7fb2900319f0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 shutdown_connections 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2a0109b90 0x7fb2a019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2a0109240 0x7fb2a019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fb2880b4ca0 0x7fb2880b71b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 --2- 172.21.15.2:0/4244089143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a0103900 0x7fb2a019a280 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 >> 172.21.15.2:0/4244089143 conn(0x7fb2a007b5f0 msgr2=0x7fb2a0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 shutdown_connections 2024-08-31T04:37:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:07.932+0000 7fb2a7c53640 1 -- 172.21.15.2:0/4244089143 wait complete. 2024-08-31T04:37:08.702 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T04:37:08.707 INFO:tasks.fwd_scrub:done joining 2024-08-31T04:37:08.707 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T04:37:09.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:37:09.336 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:08 smithi132 ceph-mon[22335]: pgmap v701: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-08-31T04:37:09.336 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:08 smithi064 ceph-mon[22007]: pgmap v701: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-08-31T04:37:09.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:08 smithi002 ceph-mon[18656]: pgmap v701: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-08-31T04:37:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 -- 172.21.15.2:0/1305442406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c1089f0 msgr2=0x7f1a2c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 --2- 172.21.15.2:0/1305442406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c10f220 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009ca0 tx=0x7f1a2402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 -- 172.21.15.2:0/1305442406 shutdown_connections 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 --2- 172.21.15.2:0/1305442406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c10f220 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 --2- 172.21.15.2:0/1305442406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 0x7f1a2c1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 --2- 172.21.15.2:0/1305442406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c102770 0x7f1a2c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.463+0000 7f1a33b20640 1 -- 172.21.15.2:0/1305442406 >> 172.21.15.2:0/1305442406 conn(0x7f1a2c07a400 msgr2=0x7f1a2c07a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.464+0000 7f1a33b20640 1 -- 172.21.15.2:0/1305442406 shutdown_connections 2024-08-31T04:37:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.464+0000 7f1a33b20640 1 -- 172.21.15.2:0/1305442406 wait complete. 2024-08-31T04:37:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.464+0000 7f1a33b20640 1 Processor -- start 2024-08-31T04:37:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.464+0000 7f1a33b20640 1 -- start start 2024-08-31T04:37:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 0x7f1a2c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1126c0 con 0x7f1a2c102770 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c112540 con 0x7f1a2c1080a0 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c112840 con 0x7f1a2c1089f0 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60454/0 (socket says 172.21.15.2:60454) 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 -- 172.21.15.2:0/3132340156 learned_addr learned my addr 172.21.15.2:0/3132340156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:09.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a320bd640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a310bb640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 0x7f1a2c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 -- 172.21.15.2:0/3132340156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c1089f0 msgr2=0x7f1a2c19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 -- 172.21.15.2:0/3132340156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 msgr2=0x7f1a2c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 0x7f1a2c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 -- 172.21.15.2:0/3132340156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c19ef90 con 0x7f1a2c102770 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a318bc640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00e9f0 tx=0x7f1a1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00cd80 con 0x7f1a2c102770 2024-08-31T04:37:09.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a1c0054d0 con 0x7f1a2c102770 2024-08-31T04:37:09.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c19f280 con 0x7f1a2c102770 2024-08-31T04:37:09.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.465+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c010690 con 0x7f1a2c102770 2024-08-31T04:37:09.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.466+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1a5a10 con 0x7f1a2c102770 2024-08-31T04:37:09.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.467+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c1039e0 con 0x7f1a2c102770 2024-08-31T04:37:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.468+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1a1c004e30 con 0x7f1a2c102770 2024-08-31T04:37:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.469+0000 7f1a2affd640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 0x7f1a140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.469+0000 7f1a310bb640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 0x7f1a140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.469+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f1a1c0e61b0 con 0x7f1a2c102770 2024-08-31T04:37:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.470+0000 7f1a310bb640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 0x7f1a140b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c105b60 tx=0x7f1a20005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:09.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.472+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1a1c056130 con 0x7f1a2c102770 2024-08-31T04:37:09.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.661+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a2c19a180 con 0x7f1a2c102770 2024-08-31T04:37:09.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.663+0000 7f1a2affd640 1 -- 172.21.15.2:0/3132340156 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+25664 (secure 0 0 0) 0x7f1a2c19a180 con 0x7f1a2c102770 2024-08-31T04:37:09.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:09.665 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:37:02.698305+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:37:09.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 msgr2=0x7f1a140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 0x7f1a140b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c105b60 tx=0x7f1a20005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 msgr2=0x7f1a2c199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00e9f0 tx=0x7f1a1c00edf0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 shutdown_connections 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a2c1089f0 0x7f1a2c19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a2c1080a0 0x7f1a2c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1a140b4ca0 0x7f1a140b71b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 --2- 172.21.15.2:0/3132340156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c102770 0x7f1a2c199060 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.665+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 >> 172.21.15.2:0/3132340156 conn(0x7f1a2c07a400 msgr2=0x7f1a2c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:09.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.666+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 shutdown_connections 2024-08-31T04:37:09.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.666+0000 7f1a33b20640 1 -- 172.21.15.2:0/3132340156 wait complete. 2024-08-31T04:37:09.679 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T04:18:21.427633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T04:22:53.823776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T04:22:55.938232+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-31T04:23:02.265074+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-31T04:37:09.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T04:37:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 -- 172.21.15.2:0/1795473992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 msgr2=0x7f0cac103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/1795473992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac103c60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009900 tx=0x7f0ca802a410 comp rx=0 tx=0).stop 2024-08-31T04:37:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 -- 172.21.15.2:0/1795473992 shutdown_connections 2024-08-31T04:37:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/1795473992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 0x7f0cac110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/1795473992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 0x7f0cac109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/1795473992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac103c60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 -- 172.21.15.2:0/1795473992 >> 172.21.15.2:0/1795473992 conn(0x7f0cac0ff290 msgr2=0x7f0cac1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 -- 172.21.15.2:0/1795473992 shutdown_connections 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.793+0000 7f0cb46d5640 1 -- 172.21.15.2:0/1795473992 wait complete. 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 Processor -- start 2024-08-31T04:37:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 -- start start 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 0x7f0cac19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 0x7f0cac1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac1137a0 con 0x7f0cac103850 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac113620 con 0x7f0cac109ad0 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb46d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac113920 con 0x7f0cac109180 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60466/0 (socket says 172.21.15.2:60466) 2024-08-31T04:37:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 -- 172.21.15.2:0/848456463 learned_addr learned my addr 172.21.15.2:0/848456463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2c72640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 0x7f0cac1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb1c70640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 0x7f0cac19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 -- 172.21.15.2:0/848456463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 msgr2=0x7f0cac19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 0x7f0cac19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 -- 172.21.15.2:0/848456463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 msgr2=0x7f0cac1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 0x7f0cac1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.794+0000 7f0cb2471640 1 -- 172.21.15.2:0/848456463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac1a2350 con 0x7f0cac103850 2024-08-31T04:37:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0cb2471640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8005940 tx=0x7f0ca80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca803f030 con 0x7f0cac103850 2024-08-31T04:37:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1a25e0 con 0x7f0cac103850 2024-08-31T04:37:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca80044c0 con 0x7f0cac103850 2024-08-31T04:37:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8035070 con 0x7f0cac103850 2024-08-31T04:37:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.795+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1a8dd0 con 0x7f0cac103850 2024-08-31T04:37:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.796+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac104ac0 con 0x7f0cac103850 2024-08-31T04:37:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.798+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0ca8042030 con 0x7f0cac103850 2024-08-31T04:37:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.798+0000 7f0ca37fe640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 0x7f0c980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.798+0000 7f0cb1c70640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 0x7f0c980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.799+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f0ca8105f40 con 0x7f0cac103850 2024-08-31T04:37:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.799+0000 7f0cb1c70640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 0x7f0c980b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0cac06a840 tx=0x7f0c9c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.802+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0ca80cc210 con 0x7f0cac103850 2024-08-31T04:37:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.985+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0cac1a9000 con 0x7f0cac103850 2024-08-31T04:37:09.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.985+0000 7f0ca37fe640 1 -- 172.21.15.2:0/848456463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f0ca80d09d0 con 0x7f0cac103850 2024-08-31T04:37:09.987 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-31T04:37:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 msgr2=0x7f0c980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 0x7f0c980b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0cac06a840 tx=0x7f0c9c005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 msgr2=0x7f0cac19c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8005940 tx=0x7f0ca80040c0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 shutdown_connections 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cac109ad0 0x7f0cac1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cac109180 0x7f0cac19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0c980b4ca0 0x7f0c980b71b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 --2- 172.21.15.2:0/848456463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cac103850 0x7f0cac19c420 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.987+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 >> 172.21.15.2:0/848456463 conn(0x7f0cac0ff290 msgr2=0x7f0cac1088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.988+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 shutdown_connections 2024-08-31T04:37:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:09.988+0000 7f0cb46d5640 1 -- 172.21.15.2:0/848456463 wait complete. 2024-08-31T04:37:09.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:09 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3132340156' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:10.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T04:37:10.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:09 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3132340156' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:10.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:09 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3132340156' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 -- 172.21.15.2:0/3239450701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c810fe40 msgr2=0x7f65c8112260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 --2- 172.21.15.2:0/3239450701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c810fe40 0x7f65c8112260 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009ca0 tx=0x7f65c002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 -- 172.21.15.2:0/3239450701 shutdown_connections 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 --2- 172.21.15.2:0/3239450701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c810fe40 0x7f65c8112260 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 --2- 172.21.15.2:0/3239450701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 0x7f65c810f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 --2- 172.21.15.2:0/3239450701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80754d0 0x7f65c80758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 -- 172.21.15.2:0/3239450701 >> 172.21.15.2:0/3239450701 conn(0x7f65c80ff2b0 msgr2=0x7f65c8101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 -- 172.21.15.2:0/3239450701 shutdown_connections 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.114+0000 7f65d0653640 1 -- 172.21.15.2:0/3239450701 wait complete. 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 Processor -- start 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 -- start start 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 0x7f65c819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 0x7f65c81a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65c8115980 con 0x7f65c80754d0 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f65c8115800 con 0x7f65c8075e20 2024-08-31T04:37:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65d0653640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f65c8115b00 con 0x7f65c810fe40 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65ce3ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65ce3ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60490/0 (socket says 172.21.15.2:60490) 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65ce3ef640 1 -- 172.21.15.2:0/2475663398 learned_addr learned my addr 172.21.15.2:0/2475663398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65cdbee640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 0x7f65c819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.115+0000 7f65cebf0640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 0x7f65c81a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 -- 172.21.15.2:0/2475663398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 msgr2=0x7f65c81a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 0x7f65c81a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 -- 172.21.15.2:0/2475663398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 msgr2=0x7f65c819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 0x7f65c819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 -- 172.21.15.2:0/2475663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c81a2290 con 0x7f65c80754d0 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65cebf0640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 0x7f65c81a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65ce3ef640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f65c400e9f0 tx=0x7f65c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c400cd80 con 0x7f65c80754d0 2024-08-31T04:37:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c40054d0 con 0x7f65c80754d0 2024-08-31T04:37:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c81a2580 con 0x7f65c80754d0 2024-08-31T04:37:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4010690 con 0x7f65c80754d0 2024-08-31T04:37:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.116+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c81a8d10 con 0x7f65c80754d0 2024-08-31T04:37:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.117+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c80758e0 con 0x7f65c80754d0 2024-08-31T04:37:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.119+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f65c4004e30 con 0x7f65c80754d0 2024-08-31T04:37:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.119+0000 7f65bf7fe640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 0x7f65b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.119+0000 7f65cdbee640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 0x7f65b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.119+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f65c40e6100 con 0x7f65c80754d0 2024-08-31T04:37:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.120+0000 7f65cdbee640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 0x7f65b40b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f65c81122b0 tx=0x7f65b8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.122+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f65c4056130 con 0x7f65c80754d0 2024-08-31T04:37:10.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.308+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f65c81a9080 con 0x7f65c80754d0 2024-08-31T04:37:10.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.308+0000 7f65bf7fe640 1 -- 172.21.15.2:0/2475663398 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) ==== 104+0+11 (secure 0 0 0) 0x7f65c40aca20 con 0x7f65c80754d0 2024-08-31T04:37:10.310 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-31T04:37:10.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 msgr2=0x7f65b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 0x7f65b40b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f65c81122b0 tx=0x7f65b8005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 msgr2=0x7f65c819c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f65c400e9f0 tx=0x7f65c400edf0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 shutdown_connections 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c810fe40 0x7f65c81a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65c8075e20 0x7f65c819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f65b40b4ca0 0x7f65b40b71b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 --2- 172.21.15.2:0/2475663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65c80754d0 0x7f65c819c360 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 >> 172.21.15.2:0/2475663398 conn(0x7f65c80ff2b0 msgr2=0x7f65c8109950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:10.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 shutdown_connections 2024-08-31T04:37:10.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.311+0000 7f65d0653640 1 -- 172.21.15.2:0/2475663398 wait complete. 2024-08-31T04:37:10.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T04:37:10.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 -- 172.21.15.2:0/1424185579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90102580 msgr2=0x7fed90102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 --2- 172.21.15.2:0/1424185579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90102580 0x7fed90102990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009900 tx=0x7fed8c02a410 comp rx=0 tx=0).stop 2024-08-31T04:37:10.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 -- 172.21.15.2:0/1424185579 shutdown_connections 2024-08-31T04:37:10.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 --2- 172.21.15.2:0/1424185579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90108800 0x7fed9010f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 --2- 172.21.15.2:0/1424185579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90107eb0 0x7fed901082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 --2- 172.21.15.2:0/1424185579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90102580 0x7fed90102990 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 -- 172.21.15.2:0/1424185579 >> 172.21.15.2:0/1424185579 conn(0x7fed900fdfe0 msgr2=0x7fed90100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:10.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 -- 172.21.15.2:0/1424185579 shutdown_connections 2024-08-31T04:37:10.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.437+0000 7fed9679d640 1 -- 172.21.15.2:0/1424185579 wait complete. 2024-08-31T04:37:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 Processor -- start 2024-08-31T04:37:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 -- start start 2024-08-31T04:37:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 0x7fed9010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90107eb0 0x7fed90110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 0x7fed90110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed901135e0 con 0x7fed90108800 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fed90113460 con 0x7fed90102580 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9679d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fed90113760 con 0x7fed90107eb0 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9579b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 0x7fed9010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed94f9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90107eb0 0x7fed90110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9579b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 0x7fed9010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.2:59962/0 (socket says 172.21.15.2:59962) 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed95f9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 0x7fed90110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.438+0000 7fed9579b640 1 -- 172.21.15.2:0/3050599763 learned_addr learned my addr 172.21.15.2:0/3050599763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 -- 172.21.15.2:0/3050599763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90107eb0 msgr2=0x7fed90110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90107eb0 0x7fed90110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 -- 172.21.15.2:0/3050599763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 msgr2=0x7fed9010fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 0x7fed9010fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 -- 172.21.15.2:0/3050599763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed901a8290 con 0x7fed90108800 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed95f9c640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 0x7fed90110590 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e940 tx=0x7fed8800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88004d20 con 0x7fed90108800 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed88005020 con 0x7fed90108800 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed901a8580 con 0x7fed90108800 2024-08-31T04:37:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed880116d0 con 0x7fed90108800 2024-08-31T04:37:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.439+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed901a8b20 con 0x7fed90108800 2024-08-31T04:37:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.440+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed90102990 con 0x7fed90108800 2024-08-31T04:37:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.442+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fed88005460 con 0x7fed90108800 2024-08-31T04:37:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.442+0000 7fed867fc640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 0x7fed7c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.442+0000 7fed9579b640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 0x7fed7c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.442+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7fed880e5990 con 0x7fed90108800 2024-08-31T04:37:10.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.443+0000 7fed9579b640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 0x7fed7c0b7260 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009230 tx=0x7fed8c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.447+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fed88016030 con 0x7fed90108800 2024-08-31T04:37:10.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.635+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fed9002e430 con 0x7fed90108800 2024-08-31T04:37:10.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.635+0000 7fed867fc640 1 -- 172.21.15.2:0/3050599763 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) ==== 100+0+11 (secure 0 0 0) 0x7fed880abc60 con 0x7fed90108800 2024-08-31T04:37:10.637 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-31T04:37:10.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 msgr2=0x7fed7c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 0x7fed7c0b7260 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009230 tx=0x7fed8c0058d0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 msgr2=0x7fed90110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 0x7fed90110590 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e940 tx=0x7fed8800ee00 comp rx=0 tx=0).stop 2024-08-31T04:37:10.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 shutdown_connections 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fed7c0b4d50 0x7fed7c0b7260 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed90108800 0x7fed90110590 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed90107eb0 0x7fed90110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 --2- 172.21.15.2:0/3050599763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed90102580 0x7fed9010fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 >> 172.21.15.2:0/3050599763 conn(0x7fed900fdfe0 msgr2=0x7fed90100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 shutdown_connections 2024-08-31T04:37:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.638+0000 7fed9679d640 1 -- 172.21.15.2:0/3050599763 wait complete. 2024-08-31T04:37:10.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-31T04:37:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1256909477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0102750 msgr2=0x7ff0c0102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1256909477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0102750 0x7ff0c0102b60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ca0 tx=0x7ff0b802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1256909477 shutdown_connections 2024-08-31T04:37:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1256909477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c01089d0 0x7ff0c010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1256909477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c0108080 0x7ff0c0108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1256909477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0102750 0x7ff0c0102b60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1256909477 >> 172.21.15.2:0/1256909477 conn(0x7ff0c00fe150 msgr2=0x7ff0c01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1256909477 shutdown_connections 2024-08-31T04:37:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.763+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1256909477 wait complete. 2024-08-31T04:37:10.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 Processor -- start 2024-08-31T04:37:10.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 -- start start 2024-08-31T04:37:10.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c0102750 0x7ff0c0199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c01089d0 0x7ff0c019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01126a0 con 0x7ff0c0108080 2024-08-31T04:37:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0112520 con 0x7ff0c0102750 2024-08-31T04:37:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.764+0000 7ff0c75c6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0112820 con 0x7ff0c01089d0 2024-08-31T04:37:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60526/0 (socket says 172.21.15.2:60526) 2024-08-31T04:37:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 -- 172.21.15.2:0/1107471323 learned_addr learned my addr 172.21.15.2:0/1107471323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:10.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c5362640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c0102750 0x7ff0c0199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c5b63640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c01089d0 0x7ff0c019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 -- 172.21.15.2:0/1107471323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c01089d0 msgr2=0x7ff0c019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c01089d0 0x7ff0c019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 -- 172.21.15.2:0/1107471323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c0102750 msgr2=0x7ff0c0199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:10.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c0102750 0x7ff0c0199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:10.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 -- 172.21.15.2:0/1107471323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c019f030 con 0x7ff0c0108080 2024-08-31T04:37:10.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c4b61640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9c0 tx=0x7ff0b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400ccc0 con 0x7ff0c0108080 2024-08-31T04:37:10.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c019f320 con 0x7ff0c0108080 2024-08-31T04:37:10.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0b40054d0 con 0x7ff0c0108080 2024-08-31T04:37:10.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4010430 con 0x7ff0c0108080 2024-08-31T04:37:10.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.765+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c01a5ab0 con 0x7ff0c0108080 2024-08-31T04:37:10.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.766+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c01039c0 con 0x7ff0c0108080 2024-08-31T04:37:10.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.768+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff0b4005000 con 0x7ff0c0108080 2024-08-31T04:37:10.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.769+0000 7ff0be7fc640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 0x7ff0a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:10.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.769+0000 7ff0c5362640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 0x7ff0a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:10.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.769+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7ff0b40e5f00 con 0x7ff0c0108080 2024-08-31T04:37:10.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.770+0000 7ff0c5362640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 0x7ff0a80b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005e30 tx=0x7ff0b8009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:10.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:10.777+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0b4056130 con 0x7ff0c0108080 2024-08-31T04:37:11.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.011+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff0c019a220 con 0x7ff0c0108080 2024-08-31T04:37:11.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.012+0000 7ff0be7fc640 1 -- 172.21.15.2:0/1107471323 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v96) ==== 103+0+11 (secure 0 0 0) 0x7ff0b40052f0 con 0x7ff0c0108080 2024-08-31T04:37:11.014 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 msgr2=0x7ff0a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 0x7ff0a80b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005e30 tx=0x7ff0b8009360 comp rx=0 tx=0).stop 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 msgr2=0x7ff0c01996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9c0 tx=0x7ff0b400ee80 comp rx=0 tx=0).stop 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 shutdown_connections 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7ff0a80b4ca0 0x7ff0a80b71b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0c0108080 0x7ff0c01996a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c01089d0 0x7ff0c019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 --2- 172.21.15.2:0/1107471323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0c0102750 0x7ff0c0199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 >> 172.21.15.2:0/1107471323 conn(0x7ff0c00fe150 msgr2=0x7ff0c0100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:11.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 shutdown_connections 2024-08-31T04:37:11.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.014+0000 7ff0c75c6640 1 -- 172.21.15.2:0/1107471323 wait complete. 2024-08-31T04:37:11.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:10 smithi002 ceph-mon[18656]: pgmap v702: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 130 op/s 2024-08-31T04:37:11.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:10 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/848456463' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:10 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2475663398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:10 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3050599763' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T04:37:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:10 smithi064 ceph-mon[22007]: pgmap v702: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 130 op/s 2024-08-31T04:37:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:10 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/848456463' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:10 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2475663398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:10 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3050599763' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:10 smithi132 ceph-mon[22335]: pgmap v702: 129 pgs: 129 active+clean; 590 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 130 op/s 2024-08-31T04:37:11.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:10 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/848456463' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:10 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2475663398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:10 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3050599763' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:37:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- 172.21.15.2:0/3987866979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109190 msgr2=0x7f23901095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 --2- 172.21.15.2:0/3987866979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109190 0x7f23901095a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2378009900 tx=0x7f237802a410 comp rx=0 tx=0).stop 2024-08-31T04:37:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- 172.21.15.2:0/3987866979 shutdown_connections 2024-08-31T04:37:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 --2- 172.21.15.2:0/3987866979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109190 0x7f23901095a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 --2- 172.21.15.2:0/3987866979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390109ae0 0x7f2390110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 --2- 172.21.15.2:0/3987866979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390103860 0x7f2390103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- 172.21.15.2:0/3987866979 >> 172.21.15.2:0/3987866979 conn(0x7f23900ff2e0 msgr2=0x7f2390101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- 172.21.15.2:0/3987866979 shutdown_connections 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- 172.21.15.2:0/3987866979 wait complete. 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 Processor -- start 2024-08-31T04:37:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.137+0000 7f2396139640 1 -- start start 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 0x7f239019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 0x7f239019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2390113770 con 0x7f2390109ae0 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f23901135f0 con 0x7f2390109190 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2396139640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23901138f0 con 0x7f2390103860 2024-08-31T04:37:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60542/0 (socket says 172.21.15.2:60542) 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 -- 172.21.15.2:0/2682188937 learned_addr learned my addr 172.21.15.2:0/2682188937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2386ffd640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 0x7f239019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 -- 172.21.15.2:0/2682188937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 msgr2=0x7f239019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238f7fe640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 0x7f239019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 0x7f239019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 -- 172.21.15.2:0/2682188937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 msgr2=0x7f239019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 0x7f239019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238ffff640 1 -- 172.21.15.2:0/2682188937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23901a0100 con 0x7f2390109ae0 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f2386ffd640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 0x7f239019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.138+0000 7f238f7fe640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 0x7f239019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f238ffff640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f238800eb10 tx=0x7f238800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388004b20 con 0x7f2390109ae0 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23901a03f0 con 0x7f2390109ae0 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2388004cc0 con 0x7f2390109ae0 2024-08-31T04:37:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388010690 con 0x7f2390109ae0 2024-08-31T04:37:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.139+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23901a6b80 con 0x7f2390109ae0 2024-08-31T04:37:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.140+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2390103c70 con 0x7f2390109ae0 2024-08-31T04:37:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.141+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2388005000 con 0x7f2390109ae0 2024-08-31T04:37:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.142+0000 7f238d7fa640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.142+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9752+0+0 (secure 0 0 0) 0x7f23880e6330 con 0x7f2390109ae0 2024-08-31T04:37:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.142+0000 7f238f7fe640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.143+0000 7f238f7fe640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 0x7f237c0b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2380009b40 tx=0x7f2380005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.145+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2388056130 con 0x7f2390109ae0 2024-08-31T04:37:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.385+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f239002e430 con 0x7f2390109ae0 2024-08-31T04:37:11.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.393+0000 7f238d7fa640 1 -- 172.21.15.2:0/2682188937 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+826314 (secure 0 0 0) 0x7f23880acc50 con 0x7f2390109ae0 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 26, 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 14220, 2024-08-31T04:37:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1444417427 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1444417427 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/1444417427", 2024-08-31T04:37:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-08-31T04:16:32.968630+0000", 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24184, 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-08-31T04:37:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-08-31T04:37:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:37:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-08-31T04:37:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-08-31T04:37:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:37:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-08-31T04:37:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-08-31T04:37:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:37:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-08-31T04:37:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-08-31T04:37:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-08-31T04:37:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-08-31T04:37:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:37:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-08-31T04:37:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:37:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:37:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-08-31T04:37:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-08-31T04:37:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:37:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-08-31T04:37:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:37:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-08-31T04:37:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-08-31T04:37:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-08-31T04:37:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-08-31T04:37:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:37:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-08-31T04:37:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:37:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:37:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-08-31T04:37:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-08-31T04:37:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:37:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-08-31T04:37:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-08-31T04:37:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-08-31T04:37:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-08-31T04:37:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:37:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-08-31T04:37:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:37:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-08-31T04:37:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:37:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:37:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:37:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:37:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:37:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:37:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:37:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:37:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:37:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:37:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:37:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-08-31T04:37:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-08-31T04:37:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-08-31T04:37:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-08-31T04:37:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-08-31T04:37:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:37:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-08-31T04:37:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-08-31T04:37:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-08-31T04:37:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-08-31T04:37:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:37:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-08-31T04:37:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-08-31T04:37:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-08-31T04:37:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:37:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:37:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-08-31T04:37:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:37:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-08-31T04:37:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-08-31T04:37:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-08-31T04:37:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-08-31T04:37:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-08-31T04:37:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-08-31T04:37:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-08-31T04:37:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-08-31T04:37:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:37:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.973 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-08-31T04:37:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-08-31T04:37:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-08-31T04:37:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:37:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-08-31T04:37:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-08-31T04:37:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:37:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-08-31T04:37:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-08-31T04:37:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-08-31T04:37:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-08-31T04:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-08-31T04:37:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-08-31T04:37:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-08-31T04:37:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:37:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-08-31T04:37:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-08-31T04:37:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-08-31T04:37:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-08-31T04:37:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-08-31T04:37:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:37:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:37:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-08-31T04:37:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-08-31T04:37:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24191, 2024-08-31T04:37:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-08-31T04:37:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-08-31T04:37:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-08-31T04:37:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:37:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:37:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-08-31T04:37:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-08-31T04:37:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-08-31T04:37:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-08-31T04:37:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-08-31T04:37:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:37:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:37:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-08-31T04:37:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-08-31T04:37:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-08-31T04:37:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:37:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:37:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:37:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-08-31T04:37:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:37:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-08-31T04:37:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-08-31T04:37:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-08-31T04:37:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:37:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-08-31T04:37:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:37:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:37:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-08-31T04:37:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:37:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-08-31T04:37:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-08-31T04:37:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:37:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:37:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-08-31T04:37:12.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-08-31T04:37:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-08-31T04:37:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:37:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:37:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:37:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:37:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:37:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:37:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:37:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:37:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:37:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:37:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:37:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-08-31T04:37:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-08-31T04:37:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-08-31T04:37:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:37:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-08-31T04:37:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-08-31T04:37:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:37:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-08-31T04:37:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:37:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-08-31T04:37:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-08-31T04:37:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:37:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-08-31T04:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-08-31T04:37:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:37:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-08-31T04:37:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-08-31T04:37:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:37:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-08-31T04:37:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.792 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-08-31T04:37:12.796 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.801 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:12.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:37:12.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-08-31T04:37:12.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:12.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-08-31T04:37:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:12.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-08-31T04:37:12.825 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.827 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.831 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:37:12.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.891 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.895 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-08-31T04:37:12.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.905 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-08-31T04:37:12.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.912 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-08-31T04:37:12.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.920 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-08-31T04:37:12.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-08-31T04:37:12.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.925 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.930 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.931 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-08-31T04:37:12.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:37:12.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-08-31T04:37:12.937 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.941 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.947 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.958 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.961 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.965 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.966 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.966 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.966 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.966 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.966 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.969 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.970 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.975 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.976 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:12.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.981 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:12.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:12.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:12.991 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.993 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-08-31T04:37:12.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:37:12.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:12.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:12.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-08-31T04:37:13.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:37:13.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.013 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-08-31T04:37:13.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-08-31T04:37:13.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.020 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.023 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.032 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.043 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-08-31T04:37:13.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:37:13.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.059 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.060 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.065 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.071 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-08-31T04:37:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-08-31T04:37:13.082 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-08-31T04:37:13.083 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.087 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.091 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.094 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-08-31T04:37:13.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-08-31T04:37:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:37:13.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-08-31T04:37:13.110 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:13.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.116 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-08-31T04:37:13.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-08-31T04:37:13.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:37:13.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-08-31T04:37:13.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.123 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-08-31T04:37:13.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.126 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.135 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-08-31T04:37:13.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:37:13.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.146 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.147 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-08-31T04:37:13.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-08-31T04:37:13.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:37:13.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:37:13.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-08-31T04:37:13.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:37:13.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:37:13.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-08-31T04:37:13.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:37:13.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-08-31T04:37:13.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-08-31T04:37:13.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-08-31T04:37:13.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:37:13.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.187 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:37:13.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:37:13.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:37:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:37:13.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-08-31T04:37:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-08-31T04:37:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-08-31T04:37:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.206 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-08-31T04:37:13.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:37:13.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-08-31T04:37:13.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-08-31T04:37:13.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.220 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:37:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.226 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:37:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-08-31T04:37:13.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-08-31T04:37:13.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-08-31T04:37:13.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:37:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.245 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-08-31T04:37:13.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:37:13.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.252 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-08-31T04:37:13.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.264 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.266 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.268 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.271 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.281 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.285 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:37:13.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.293 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.294 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.296 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.303 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:37:13.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:37:13.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:37:13.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-08-31T04:37:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.323 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:37:13.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:37:13.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.335 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:37:13.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.342 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:37:13.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:37:13.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:37:13.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:13.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-08-31T04:37:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-08-31T04:37:13.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.372 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.378 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-08-31T04:37:13.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-08-31T04:37:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:13.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-08-31T04:37:13.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.398 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-08-31T04:37:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.402 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-08-31T04:37:13.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:37:13.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.416 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:13.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:37:13.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.425 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.429 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:13.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:37:13.440 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-08-31T04:37:13.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:37:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:37:13.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.449 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:37:13.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.462 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-08-31T04:37:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-08-31T04:37:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-08-31T04:37:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:37:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-08-31T04:37:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:37:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-08-31T04:37:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-08-31T04:37:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-08-31T04:37:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-08-31T04:37:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-08-31T04:37:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-08-31T04:37:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-08-31T04:37:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-08-31T04:37:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-08-31T04:37:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-08-31T04:37:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-08-31T04:37:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:37:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-08-31T04:37:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-08-31T04:37:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-08-31T04:37:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-08-31T04:37:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-08-31T04:37:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-08-31T04:37:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-08-31T04:37:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-08-31T04:37:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-08-31T04:37:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-08-31T04:37:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-08-31T04:37:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-08-31T04:37:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-08-31T04:37:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-08-31T04:37:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-08-31T04:37:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-08-31T04:37:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-08-31T04:37:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-08-31T04:37:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-08-31T04:37:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-08-31T04:37:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-08-31T04:37:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-08-31T04:37:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-08-31T04:37:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-08-31T04:37:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-08-31T04:37:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-08-31T04:37:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-08-31T04:37:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 5, 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3923362305 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2150317341 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1486124624 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3720458596 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2489086464 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-08-31T04:37:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2713533173 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-31T04:37:13.935 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:13.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 msgr2=0x7f237c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 0x7f237c0b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2380009b40 tx=0x7f2380005e50 comp rx=0 tx=0).stop 2024-08-31T04:37:13.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 msgr2=0x7f239019fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f238800eb10 tx=0x7f238800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 shutdown_connections 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2390109ae0 0x7f239019fa00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2390109190 0x7f239019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 --2- 172.21.15.2:0/2682188937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2390103860 0x7f239019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 >> 172.21.15.2:0/2682188937 conn(0x7f23900ff2e0 msgr2=0x7f2390108840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 shutdown_connections 2024-08-31T04:37:13.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:11.399+0000 7f2396139640 1 -- 172.21.15.2:0/2682188937 wait complete. 2024-08-31T04:37:13.945 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T04:37:13.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1107471323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2682188937' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:13.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:13.947 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:11 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:37:13.947 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:12 smithi002 ceph-mon[18656]: pgmap v703: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 110 op/s 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1107471323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2682188937' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:13.948 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:11 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:12 smithi132 ceph-mon[22335]: pgmap v703: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 110 op/s 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1107471323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2682188937' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:37:13.949 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:13.950 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:13.950 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:11 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' 2024-08-31T04:37:13.950 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:12 smithi064 ceph-mon[22007]: pgmap v703: 129 pgs: 129 active+clean; 591 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 110 op/s 2024-08-31T04:37:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-08-31T04:37:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-08-31T04:37:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 2992, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003207359, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000050500, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002197899, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-08-31T04:37:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.003869880, 2024-08-31T04:37:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001289960 2024-08-31T04:37:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 177, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 160, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 111088, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014988014, 2024-08-31T04:37:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.012245829, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001203245, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 175, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.007402961, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000042302 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 111088 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 240, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 233, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1138528, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 143424, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.040276554, 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.017741455, 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.032423141, 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 232, 2024-08-31T04:37:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010778561, 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000046459 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1138528, 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 143424 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148967, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 29, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-08-31T04:37:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 241, 2024-08-31T04:37:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1104596, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 241, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 241, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1104596, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:14.745 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:14.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:14 smithi002 ceph-mon[18656]: pgmap v705: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-08-31T04:37:15.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:14 smithi064 ceph-mon[22007]: pgmap v705: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-08-31T04:37:15.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:14 smithi132 ceph-mon[22335]: pgmap v705: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-08-31T04:37:15.524 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-31T04:37:15.524 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-31T04:37:15.524 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-08-31T04:37:15.524 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-08-31T04:37:15.524 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-08-31T04:37:15.524 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T04:37:15.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T04:37:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 245, 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 238, 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1139888, 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 146624, 2024-08-31T04:37:16.293 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.043089967, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.019233398, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.033772240, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 237, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010455871, 2024-08-31T04:37:16.294 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000044117 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1139888, 2024-08-31T04:37:16.295 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 146624 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 5, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 183, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3152, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 112240, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-08-31T04:37:16.296 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.017208303, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.012753267, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003069194, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 182, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011139095, 2024-08-31T04:37:16.297 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000061203 2024-08-31T04:37:16.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 112240 2024-08-31T04:37:16.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:16.301 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000377301, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000317033, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-08-31T04:37:16.303 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:16.304 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:16.305 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:16.306 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:16.307 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:16.308 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149007, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-08-31T04:37:16.309 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-08-31T04:37:16.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-08-31T04:37:16.311 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-08-31T04:37:16.312 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 246, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1105246, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 246, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-08-31T04:37:16.313 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 246, 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1105246, 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:16.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:16.315 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:16 smithi002 ceph-mon[18656]: pgmap v706: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 1.7 MiB/s wr, 54 op/s 2024-08-31T04:37:16.979 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-31T04:37:16.979 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-31T04:37:16.979 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-31T04:37:16.979 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-31T04:37:16.980 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-31T04:37:16.980 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T04:37:16.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T04:37:17.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:16 smithi064 ceph-mon[22007]: pgmap v706: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 1.7 MiB/s wr, 54 op/s 2024-08-31T04:37:17.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:16 smithi132 ceph-mon[22335]: pgmap v706: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 1.7 MiB/s wr, 54 op/s 2024-08-31T04:37:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:17.867 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-08-31T04:37:17.868 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001310968, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000318551, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:17.869 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:17.870 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1, 2024-08-31T04:37:17.871 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 179, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 160, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 111440, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.015329469, 2024-08-31T04:37:17.872 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.012323281, 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001493374, 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 177, 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.007916303, 2024-08-31T04:37:17.873 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000044724 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:17.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 111440 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 246, 2024-08-31T04:37:17.875 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 237, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1142064, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 145152, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.041368566, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.017534021, 2024-08-31T04:37:17.876 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.033103411, 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 237, 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014197195, 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000059903 2024-08-31T04:37:17.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.878 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1142064, 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 145152 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.879 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:17.880 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:17.884 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148984, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-08-31T04:37:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:17.886 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-08-31T04:37:17.887 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-08-31T04:37:17.888 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 243, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1104856, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 243, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 243, 2024-08-31T04:37:17.889 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1104856, 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:17.890 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:18.549 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-31T04:37:18.549 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-31T04:37:18.549 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-08-31T04:37:18.550 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-08-31T04:37:18.550 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-08-31T04:37:18.550 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T04:37:18.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T04:37:18.803 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:19.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:18 smithi002 ceph-mon[18656]: pgmap v707: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-08-31T04:37:19.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:18 smithi064 ceph-mon[22007]: pgmap v707: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-08-31T04:37:19.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:18 smithi132 ceph-mon[22335]: pgmap v707: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-08-31T04:37:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-31T04:37:19.305 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 251, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 242, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1143424, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 148352, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.045288356, 2024-08-31T04:37:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.018685668, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.036145206, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 242, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014924011, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000061669 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.307 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1143424, 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 148352 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.308 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 183, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 160, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 112144, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:19.309 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.015454023, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.012532638, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001420728, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 181, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.007106186, 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000039260 2024-08-31T04:37:19.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 112144 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.311 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000335928, 2024-08-31T04:37:19.312 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000256138, 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:19.313 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:19.314 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:19.315 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:19.316 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:19.317 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:19.318 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:19.319 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149047, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-08-31T04:37:19.320 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-08-31T04:37:19.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-08-31T04:37:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-08-31T04:37:19.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 248, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1105506, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 248, 2024-08-31T04:37:19.324 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 248, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1105506, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-08-31T04:37:19.325 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-08-31T04:37:19.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:19.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-31T04:37:19.326 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-31T04:37:19.956 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T04:37:19.956 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T04:37:19.957 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-31T04:37:19.957 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-31T04:37:19.957 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-31T04:37:19.957 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T04:37:19.957 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T04:37:20.290 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:37:20.863 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-08-31T04:37:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 147207, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 246439, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 29195171, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 484881682, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 125, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 16.381111633, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 9.070697301, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 5.962126775, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 1.605867064, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 246441, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 6.920436733, 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000028081 2024-08-31T04:37:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 297960, 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.057082227, 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000191 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 1265600, 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 180192 2024-08-31T04:37:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 449176, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 641324, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 161079696, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 884864881, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 17, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 8, 2024-08-31T04:37:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 40.811599371, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 22.253286395, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 20.122211129, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 2.457841203, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 641320, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 17.767552426, 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000027704 2024-08-31T04:37:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 938974, 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.165155605, 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000175 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 144106128, 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 541869392 2024-08-31T04:37:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 165212, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 263912, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 32584770, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 428770109, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 22, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 6, 2024-08-31T04:37:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 16.582785909, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 8.692840849, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 6.199314053, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 1.871943786, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 263910, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 9.095710790, 2024-08-31T04:37:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000034465 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 325359, 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.064162158, 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000197 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 130293, 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 111.517713234, 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000855899 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 65039, 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 9.556668991, 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000146937 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 308726, 2024-08-31T04:37:20.875 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 307770, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 307770, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 438.296298001, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001424103 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 956, 2024-08-31T04:37:20.876 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 216, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 16, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 24, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 3315, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 1403, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 1884, 2024-08-31T04:37:20.877 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 28, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 1311, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 65, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 383, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 383, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 4, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 426819, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 278005, 2024-08-31T04:37:20.878 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 956, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 3114, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-08-31T04:37:20.879 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 1, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 6, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 1382, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 68, 2024-08-31T04:37:20.880 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 21135904, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 6, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 1382, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 309, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 16, 2024-08-31T04:37:20.881 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 293, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 1073, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 2, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 12783, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 151796, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:20.882 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 67576, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 29973, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 14640, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 213456 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 6, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-08-31T04:37:20.883 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 17, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 309, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:20.884 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 39005, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 38696, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:20.885 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 16, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 1, 2024-08-31T04:37:20.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-08-31T04:37:20.887 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 40, 2024-08-31T04:37:20.887 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:20.887 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:20.887 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-08-31T04:37:20.887 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 183274, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 112281, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 110612, 2024-08-31T04:37:20.888 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 72662, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 1669, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 296, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 168, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 165, 2024-08-31T04:37:20.889 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 131, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 6, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 3, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 451503379, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 977248824, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-08-31T04:37:20.890 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 65507, 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 142.149942847, 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002169996 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 1153, 2024-08-31T04:37:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 39803, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 38650, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 70, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 186, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 116, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 3216, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 83712, 2024-08-31T04:37:20.892 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 80496, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 383, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 42908, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 42525, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 158636, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 374222848 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-08-31T04:37:20.893 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 446828, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 2649, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 308726, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 5746, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 5298, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 39073, 2024-08-31T04:37:20.894 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 45.324800048, 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001160003 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2849, 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 24.353179948, 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.008547974 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.895 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.896 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 87711, 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 73.987827354, 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000843541 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.897 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.898 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.899 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:20.900 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.900 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.901 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 12, 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.005030527, 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000419210 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-08-31T04:37:20.902 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 20, 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.023524825, 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001176241 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.903 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 12, 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 3.796921683, 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.316410140 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-08-31T04:37:20.904 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000317781, 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000317781 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 129095, 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 223.650317604, 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001732447 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.905 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8647, 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 13.452356367, 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001555725 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.906 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-08-31T04:37:20.907 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6, 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.064866513, 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.010811085 2024-08-31T04:37:20.908 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2, 2024-08-31T04:37:20.909 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.001607577, 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000803788 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:20.910 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1328, 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.850753389, 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000640627 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.911 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 9, 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.023262889, 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002584765 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.912 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 39005, 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 52.761531496, 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001352686 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.913 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.914 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 2, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 5, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 3, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 2, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 47611, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 23805, 2024-08-31T04:37:20.915 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 693, 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:20.916 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:20.917 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:20.918 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:20.919 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:20.920 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 4021881, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 1745, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 176, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 2, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:20.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 208, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:20.922 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 6214317, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 135209, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 149013, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 983094971, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 37, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 149013, 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-08-31T04:37:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 149013, 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 552.060211019, 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.003704778 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 149013, 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 150547 2024-08-31T04:37:20.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 149013, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 2559, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 146454, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 33, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 51, 2024-08-31T04:37:20.926 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 1161, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 66652, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 539, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 16, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 78343, 2024-08-31T04:37:20.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 1398, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 98, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-08-31T04:37:20.928 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-08-31T04:37:20.929 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-08-31T04:37:20.930 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 97, 2024-08-31T04:37:20.931 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 22, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 12, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 12, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 1658, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-08-31T04:37:20.932 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 598 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.933 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 16, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 8, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 77392, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 38696, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.934 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 761591, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 136555866, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 761591, 2024-08-31T04:37:20.935 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 761591, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 136555866, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:20.937 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 149013, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 987317435, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 149013, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 987317435, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.938 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:20.939 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 149013, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 149013, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 149013, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 149013, 2024-08-31T04:37:20.940 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:20.941 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 38696, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 4222464, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 38696, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:20.942 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1145, 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 4222464, 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.943 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x55edcac9e9c0": { 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 70682, 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 183274, 2024-08-31T04:37:20.944 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 973054520, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 183274, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 65507, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 972983838, 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:20.945 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:20.946 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-08-31T04:37:21.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:20 smithi064 ceph-mon[22007]: pgmap v708: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-08-31T04:37:21.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:20 smithi132 ceph-mon[22335]: pgmap v708: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-08-31T04:37:21.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:20 smithi002 ceph-mon[18656]: pgmap v708: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-08-31T04:37:21.753 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-08-31T04:37:21.753 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-08-31T04:37:21.753 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-31T04:37:21.753 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-08-31T04:37:21.753 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-08-31T04:37:21.753 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T04:37:21.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T04:37:22.019 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:37:22.622 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-08-31T04:37:22.622 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:22.622 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 2264, 2024-08-31T04:37:22.622 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 2266, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 399105588, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 719962, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 8, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.382897957, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.091485264, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.223599731, 2024-08-31T04:37:22.623 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.053454575, 2024-08-31T04:37:22.624 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:22.624 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2264, 2024-08-31T04:37:22.624 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.059020959, 2024-08-31T04:37:22.624 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000026069 2024-08-31T04:37:22.624 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:22.625 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 827, 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1006, 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 261070602, 2024-08-31T04:37:22.626 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 653798, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 6, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 5, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.223093501, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.033673027, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.164741219, 2024-08-31T04:37:22.627 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.017353292, 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1005, 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.032350064, 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000032189 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.628 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 392336 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1426, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1411, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 316071424, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 517057, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:22.630 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.321597060, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.055228373, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.245463840, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.026771042, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1410, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.037768635, 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000026786 2024-08-31T04:37:22.631 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 1201552, 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 150720 2024-08-31T04:37:22.632 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6424, 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.190884208, 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000029714 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:22.634 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:22.635 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.635 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.635 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.635 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.635 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 0, 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 0, 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.636 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-08-31T04:37:22.637 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 39791, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 16415, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 23376, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 16342, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 0, 2024-08-31T04:37:22.638 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 3, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:22.639 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-08-31T04:37:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 68, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 21135904, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 6, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:37:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 0, 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 0 2024-08-31T04:37:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:37:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 0, 2024-08-31T04:37:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 183383, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-08-31T04:37:22.648 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 132, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 16, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 451503379, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 978076940, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 978076341, 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-08-31T04:37:22.649 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 183383 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 1033, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 39730, 2024-08-31T04:37:22.650 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 38697, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 68, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 184, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 116, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 39797, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 39802, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 5, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 0, 2024-08-31T04:37:22.651 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 0, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 0, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 156940, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 388624384 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 0, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-08-31T04:37:22.652 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 0, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 0, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.653 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.654 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-08-31T04:37:22.655 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.658 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:22.659 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.659 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.659 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.659 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.660 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-08-31T04:37:22.660 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.660 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.660 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.661 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-08-31T04:37:22.662 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.663 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.663 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.663 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.663 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-08-31T04:37:22.663 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.664 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.665 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:22.666 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.667 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.668 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.669 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.669 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:22.669 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.670 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.671 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.672 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-08-31T04:37:22.673 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.673 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.673 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.673 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.673 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.674 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.675 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 2, 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 5, 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 3, 2024-08-31T04:37:22.676 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 3, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 0, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 0, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 2532, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-08-31T04:37:22.677 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:22.678 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:22.679 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:22.680 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:22.681 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 282821, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 1465, 2024-08-31T04:37:22.682 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:22.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 208, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 30421730, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 249795, 2024-08-31T04:37:22.684 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-08-31T04:37:22.685 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 4238, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 26, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 4, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 4238, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4238, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 4.717907907, 2024-08-31T04:37:22.686 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001113239 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4238, 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 4239 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 4238, 2024-08-31T04:37:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 4238, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 0, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 2593, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 0, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 1642, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 0, 2024-08-31T04:37:22.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:22.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 2, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-08-31T04:37:22.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-08-31T04:37:22.692 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-08-31T04:37:22.693 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 97, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 14, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 10, 2024-08-31T04:37:22.694 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 10, 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 0, 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 2, 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 0 2024-08-31T04:37:22.695 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 0, 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-08-31T04:37:22.696 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 0, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.697 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 4513, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 975824452, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 4513, 2024-08-31T04:37:22.698 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4513, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 975824452, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.699 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:22.700 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4238, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 973890334, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4238, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 973890334, 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:22.702 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4238, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 4238, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4238, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 4238, 2024-08-31T04:37:22.703 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:22.704 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:22.705 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.706 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x55dc23b08750": { 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:22.707 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:22.708 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:22.709 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-08-31T04:37:23.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:22 smithi064 ceph-mon[22007]: pgmap v709: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-08-31T04:37:23.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:22 smithi132 ceph-mon[22335]: pgmap v709: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-08-31T04:37:23.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:22 smithi002 ceph-mon[18656]: pgmap v709: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-08-31T04:37:23.682 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T04:37:23.682 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T04:37:23.682 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-08-31T04:37:23.682 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-31T04:37:23.682 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T04:37:23.682 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T04:37:23.683 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T04:37:23.952 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:37:24.678 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 198943, 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 99670, 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 111221145, 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 16174954, 2024-08-31T04:37:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 9, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 9.976757004, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 4.866382134, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 7.025706553, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.004138137, 2024-08-31T04:37:24.680 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 99668, 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.361508013, 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000013660 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 298410, 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.042720504, 2024-08-31T04:37:24.681 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000143 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 3296, 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 13312 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 362, 2024-08-31T04:37:24.682 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 342, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 1227674, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 581148, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 42, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 5, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.061269332, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.018886448, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.064180996, 2024-08-31T04:37:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000450634, 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 342, 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.033490926, 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000097926 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.684 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 49, 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000006711, 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000136 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 1219968, 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 156880 2024-08-31T04:37:24.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 9436, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 9652, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 3017233, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 1794175, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 9, 2024-08-31T04:37:24.686 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 5, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.770708876, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.350753374, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.563256078, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000290944, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 9650, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.144447923, 2024-08-31T04:37:24.687 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000014968 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 18880, 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003338050, 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000176 2024-08-31T04:37:24.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 3014720, 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 1760144 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-08-31T04:37:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 58, 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.002803413, 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000048334 2024-08-31T04:37:24.690 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2, 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000013903, 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000006951 2024-08-31T04:37:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 9420, 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 4, 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4, 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000620199, 2024-08-31T04:37:24.692 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000155049 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 9416, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 11, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-08-31T04:37:24.693 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 22, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 2, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 20, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 19, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 1, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 2, 2024-08-31T04:37:24.694 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 9427, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 9, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 9414, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 3, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-08-31T04:37:24.695 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:24.696 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 74, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 21222240, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 6, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:37:24.697 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:24.698 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 0, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 0, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 0 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-08-31T04:37:24.699 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 9, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 6, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 7, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:24.700 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-08-31T04:37:24.701 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:24.702 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 8, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-08-31T04:37:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 8, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 2, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 2, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 2, 2024-08-31T04:37:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 4196655, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.014750640, 2024-08-31T04:37:24.705 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002107234 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 25, 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 25, 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 0, 2024-08-31T04:37:24.706 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 38, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 41, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 3, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 22, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 22, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 0, 2024-08-31T04:37:24.708 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 2, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 2, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 0, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 121312, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 330186752 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 9420, 2024-08-31T04:37:24.709 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 9420, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 27, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.710 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 3, 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000494350, 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000164783 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.711 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-08-31T04:37:24.712 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.713 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000125849, 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000125849 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.714 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:24.715 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.716 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-08-31T04:37:24.717 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.718 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.719 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:24.720 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.721 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.722 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.723 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.724 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-08-31T04:37:24.725 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.726 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-08-31T04:37:24.727 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.728 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 2, 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 4, 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 2, 2024-08-31T04:37:24.729 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 2, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 3, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 1, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 691, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-08-31T04:37:24.730 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:24.732 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:24.733 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:24.734 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 258659, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 115, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-08-31T04:37:24.735 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 208, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:24.736 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 130873, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 654, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:24.737 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 45, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 12833, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 33, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 45, 2024-08-31T04:37:24.738 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 45, 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.279994435, 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.006222098 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 45, 2024-08-31T04:37:24.739 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 67 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 45, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 0, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 45, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-08-31T04:37:24.740 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 10, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 0, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 7, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 9, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-08-31T04:37:24.741 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 6, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 20, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:24.742 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-08-31T04:37:24.743 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-08-31T04:37:24.744 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 97, 2024-08-31T04:37:24.745 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 14, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 9, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 9, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 14, 2024-08-31T04:37:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 1 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.747 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 0, 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:24.748 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 208737, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 96280157, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:24.749 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 208737, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 208737, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 96280157, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.750 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:24.751 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 45, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 12833, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 45, 2024-08-31T04:37:24.752 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 12833, 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:24.753 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 45, 2024-08-31T04:37:24.754 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 45, 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 45, 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 45, 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.755 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.757 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x563bf9e62680": { 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 8, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 2351, 2024-08-31T04:37:24.758 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 8, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 7, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 2351, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:24.759 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:24.760 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-08-31T04:37:25.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:24 smithi064 ceph-mon[22007]: pgmap v710: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 1.6 MiB/s wr, 65 op/s 2024-08-31T04:37:25.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:24 smithi132 ceph-mon[22335]: pgmap v710: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 1.6 MiB/s wr, 65 op/s 2024-08-31T04:37:25.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:24 smithi002 ceph-mon[18656]: pgmap v710: 129 pgs: 129 active+clean; 588 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 1.6 MiB/s wr, 65 op/s 2024-08-31T04:37:25.725 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-31T04:37:25.725 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-31T04:37:25.725 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-31T04:37:25.725 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-31T04:37:25.726 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T04:37:25.726 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T04:37:25.726 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T04:37:25.991 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:37:26.555 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1102, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1087, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 1480304, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 415166, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:26.556 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.132604899, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.059543918, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.058235812, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.020882013, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1086, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.039210908, 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000036105 2024-08-31T04:37:26.557 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 1203104, 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 152816 2024-08-31T04:37:26.558 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 9, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 192, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 4028, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 567418, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 6, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 3, 2024-08-31T04:37:26.559 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.014909268, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.009358472, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.003963540, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000066219, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 190, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.013561383, 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000071375 2024-08-31T04:37:26.560 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 3472, 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 566720 2024-08-31T04:37:26.561 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1577, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1579, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 404138, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 501493, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 3, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.108642812, 2024-08-31T04:37:26.562 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.042964063, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.024290473, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.035859959, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1577, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.047322511, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000030007 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.563 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.564 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4051, 2024-08-31T04:37:26.565 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.094767604, 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000023393 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.566 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 0, 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 0, 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 0, 2024-08-31T04:37:26.568 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-08-31T04:37:26.569 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 1, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:26.570 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:26.571 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:26.572 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:37:26.573 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 0, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 0 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:26.575 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:26.576 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:37:26.577 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 0, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 8, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-08-31T04:37:26.579 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 2, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 2, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-08-31T04:37:26.580 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 4196655, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 4196514, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.581 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 8 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 3, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 3, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 0, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 1, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 1, 2024-08-31T04:37:26.582 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 0, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 117016, 2024-08-31T04:37:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 316424192 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 0, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 0, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 0, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-08-31T04:37:26.584 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.585 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-08-31T04:37:26.586 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.587 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.588 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:26.589 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.590 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.591 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-08-31T04:37:26.591 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.591 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.592 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.593 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.594 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.595 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:26.596 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.598 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:26.598 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.598 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.598 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.598 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-08-31T04:37:26.599 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.600 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.601 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-08-31T04:37:26.602 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.603 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.604 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 2, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 4, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 2, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 3, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-08-31T04:37:26.605 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 0, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 0, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 2538, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:26.606 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:26.607 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:26.608 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:26.609 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:26.610 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 182318, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 46, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-08-31T04:37:26.611 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 208, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:26.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 8512, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 13, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 2404, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 21, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 3, 2024-08-31T04:37:26.614 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 2404, 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2404, 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.372973047, 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000571120 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-08-31T04:37:26.615 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2404, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2405 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 2404, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 2404, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 0, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-08-31T04:37:26.616 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 1567, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 835, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-08-31T04:37:26.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 1, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:26.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-08-31T04:37:26.619 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-08-31T04:37:26.620 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-08-31T04:37:26.621 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 97, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 14, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 4, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 4, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 0, 2024-08-31T04:37:26.622 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 2, 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 0 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 0, 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-08-31T04:37:26.623 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 0, 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:26.624 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 2684, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 1629683, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:26.625 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 2684, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2684, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 1629683, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.626 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:26.627 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 2404, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 2356, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2404, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 2356, 2024-08-31T04:37:26.628 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:26.629 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 2404, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 2404, 2024-08-31T04:37:26.630 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2404, 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 2404, 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:26.632 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:26.632 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:26.632 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:26.632 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:26.632 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:26.633 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x556c4aec69c0": { 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-08-31T04:37:26.634 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-08-31T04:37:26.635 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-08-31T04:37:26.636 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-08-31T04:37:27.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:26 smithi064 ceph-mon[22007]: pgmap v711: 129 pgs: 129 active+clean; 589 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.5 MiB/s wr, 60 op/s 2024-08-31T04:37:27.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:26 smithi132 ceph-mon[22335]: pgmap v711: 129 pgs: 129 active+clean; 589 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.5 MiB/s wr, 60 op/s 2024-08-31T04:37:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:26 smithi002 ceph-mon[18656]: pgmap v711: 129 pgs: 129 active+clean; 589 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.5 MiB/s wr, 60 op/s 2024-08-31T04:37:27.340 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-31T04:37:27.340 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-31T04:37:27.341 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-08-31T04:37:27.341 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-08-31T04:37:27.341 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T04:37:27.341 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T04:37:27.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T04:37:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:37:28.164 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-08-31T04:37:28.164 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:28.164 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 968, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 970, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 8637543, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 307888, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 6, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.086814410, 2024-08-31T04:37:28.165 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.032579708, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.025194834, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.022523412, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 968, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.034506561, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000035647 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.166 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:28.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 891, 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 1072, 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 12512557, 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 676561, 2024-08-31T04:37:28.168 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 5, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.088675110, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.040831422, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.022935995, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.018459867, 2024-08-31T04:37:28.169 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1070, 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.033361169, 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000031178 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:28.170 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 393536 2024-08-31T04:37:28.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 1387, 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 1370, 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 5747656, 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 503988, 2024-08-31T04:37:28.172 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 3, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.167005426, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.068535716, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.068461974, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.033177409, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1370, 2024-08-31T04:37:28.173 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.058987774, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000043056 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1204384, 2024-08-31T04:37:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 151008 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 1, 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-MDSRank": { 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-08-31T04:37:28.175 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 5142, 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.113437889, 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000022061 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-08-31T04:37:28.176 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": { 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "request": 0, 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "reply": 0, 2024-08-31T04:37:28.177 INFO:teuthology.orchestra.run.smithi132.stdout: "reply_latency": { 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_reply": 0, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "forward": 0, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:28.178 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_commit": 0, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_split": 0, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_merge": 0, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes": 2363, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_top": 1, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_bottom": 2362, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pin_tail": 0, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pinned": 2362, 2024-08-31T04:37:28.179 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_expired": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_with_caps": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "subtrees": 3, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_hit": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_forward": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_discover": 0, 2024-08-31T04:37:28.180 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_lock": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "load_cent": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "q": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "exported": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "exported_inodes": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "imported": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "imported_inodes": 0, 2024-08-31T04:37:28.181 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rfiles": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rbytes": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rsnaps": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:37:28.182 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_file_inodes": 0, 2024-08-31T04:37:28.183 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:37:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_cap_release": 0, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "process_request_cap_release": 0 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_cache": { 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update": 0, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update_receipt": 0, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_try_discover": 0, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_send_discover": 0, 2024-08-31T04:37:28.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_handle_discover": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_created": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_enqueued": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_migrated": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:28.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_started": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_completed": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_exportdir": 0, 2024-08-31T04:37:28.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_flush": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_started": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_write_failed": 0 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_log": { 2024-08-31T04:37:28.188 INFO:teuthology.orchestra.run.smithi132.stdout: "evlrg": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "evadd": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "evex": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "evtrm": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "ev": 13722, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "evexg": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "evexd": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "segadd": 0, 2024-08-31T04:37:28.189 INFO:teuthology.orchestra.run.smithi132.stdout: "segex": 0, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "segtrm": 0, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "seg": 18, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "segmjr": 3, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "segexg": 0, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "segexd": 0, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "expos": 4194304, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "wrpos": 29064743, 2024-08-31T04:37:28.190 INFO:teuthology.orchestra.run.smithi132.stdout: "rdpos": 29057925, 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "jlat": { 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "replayed": 13722 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_mem": { 2024-08-31T04:37:28.191 INFO:teuthology.orchestra.run.smithi132.stdout: "ino": 77, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ino+": 2361, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ino-": 2284, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "dir": 22, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "dir+": 22, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "dir-": 0, 2024-08-31T04:37:28.192 INFO:teuthology.orchestra.run.smithi132.stdout: "dn": 2363, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "dn+": 2363, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "dn-": 0, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "cap": 0, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "cap+": 0, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "cap-": 0, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "rss": 120936, 2024-08-31T04:37:28.193 INFO:teuthology.orchestra.run.smithi132.stdout: "heap": 319565824 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_server": { 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_client_request": 0, 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_server_request": 0, 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_request": 0, 2024-08-31T04:37:28.194 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_session": 0, 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_peer_request": 0, 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "req_create_latency": { 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.195 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getattr_latency": { 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:28.196 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "req_link_latency": { 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.197 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookup_latency": { 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupino_latency": { 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.199 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupname_latency": { 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.202 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lssnap_latency": { 2024-08-31T04:37:28.203 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.203 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.204 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.204 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mkdir_latency": { 2024-08-31T04:37:28.204 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.204 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mknod_latency": { 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mksnap_latency": { 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.206 INFO:teuthology.orchestra.run.smithi132.stdout: "req_open_latency": { 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: "req_readdir_latency": { 2024-08-31T04:37:28.207 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rename_latency": { 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.208 INFO:teuthology.orchestra.run.smithi132.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.209 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmdir_latency": { 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:28.210 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.211 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setattr_latency": { 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.212 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setlayout_latency": { 2024-08-31T04:37:28.213 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setxattr_latency": { 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "req_symlink_latency": { 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "req_unlink_latency": { 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.215 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.216 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_sessions": { 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "session_count": 1, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "session_add": 2, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "session_remove": 1, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_open": 1, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_stale": 0, 2024-08-31T04:37:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: "total_load": 0, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "average_load": 0, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "avg_session_uptime": 1934, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:28.218 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:28.220 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:28.221 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:28.222 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 201365, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 121, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 208, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:28.224 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 1860216, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 14341, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:28.225 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "objecter": { 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_active": 0, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_laggy": 0, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send": 2968, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send_bytes": 21, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_resend": 3, 2024-08-31T04:37:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "op_reply": 2968, 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "op_latency": { 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2968, 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.575958403, 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000530983 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "op_inflight": 0, 2024-08-31T04:37:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "oplen_avg": { 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2968, 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 2969 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "op": 2968, 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "op_r": 2968, 2024-08-31T04:37:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "op_w": 0, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "op_rmw": 0, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "op_pg": 0, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_stat": 1569, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_create": 0, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_read": 1397, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_write": 0, 2024-08-31T04:37:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writefull": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writesame": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_append": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_zero": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_truncate": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_delete": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_mapext": 0, 2024-08-31T04:37:28.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_getxattr": 1, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_setxattr": 0, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:28.231 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_call": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_watch": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_notify": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:28.232 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_other": 0, 2024-08-31T04:37:28.233 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_active": 0, 2024-08-31T04:37:28.233 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_send": 0, 2024-08-31T04:37:28.233 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_resend": 0, 2024-08-31T04:37:28.233 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_ping": 0, 2024-08-31T04:37:28.233 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_active": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_send": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_resend": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_active": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_send": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_resend": 0, 2024-08-31T04:37:28.234 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_active": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_send": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_resend": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "command_active": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "command_send": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "command_resend": 0, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "map_epoch": 97, 2024-08-31T04:37:28.235 INFO:teuthology.orchestra.run.smithi132.stdout: "map_full": 0, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "map_inc": 14, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_sessions": 6, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_open": 6, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_close": 0, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_laggy": 0, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_wr": 0, 2024-08-31T04:37:28.236 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_rd": 2, 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_del": 0 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "oft": { 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_objs": 0, 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_updates": 0, 2024-08-31T04:37:28.237 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_removes": 0 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "purge_queue": { 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing": 0, 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_high_water": 0, 2024-08-31T04:37:28.238 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed_ops": 0, 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed": 0, 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 3242, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 26589030, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 3242, 2024-08-31T04:37:28.240 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:28.241 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:28.241 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 3242, 2024-08-31T04:37:28.241 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 26589030, 2024-08-31T04:37:28.241 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:28.241 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:28.242 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2968, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 24874504, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2968, 2024-08-31T04:37:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 24874504, 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 1024, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:28.245 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2968, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 2968, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2968, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 2968, 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:28.246 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:28.247 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:28.248 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 0, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 0, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle-0x562b37486750": { 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:28.250 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:28.251 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout: "trackedop": { 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_ops_count": 0 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:28.252 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-08-31T04:37:28.989 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-31T04:37:28.990 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-31T04:37:28.990 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-08-31T04:37:28.990 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-31T04:37:28.990 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T04:37:28.990 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T04:37:28.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T04:37:29.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:28 smithi132 ceph-mon[22335]: pgmap v712: 129 pgs: 129 active+clean; 585 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-31T04:37:29.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:28 smithi064 ceph-mon[22007]: pgmap v712: 129 pgs: 129 active+clean; 585 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-31T04:37:29.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:28 smithi002 ceph-mon[18656]: pgmap v712: 129 pgs: 129 active+clean; 585 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-31T04:37:29.238 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:37:29.785 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 0, 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 2, 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 0, 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 0, 2024-08-31T04:37:29.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.001216364, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.000264516, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:29.787 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:29.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:29.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:29.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:29.788 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:29.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 251, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 242, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1143424, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 148352, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.044219539, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.017740677, 2024-08-31T04:37:29.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.039437741, 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 242, 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.017961722, 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000074221 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:29.791 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1143424, 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 148352 2024-08-31T04:37:29.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 1, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 183, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 160, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 112144, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 3, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:29.793 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.012780564, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.010135556, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.000900544, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 181, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.009458536, 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000052257 2024-08-31T04:37:29.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 112144 2024-08-31T04:37:29.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 0, 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:29.796 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:29.797 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:29.798 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:29.799 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:29.800 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:29.800 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:29.800 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:29.800 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:29.801 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 149007, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 30, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-08-31T04:37:29.802 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:29.803 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 2, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-08-31T04:37:29.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 248, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 1105506, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:29.805 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 248, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 248, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 1105506, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:29.806 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:29.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:29.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:29.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:29.807 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-08-31T04:37:30.546 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-08-31T04:37:30.547 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-08-31T04:37:30.547 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-08-31T04:37:30.547 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-08-31T04:37:30.547 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-08-31T04:37:30.547 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T04:37:30.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T04:37:30.790 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:30 smithi132 ceph-mon[22335]: pgmap v713: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-08-31T04:37:30.836 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:37:31.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:30 smithi064 ceph-mon[22007]: pgmap v713: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-08-31T04:37:31.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:30 smithi002 ceph-mon[18656]: pgmap v713: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-08-31T04:37:31.397 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 27627, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 38267, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 9648722, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 22180140, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 13, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 4, 2024-08-31T04:37:31.398 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 2.651495639, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 1.364733773, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 1.543827946, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.082129770, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 38266, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.921449922, 2024-08-31T04:37:31.399 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000024080 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 56933, 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.009056426, 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000159 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 8689280, 2024-08-31T04:37:31.400 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 16791072 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 4930, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 4917, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 2399969, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 14389357, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 11, 2024-08-31T04:37:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 6, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.451185583, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.204241912, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.117601200, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.119375832, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 4916, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.198627030, 2024-08-31T04:37:31.402 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000040404 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 4, 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000529, 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000132 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1215088, 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 166880 2024-08-31T04:37:31.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 215802, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 117277, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 115650899, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 29753723, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 37, 2024-08-31T04:37:31.404 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 5, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 10.468263177, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 4.794434555, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 7.619709809, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.089093329, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 117275, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.751181120, 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000014932 2024-08-31T04:37:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 326688, 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.042182652, 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000129 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 397296 2024-08-31T04:37:31.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 1, 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-MDSRank": { 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-08-31T04:37:31.407 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 8020, 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 3.571450160, 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000445317 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-PurgeQueue": { 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-08-31T04:37:31.408 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 5144, 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.284408707, 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000055289 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": { 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: "request": 18882, 2024-08-31T04:37:31.409 INFO:teuthology.orchestra.run.smithi132.stdout: "reply": 9231, 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "reply_latency": { 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 9231, 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 12.508350804, 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001355037 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_reply": 0, 2024-08-31T04:37:31.410 INFO:teuthology.orchestra.run.smithi132.stdout: "forward": 9651, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_complete": 0, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_keys": 0, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_commit": 11, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_split": 0, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_merge": 0, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes": 83, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_top": 2, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_bottom": 81, 2024-08-31T04:37:31.411 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pin_tail": 0, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pinned": 78, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_expired": 0, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_with_caps": 11, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": 11, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "subtrees": 3, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse": 29266, 2024-08-31T04:37:31.412 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_hit": 7324, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_forward": 9649, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_discover": 6, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_remote_ino": 0, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_lock": 0, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "load_cent": 0, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "q": 0, 2024-08-31T04:37:31.413 INFO:teuthology.orchestra.run.smithi132.stdout: "exported": 0, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "exported_inodes": 0, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "imported": 1, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "imported_inodes": 6, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_dir_fetch": 0, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_backtrace_fetch": 45, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_peer_discover": 0, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rfiles": 74, 2024-08-31T04:37:31.414 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rbytes": 21222240, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rsnaps": 6, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_fetch": 45, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_set_tag": 0, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:37:31.415 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_file_inodes": 45, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_revoke": 112, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_grant": 8646, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:37:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps": 4092, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps_dirty": 2697, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_cap_release": 1383, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "process_request_cap_release": 9583 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_cache": { 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update": 0, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update_receipt": 9, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_try_discover": 6, 2024-08-31T04:37:31.417 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_send_discover": 10, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_handle_discover": 0, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays": 8, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_delayed": 0, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_created": 2312, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_enqueued": 2304, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_reintegrated": 0, 2024-08-31T04:37:31.418 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_migrated": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_processing": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_started": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_completed": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:37:31.419 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_exportdir": 2, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_flush": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragstats": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_inodestats": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_started": 0, 2024-08-31T04:37:31.420 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_succeeded": 0, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "uninline_write_failed": 0 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_log": { 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "evlrg": 0, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "evadd": 13759, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "evex": 0, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "evtrm": 0, 2024-08-31T04:37:31.421 INFO:teuthology.orchestra.run.smithi132.stdout: "ev": 13759, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "evexg": 0, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "evexd": 0, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "segadd": 18, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "segex": 0, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "segtrm": 0, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "seg": 18, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "segmjr": 3, 2024-08-31T04:37:31.422 INFO:teuthology.orchestra.run.smithi132.stdout: "segexg": 0, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "segexd": 0, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "expos": 4194304, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "wrpos": 29153483, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "rdpos": 0, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "jlat": { 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 3750, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 8.434523953, 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.002249206 2024-08-31T04:37:31.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "replayed": 0 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_mem": { 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "ino": 68, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "ino+": 2364, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "ino-": 2296, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "dir": 39, 2024-08-31T04:37:31.424 INFO:teuthology.orchestra.run.smithi132.stdout: "dir+": 42, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "dir-": 3, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "dn": 71, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "dn+": 2367, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "dn-": 2296, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "cap": 3, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "cap+": 2318, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "cap-": 2315, 2024-08-31T04:37:31.425 INFO:teuthology.orchestra.run.smithi132.stdout: "rss": 126596, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "heap": 333266944 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_server": { 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_client_request": 27557, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_server_request": 0, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_request": 18882, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_session": 14, 2024-08-31T04:37:31.426 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_peer_request": 2649, 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "req_create_latency": { 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2312, 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 4.465391360, 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001931397 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getattr_latency": { 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 3, 2024-08-31T04:37:31.427 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.003465839, 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001155279 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getfilelock_latency": { 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.428 INFO:teuthology.orchestra.run.smithi132.stdout: "req_link_latency": { 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookup_latency": { 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1958, 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.415814668, 2024-08-31T04:37:31.429 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000212367 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookuphash_latency": { 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupino_latency": { 2024-08-31T04:37:31.430 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1, 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000316505, 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000316505 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupname_latency": { 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupparent_latency": { 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupsnap_latency": { 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.432 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lssnap_latency": { 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mkdir_latency": { 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mknod_latency": { 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mksnap_latency": { 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "req_open_latency": { 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "req_readdir_latency": { 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2645, 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.982196524, 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000371340 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rename_latency": { 2024-08-31T04:37:31.436 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "req_renamesnap_latency": { 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.437 INFO:teuthology.orchestra.run.smithi132.stdout: "req_snapdiff_latency": { 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmdir_latency": { 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmsnap_latency": { 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmxattr_latency": { 2024-08-31T04:37:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setattr_latency": { 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setdirlayout_latency": { 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setfilelock_latency": { 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setlayout_latency": { 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setxattr_latency": { 2024-08-31T04:37:31.442 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "req_symlink_latency": { 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.444 INFO:teuthology.orchestra.run.smithi132.stdout: "req_unlink_latency": { 2024-08-31T04:37:31.444 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2312, 2024-08-31T04:37:31.444 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 6.641165908, 2024-08-31T04:37:31.444 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.002872476 2024-08-31T04:37:31.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getvxattr_latency": { 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.445 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_sessions": { 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "session_count": 1, 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "session_add": 2, 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "session_remove": 1, 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_open": 1, 2024-08-31T04:37:31.446 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_stale": 0, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "total_load": 1158, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "average_load": 1158, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "avg_session_uptime": 721, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "mdthresh_evicted": 0 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:31.447 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:31.448 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:31.450 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:31.451 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 511377, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 230, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 528, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 6, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:31.452 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 10224, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 208, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:31.453 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 370149, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 6698, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.454 INFO:teuthology.orchestra.run.smithi132.stdout: "objecter": { 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_active": 0, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_laggy": 0, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send": 10280, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send_bytes": 25502896, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_resend": 28, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_reply": 10280, 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "op_latency": { 2024-08-31T04:37:31.455 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 10280, 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 34.590087214, 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.003364794 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "op_inflight": 0, 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "oplen_avg": { 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 10280, 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 11129 2024-08-31T04:37:31.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "op": 10280, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "op_r": 529, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "op_w": 9751, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "op_rmw": 0, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "op_pg": 0, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_stat": 0, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_create": 10, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_read": 484, 2024-08-31T04:37:31.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_write": 4234, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writefull": 295, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writesame": 0, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_append": 0, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_zero": 0, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_truncate": 0, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_delete": 4625, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_mapext": 0, 2024-08-31T04:37:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_sparse_read": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_clonerange": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_getxattr": 45, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_setxattr": 20, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_rmxattr": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_call": 0, 2024-08-31T04:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_watch": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_notify": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_other": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_active": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_send": 0, 2024-08-31T04:37:31.460 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_resend": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_ping": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_active": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_send": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_resend": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_active": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_send": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_resend": 0, 2024-08-31T04:37:31.461 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_active": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_send": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_resend": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "command_active": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "command_send": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "command_resend": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "map_epoch": 97, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "map_full": 0, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "map_inc": 14, 2024-08-31T04:37:31.462 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_sessions": 12, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_open": 12, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_close": 0, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_laggy": 0, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_wr": 1144, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_rd": 0, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_del": 272 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.463 INFO:teuthology.orchestra.run.smithi132.stdout: "oft": { 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_objs": 1, 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_updates": 0, 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_removes": 0 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "purge_queue": { 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops": 0, 2024-08-31T04:37:31.464 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops_high_water": 16, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing": 0, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_high_water": 8, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed_ops": 4608, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed": 2304, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_item_in_journal": 0 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:31.465 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 248355, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 104233257, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 248355, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 248355, 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 104233257, 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_bytes": { 2024-08-31T04:37:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 10280, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 25754208, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 10280, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 25754208, 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_ops": { 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 1024, 2024-08-31T04:37:31.470 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 10280, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 10280, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 10280, 2024-08-31T04:37:31.471 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 10280, 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:37:31.472 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 2304, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 251312, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 2304, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 484, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 251312, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.474 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle-0x56424de5c750": { 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 42885, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 13759, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 24959179, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 13759, 2024-08-31T04:37:31.475 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 3750, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 24916294, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:31.476 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:31.477 INFO:teuthology.orchestra.run.smithi132.stdout: "trackedop": { 2024-08-31T04:37:31.477 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_ops_count": 0 2024-08-31T04:37:31.477 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:31.477 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-08-31T04:37:32.208 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-08-31T04:37:32.208 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-08-31T04:37:32.209 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-08-31T04:37:32.209 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-08-31T04:37:32.209 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T04:37:32.209 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T04:37:32.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T04:37:32.454 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:37:32.892 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:32 smithi132 ceph-mon[22335]: pgmap v714: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-08-31T04:37:33.012 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-08-31T04:37:33.012 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:37:33.012 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 253, 2024-08-31T04:37:33.012 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 246, 2024-08-31T04:37:33.012 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1142688, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 151440, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 0, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.046426098, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.018471074, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.040087816, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:33.013 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 245, 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.011997053, 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000048967 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:33.014 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1142688, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 151440 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 2, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 188, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 320, 2024-08-31T04:37:33.015 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 193312, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 2, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.013628773, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.010508675, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.001273162, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:33.016 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 186, 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.009122855, 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000049047 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 193312 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 4, 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 4, 2024-08-31T04:37:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 2992, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 448, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 2, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 1, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.002152538, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.000035117, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.002096764, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:37:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 3, 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.003897725, 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001299241 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 0, 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-08-31T04:37:33.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:37:33.022 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:37:33.023 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:37:33.024 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-08-31T04:37:33.025 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 148704, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 29, 2024-08-31T04:37:33.026 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-08-31T04:37:33.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 928, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 2, 2024-08-31T04:37:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-08-31T04:37:33.029 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-08-31T04:37:33.030 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 255, 2024-08-31T04:37:33.030 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 1106950, 2024-08-31T04:37:33.030 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-08-31T04:37:33.030 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 255, 2024-08-31T04:37:33.030 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 255, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 1106950, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-08-31T04:37:33.033 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-08-31T04:37:33.034 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:33.034 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-08-31T04:37:33.034 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-08-31T04:37:33.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:32 smithi064 ceph-mon[22007]: pgmap v714: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-08-31T04:37:33.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:32 smithi002 ceph-mon[18656]: pgmap v714: 129 pgs: 129 active+clean; 586 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-08-31T04:37:33.803 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-31T04:37:33.803 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-31T04:37:33.803 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-08-31T04:37:33.803 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-08-31T04:37:33.803 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-08-31T04:37:33.804 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-31T04:37:33.814 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T04:37:33.815 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:37:33.815 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:37:33.837 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-31T04:37:33.837 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:37:33.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T04:37:34.256 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- 172.21.15.2:0/3229937253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4108160 msgr2=0x7f6cc4108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 --2- 172.21.15.2:0/3229937253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4108160 0x7f6cc4108570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009900 tx=0x7f6cb802a410 comp rx=0 tx=0).stop 2024-08-31T04:37:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- 172.21.15.2:0/3229937253 shutdown_connections 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 --2- 172.21.15.2:0/3229937253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4108160 0x7f6cc4108570 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 --2- 172.21.15.2:0/3229937253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 0x7f6cc410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 --2- 172.21.15.2:0/3229937253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4102820 0x7f6cc4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- 172.21.15.2:0/3229937253 >> 172.21.15.2:0/3229937253 conn(0x7f6cc40794e0 msgr2=0x7f6cc40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- 172.21.15.2:0/3229937253 shutdown_connections 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- 172.21.15.2:0/3229937253 wait complete. 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 Processor -- start 2024-08-31T04:37:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.704+0000 7f6ccae18640 1 -- start start 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4108160 0x7f6cc419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 0x7f6cc419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112760 con 0x7f6cc4102820 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41125e0 con 0x7f6cc4108ab0 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6ccae18640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41128e0 con 0x7f6cc4108160 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46648/0 (socket says 172.21.15.2:46648) 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 -- 172.21.15.2:0/931080834 learned_addr learned my addr 172.21.15.2:0/931080834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc93b5640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 0x7f6cc419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc3fff640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4108160 0x7f6cc419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 -- 172.21.15.2:0/931080834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4108160 msgr2=0x7f6cc419b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4108160 0x7f6cc419b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 -- 172.21.15.2:0/931080834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 msgr2=0x7f6cc419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 0x7f6cc419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.705+0000 7f6cc8bb4640 1 -- 172.21.15.2:0/931080834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41a6320 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6cc8bb4640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b4a0 tx=0x7f6cb400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4014070 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb4010ac0 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41a6610 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4017c30 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.706+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a6bf0 con 0x7f6cc4102820 2024-08-31T04:37:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.707+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc4103aa0 con 0x7f6cc4102820 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.708+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6cb4017070 con 0x7f6cc4102820 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.709+0000 7f6cc1ffb640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 0x7f6cac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.709+0000 7f6cc3fff640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 0x7f6cac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.709+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9664+0+0 (secure 0 0 0) 0x7f6cb40e4eb0 con 0x7f6cc4102820 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.710+0000 7f6cc3fff640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 0x7f6cac0b7230 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.714+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6cb40ab1a0 con 0x7f6cc4102820 2024-08-31T04:37:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.912+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6cc406bd10 con 0x7f6cc4102820 2024-08-31T04:37:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.912+0000 7f6cc1ffb640 1 -- 172.21.15.2:0/931080834 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v97) ==== 81+0+867 (secure 0 0 0) 0x7f6cc406bd10 con 0x7f6cc4102820 2024-08-31T04:37:34.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3769218802 2024-09-01T04:16:32.968503+0000 2024-08-31T04:37:34.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:37:34.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/676946348 2024-09-01T04:16:32.968503+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3520570143 2024-09-01T04:15:31.947876+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/383819124 2024-09-01T04:15:07.436437+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2196385741 2024-09-01T04:15:07.436437+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1227945442 2024-09-01T04:15:07.436437+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/737748268 2024-09-01T04:15:07.436437+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:37:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3454213639 2024-09-01T04:15:31.947876+0000 2024-08-31T04:37:34.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2617567314 2024-09-01T04:15:31.947876+0000 2024-08-31T04:37:34.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/967619453 2024-09-01T04:15:31.947876+0000 2024-08-31T04:37:34.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3950990944 2024-09-01T04:16:32.968503+0000 2024-08-31T04:37:34.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2564901012 2024-09-01T04:16:32.968503+0000 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:listed 15 entries 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 msgr2=0x7f6cac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 0x7f6cac0b7230 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8031400 comp rx=0 tx=0).stop 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 msgr2=0x7f6cc419b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b4a0 tx=0x7f6cb400b960 comp rx=0 tx=0).stop 2024-08-31T04:37:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 shutdown_connections 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cc4108ab0 0x7f6cc419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cc4108160 0x7f6cc419b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f6cac0b4d20 0x7f6cac0b7230 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 --2- 172.21.15.2:0/931080834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc4102820 0x7f6cc419b0f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 >> 172.21.15.2:0/931080834 conn(0x7f6cc40794e0 msgr2=0x7f6cc41050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 shutdown_connections 2024-08-31T04:37:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:34.915+0000 7f6ccae18640 1 -- 172.21.15.2:0/931080834 wait complete. 2024-08-31T04:37:35.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:34 smithi064 ceph-mon[22007]: pgmap v715: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 1.6 MiB/s wr, 62 op/s 2024-08-31T04:37:35.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:34 smithi132 ceph-mon[22335]: pgmap v715: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 1.6 MiB/s wr, 62 op/s 2024-08-31T04:37:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:34 smithi002 ceph-mon[18656]: pgmap v715: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 1.6 MiB/s wr, 62 op/s 2024-08-31T04:37:35.765 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-31T04:37:35.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:37:35.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-31T04:37:35.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:37:35.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:37:35.871 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T04:37:35.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:37:35.913 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-31T04:37:35.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T04:37:35.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:37:35.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:37:36.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:35 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/931080834' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:37:36.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:37:36.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-31T04:37:36.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:35 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/931080834' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:37:36.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:35 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/931080834' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:37:36.131 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T04:37:36.141 INFO:tasks.cephadm:Teardown begin 2024-08-31T04:37:36.142 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T04:37:36.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:37:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:36.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 -- 172.21.15.2:0/980772062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 msgr2=0x7f01001100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 --2- 172.21.15.2:0/980772062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f01001100c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009ca0 tx=0x7f00f802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 -- 172.21.15.2:0/980772062 shutdown_connections 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 --2- 172.21.15.2:0/980772062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f01001100c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 --2- 172.21.15.2:0/980772062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100105070 0x7f010010d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 --2- 172.21.15.2:0/980772062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100104640 0x7f0100104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 -- 172.21.15.2:0/980772062 >> 172.21.15.2:0/980772062 conn(0x7f01000794e0 msgr2=0x7f01000798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 -- 172.21.15.2:0/980772062 shutdown_connections 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.877+0000 7f0106829640 1 -- 172.21.15.2:0/980772062 wait complete. 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 Processor -- start 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 -- start start 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100104640 0x7f0100102550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100105070 0x7f0100102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:36.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0100113810 con 0x7f010010dbf0 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0100113690 con 0x7f0100105070 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0106829640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0100113990 con 0x7f0100104640 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0104dc6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0104dc6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34608/0 (socket says 172.21.15.2:34608) 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.878+0000 7f0104dc6640 1 -- 172.21.15.2:0/850803954 learned_addr learned my addr 172.21.15.2:0/850803954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f00fffff640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100104640 0x7f0100102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f00f7fff640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100105070 0x7f0100102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:36.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 -- 172.21.15.2:0/850803954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100104640 msgr2=0x7f0100102550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100104640 0x7f0100102550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 -- 172.21.15.2:0/850803954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100105070 msgr2=0x7f0100102a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100105070 0x7f0100102a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 -- 172.21.15.2:0/850803954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01001a83b0 con 0x7f010010dbf0 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0104dc6640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098d0 tx=0x7f00f80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003b70 con 0x7f010010dbf0 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00f8003d10 con 0x7f010010dbf0 2024-08-31T04:37:36.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01001a8640 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f802fa20 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.879+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01001a8b80 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.880+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010006bf40 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.882+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f00f802fbe0 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.883+0000 7f00fdffb640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 0x7f00ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.883+0000 7f00fffff640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 0x7f00ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.883+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9664+0+0 (secure 0 0 0) 0x7f00f8106ea0 con 0x7f010010dbf0 2024-08-31T04:37:36.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.883+0000 7f00fffff640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 0x7f00ec0b71b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0100103fa0 tx=0x7f00f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:36.886+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00f80cd7e0 con 0x7f010010dbf0 2024-08-31T04:37:37.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:36 smithi064 ceph-mon[22007]: pgmap v716: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-08-31T04:37:37.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:36 smithi132 ceph-mon[22335]: pgmap v716: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-08-31T04:37:37.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.111+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0100104a50 con 0x7f010010dbf0 2024-08-31T04:37:37.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:36 smithi002 ceph-mon[18656]: pgmap v716: 129 pgs: 129 active+clean; 587 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-08-31T04:37:37.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.111+0000 7f00fdffb640 1 -- 172.21.15.2:0/850803954 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11897 (secure 0 0 0) 0x7f00f80cd0e0 con 0x7f010010dbf0 2024-08-31T04:37:37.113 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:37.114 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-08-31T04:36:19:632791+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:36:18.731960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:37:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-08-31T04:37:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 msgr2=0x7f00ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 0x7f00ec0b71b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0100103fa0 tx=0x7f00f0005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 msgr2=0x7f0100102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098d0 tx=0x7f00f80317b0 comp rx=0 tx=0).stop 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 shutdown_connections 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f00ec0b4ca0 0x7f00ec0b71b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010010dbf0 0x7f0100102fd0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0100105070 0x7f0100102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 --2- 172.21.15.2:0/850803954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0100104640 0x7f0100102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 >> 172.21.15.2:0/850803954 conn(0x7f01000794e0 msgr2=0x7f01001005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 shutdown_connections 2024-08-31T04:37:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:37.114+0000 7f0106829640 1 -- 172.21.15.2:0/850803954 wait complete. 2024-08-31T04:37:37.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:37:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:38.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:37 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/850803954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:38.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:37 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/850803954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:38.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:37 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/850803954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 -- 172.21.15.2:0/2731956495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109b90 msgr2=0x7f64381103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 --2- 172.21.15.2:0/2731956495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109b90 0x7f64381103c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6430009ca0 tx=0x7f643002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 -- 172.21.15.2:0/2731956495 shutdown_connections 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 --2- 172.21.15.2:0/2731956495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109b90 0x7f64381103c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 --2- 172.21.15.2:0/2731956495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438109240 0x7f6438109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 --2- 172.21.15.2:0/2731956495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438103900 0x7f6438103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 -- 172.21.15.2:0/2731956495 >> 172.21.15.2:0/2731956495 conn(0x7f643807b5f0 msgr2=0x7f643807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 -- 172.21.15.2:0/2731956495 shutdown_connections 2024-08-31T04:37:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.551+0000 7f64406b5640 1 -- 172.21.15.2:0/2731956495 wait complete. 2024-08-31T04:37:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.552+0000 7f64406b5640 1 Processor -- start 2024-08-31T04:37:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.552+0000 7f64406b5640 1 -- start start 2024-08-31T04:37:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.552+0000 7f64406b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438103900 0x7f643819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f64406b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f64406b5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 0x7f643819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f64406b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6438113850 con 0x7f6438109240 2024-08-31T04:37:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f64406b5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64381136d0 con 0x7f6438109b90 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f64406b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f64381139d0 con 0x7f6438103900 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34626/0 (socket says 172.21.15.2:34626) 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 -- 172.21.15.2:0/104827644 learned_addr learned my addr 172.21.15.2:0/104827644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643e451640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438103900 0x7f643819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643ec52640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 0x7f643819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 -- 172.21.15.2:0/104827644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438103900 msgr2=0x7f643819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438103900 0x7f643819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 -- 172.21.15.2:0/104827644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 msgr2=0x7f643819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 0x7f643819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 -- 172.21.15.2:0/104827644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64381a0170 con 0x7f6438109240 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643ec52640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 0x7f643819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.553+0000 7f643dc50640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f642800d750 tx=0x7f642800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.554+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428017070 con 0x7f6438109240 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.554+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64280054d0 con 0x7f6438109240 2024-08-31T04:37:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.554+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64381a0460 con 0x7f6438109240 2024-08-31T04:37:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.554+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428004c30 con 0x7f6438109240 2024-08-31T04:37:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.554+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381a6bc0 con 0x7f6438109240 2024-08-31T04:37:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.555+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6438103d10 con 0x7f6438109240 2024-08-31T04:37:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.556+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6428004dd0 con 0x7f6438109240 2024-08-31T04:37:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.557+0000 7f642f7fe640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 0x7f64240b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.557+0000 7f643e451640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 0x7f64240b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.557+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9664+0+0 (secure 0 0 0) 0x7f64280e5710 con 0x7f6438109240 2024-08-31T04:37:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.557+0000 7f643e451640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 0x7f64240b7230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f643400bbe0 tx=0x7f643400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.560+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f64280ac110 con 0x7f6438109240 2024-08-31T04:37:38.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.782+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643810b9e0 con 0x7f6438109240 2024-08-31T04:37:38.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.783+0000 7f642f7fe640 1 -- 172.21.15.2:0/104827644 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11897 (secure 0 0 0) 0x7f64280aba10 con 0x7f6438109240 2024-08-31T04:37:38.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:38.785 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-08-31T04:36:19:632791+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14757,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3395319824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3395319824},{"type":"v1","addr":"172.21.15.2:6835","nonce":3395319824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1100615699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":1100615699},{"type":"v1","addr":"172.21.15.2:6837","nonce":1100615699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1028238905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1028238905},{"type":"v1","addr":"172.21.15.2:6839","nonce":1028238905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3442554545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3442554545},{"type":"v1","addr":"172.21.15.2:6841","nonce":3442554545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/4201237499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4201237499},{"type":"v1","addr":"172.21.15.132:6833","nonce":4201237499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24616,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/355644328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":355644328},{"type":"v1","addr":"172.21.15.132:6835","nonce":355644328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:22:57.945132+0000","modified":"2024-08-31T04:36:18.731960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6837/209815036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":209815036},{"type":"v1","addr":"172.21.15.132:6837","nonce":209815036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/3514773724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3514773724},{"type":"v1","addr":"172.21.15.64:6833","nonce":3514773724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/3881208235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3881208235},{"type":"v1","addr":"172.21.15.64:6835","nonce":3881208235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.132:6839/1468403629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":1468403629},{"type":"v1","addr":"172.21.15.132:6839","nonce":1468403629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.64:6837/2463382536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2463382536},{"type":"v1","addr":"172.21.15.64:6837","nonce":2463382536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6839/574572481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":574572481},{"type":"v1","addr":"172.21.15.64:6839","nonce":574572481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24646]},"id":1}]} 2024-08-31T04:37:38.786 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-08-31T04:37:38.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 msgr2=0x7f64240b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:38.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 0x7f64240b7230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f643400bbe0 tx=0x7f643400b390 comp rx=0 tx=0).stop 2024-08-31T04:37:38.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 msgr2=0x7f643819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:38.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f642800d750 tx=0x7f642800dc10 comp rx=0 tx=0).stop 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 shutdown_connections 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f64240b4d20 0x7f64240b7230 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6438109240 0x7f643819a7a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6438109b90 0x7f643819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 --2- 172.21.15.2:0/104827644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6438103900 0x7f643819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.785+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 >> 172.21.15.2:0/104827644 conn(0x7f643807b5f0 msgr2=0x7f6438107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.786+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 shutdown_connections 2024-08-31T04:37:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:38.786+0000 7f64406b5640 1 -- 172.21.15.2:0/104827644 wait complete. 2024-08-31T04:37:39.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:38 smithi064 ceph-mon[22007]: pgmap v717: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-08-31T04:37:39.068 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:38 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/104827644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:39.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:38 smithi132 ceph-mon[22335]: pgmap v717: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-08-31T04:37:39.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:38 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/104827644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:39.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:38 smithi002 ceph-mon[18656]: pgmap v717: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-08-31T04:37:39.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:38 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/104827644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:37:39.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:37:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 -- 172.21.15.2:0/3594695759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54109b90 msgr2=0x7fdb541103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/3594695759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54109b90 0x7fdb541103c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009ca0 tx=0x7fdb4c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 -- 172.21.15.2:0/3594695759 shutdown_connections 2024-08-31T04:37:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/3594695759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54109b90 0x7fdb541103c0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/3594695759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109240 0x7fdb54109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/3594695759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54103900 0x7fdb54103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 -- 172.21.15.2:0/3594695759 >> 172.21.15.2:0/3594695759 conn(0x7fdb5407b5f0 msgr2=0x7fdb5407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 -- 172.21.15.2:0/3594695759 shutdown_connections 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.443+0000 7fdb58ab1640 1 -- 172.21.15.2:0/3594695759 wait complete. 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 Processor -- start 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 -- start start 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54109240 0x7fdb5419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 0x7fdb541a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54113850 con 0x7fdb54103900 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541136d0 con 0x7fdb54109b90 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.444+0000 7fdb58ab1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541139d0 con 0x7fdb54109240 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34656/0 (socket says 172.21.15.2:34656) 2024-08-31T04:37:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 -- 172.21.15.2:0/279817490 learned_addr learned my addr 172.21.15.2:0/279817490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb51d9b640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54109240 0x7fdb5419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb52d9d640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 0x7fdb541a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 -- 172.21.15.2:0/279817490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54109240 msgr2=0x7fdb5419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54109240 0x7fdb5419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 -- 172.21.15.2:0/279817490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 msgr2=0x7fdb541a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 0x7fdb541a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 -- 172.21.15.2:0/279817490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb541a2350 con 0x7fdb54103900 2024-08-31T04:37:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb52d9d640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 0x7fdb541a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb5259c640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c890 tx=0x7fdb4400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44004220 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb541a2640 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb440043c0 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44004a00 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.445+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541a8da0 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.446+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb54103d10 con 0x7fdb54103900 2024-08-31T04:37:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.448+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdb440079b0 con 0x7fdb54103900 2024-08-31T04:37:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.449+0000 7fdb437fe640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 0x7fdb3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.449+0000 7fdb51d9b640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 0x7fdb3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.449+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9664+0+0 (secure 0 0 0) 0x7fdb440e5af0 con 0x7fdb54103900 2024-08-31T04:37:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.449+0000 7fdb51d9b640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 0x7fdb3c0b71b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdb54106cf0 tx=0x7fdb4800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.452+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb44014030 con 0x7fdb54103900 2024-08-31T04:37:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.640+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb5419d510 con 0x7fdb54103900 2024-08-31T04:37:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.642+0000 7fdb437fe640 1 -- 172.21.15.2:0/279817490 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+25529 (secure 0 0 0) 0x7fdb440ac470 con 0x7fdb54103900 2024-08-31T04:37:40.644 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-31T04:37:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"fsid":"4070480a-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:14:46.410110+0000","modified":"2024-08-31T04:37:11.358992+0000","last_up_change":"2024-08-31T04:22:06.880703+0000","last_in_change":"2024-08-31T04:21:42.427968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:18:21.427633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:22:53.823776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:22:55.938232+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:23:02.265074+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"04b1eadc-fc29-4c3a-b5fc-baf84660347b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6803","nonce":1178687126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6805","nonce":1178687126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6809","nonce":1178687126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1178687126},{"type":"v1","addr":"172.21.15.2:6807","nonce":1178687126}]},"public_addr":"172.21.15.2:6803/1178687126","cluster_addr":"172.21.15.2:6805/1178687126","heartbeat_back_addr":"172.21.15.2:6809/1178687126","heartbeat_front_addr":"172.21.15.2:6807/1178687126","state":["exists","up"]},{"osd":1,"uuid":"ddf40256-b4dc-4669-882b-cb08a7b1871c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6801","nonce":4211233345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6803","nonce":4211233345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6807","nonce":4211233345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":4211233345},{"type":"v1","addr":"172.21.15.64:6805","nonce":4211233345}]},"public_addr":"172.21.15.64:6801/4211233345","cluster_addr":"172.21.15.64:6803/4211233345","heartbeat_back_addr":"172.21.15.64:6807/4211233345","heartbeat_front_addr":"172.21.15.64:6805/4211233345","state":["exists","up"]},{"osd":2,"uuid":"c67a3487-d5b9-4171-a372-4746ee7828fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6801","nonce":1699390891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6803","nonce":1699390891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6807","nonce":1699390891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1699390891},{"type":"v1","addr":"172.21.15.132:6805","nonce":1699390891}]},"public_addr":"172.21.15.132:6801/1699390891","cluster_addr":"172.21.15.132:6803/1699390891","heartbeat_back_addr":"172.21.15.132:6807/1699390891","heartbeat_front_addr":"172.21.15.132:6805/1699390891","state":["exists","up"]},{"osd":3,"uuid":"e216ee69-c75f-4ed4-934c-64e65fac20a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6811","nonce":2669191868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6813","nonce":2669191868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6817","nonce":2669191868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2669191868},{"type":"v1","addr":"172.21.15.2:6815","nonce":2669191868}]},"public_addr":"172.21.15.2:6811/2669191868","cluster_addr":"172.21.15.2:6813/2669191868","heartbeat_back_addr":"172.21.15.2:6817/2669191868","heartbeat_front_addr":"172.21.15.2:6815/2669191868","state":["exists","up"]},{"osd":4,"uuid":"a5585cc1-f8f8-4c13-bffc-893da439f2ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6809","nonce":4269153190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6811","nonce":4269153190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6815","nonce":4269153190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":4269153190},{"type":"v1","addr":"172.21.15.64:6813","nonce":4269153190}]},"public_addr":"172.21.15.64:6809/4269153190","cluster_addr":"172.21.15.64:6811/4269153190","heartbeat_back_addr":"172.21.15.64:6815/4269153190","heartbeat_front_addr":"172.21.15.64:6813/4269153190","state":["exists","up"]},{"osd":5,"uuid":"3c826df0-d572-44f2-950f-9c1d60d195e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6809","nonce":3694952222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6811","nonce":3694952222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6815","nonce":3694952222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3694952222},{"type":"v1","addr":"172.21.15.132:6813","nonce":3694952222}]},"public_addr":"172.21.15.132:6809/3694952222","cluster_addr":"172.21.15.132:6811/3694952222","heartbeat_back_addr":"172.21.15.132:6815/3694952222","heartbeat_front_addr":"172.21.15.132:6813/3694952222","state":["exists","up"]},{"osd":6,"uuid":"417ac9aa-e876-4135-be80-ee260fd3d904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6819","nonce":2257797183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6821","nonce":2257797183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6825","nonce":2257797183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2257797183},{"type":"v1","addr":"172.21.15.2:6823","nonce":2257797183}]},"public_addr":"172.21.15.2:6819/2257797183","cluster_addr":"172.21.15.2:6821/2257797183","heartbeat_back_addr":"172.21.15.2:6825/2257797183","heartbeat_front_addr":"172.21.15.2:6823/2257797183","state":["exists","up"]},{"osd":7,"uuid":"8a85816f-eef9-4786-a3ab-29640863c16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6817","nonce":2487011735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6819","nonce":2487011735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6823","nonce":2487011735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2487011735},{"type":"v1","addr":"172.21.15.64:6821","nonce":2487011735}]},"public_addr":"172.21.15.64:6817/2487011735","cluster_addr":"172.21.15.64:6819/2487011735","heartbeat_back_addr":"172.21.15.64:6823/2487011735","heartbeat_front_addr":"172.21.15.64:6821/2487011735","state":["exists","up"]},{"osd":8,"uuid":"62ec99e5-2cff-4ab4-984f-bffffd019944","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6817","nonce":3969222999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6819","nonce":3969222999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6823","nonce":3969222999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3969222999},{"type":"v1","addr":"172.21.15.132:6821","nonce":3969222999}]},"public_addr":"172.21.15.132:6817/3969222999","cluster_addr":"172.21.15.132:6819/3969222999","heartbeat_back_addr":"172.21.15.132:6823/3969222999","heartbeat_front_addr":"172.21.15.132:6821/3969222999","state":["exists","up"]},{"osd":9,"uuid":"5631cd2a-008f-40a9-b09d-7fa3e05bbddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6827","nonce":3837959291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6829","nonce":3837959291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6833","nonce":3837959291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3837959291},{"type":"v1","addr":"172.21.15.2:6831","nonce":3837959291}]},"public_addr":"172.21.15.2:6827/3837959291","cluster_addr":"172.21.15.2:6829/3837959291","heartbeat_back_addr":"172.21.15.2:6833/3837959291","heartbeat_front_addr":"172.21.15.2:6831/3837959291","state":["exists","up"]},{"osd":10,"uuid":"3f893c6f-12bd-4afc-8b24-c706cd68cb1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6825","nonce":431915757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6827","nonce":431915757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6831","nonce":431915757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":431915757},{"type":"v1","addr":"172.21.15.64:6829","nonce":431915757}]},"public_addr":"172.21.15.64:6825/431915757","cluster_addr":"172.21.15.64:6827/431915757","heartbeat_back_addr":"172.21.15.64:6831/431915757","heartbeat_front_addr":"172.21.15.64:6829/431915757","state":["exists","up"]},{"osd":11,"uuid":"c4c97091-28c9-441a-a030-afe7b066620e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6825","nonce":655576737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6827","nonce":655576737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6831","nonce":655576737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":655576737},{"type":"v1","addr":"172.21.15.132:6829","nonce":655576737}]},"public_addr":"172.21.15.132:6825/655576737","cluster_addr":"172.21.15.132:6827/655576737","heartbeat_back_addr":"172.21.15.132:6831/655576737","heartbeat_front_addr":"172.21.15.132:6829/655576737","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.142267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:54.737630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:18.925006+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:43.500386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:09.100304+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:33.813967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:58.444019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:23.024925+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:20:47.428124+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:12.222428+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:21:38.631194+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:22:04.197263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":6}]},{"pgid":"2.3","mappings":[{"from":10,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3769218802":"2024-09-01T04:16:32.968503+0000","172.21.15.2:6801/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/676946348":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/3520570143":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/383819124":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/2196385741":"2024-09-01T04:15:07.436437+0000","172.21.15.2:0/1227945442":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6800/737748268":"2024-09-01T04:15:07.436437+0000","172.21.15.2:6801/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/3454213639":"2024-09-01T04:15:31.947876+0000","172.21.15.2:0/2617567314":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6800/967619453":"2024-09-01T04:15:31.947876+0000","172.21.15.2:6801/3950990944":"2024-09-01T04:16:32.968503+0000","172.21.15.2:0/2564901012":"2024-09-01T04:16:32.968503+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:37:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 msgr2=0x7fdb3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 0x7fdb3c0b71b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdb54106cf0 tx=0x7fdb4800b410 comp rx=0 tx=0).stop 2024-08-31T04:37:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 msgr2=0x7fdb5419c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c890 tx=0x7fdb4400cd50 comp rx=0 tx=0).stop 2024-08-31T04:37:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 shutdown_connections 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb54109b90 0x7fdb541a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb54109240 0x7fdb5419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7fdb3c0b4ca0 0x7fdb3c0b71b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 --2- 172.21.15.2:0/279817490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54103900 0x7fdb5419c3e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 >> 172.21.15.2:0/279817490 conn(0x7fdb5407b5f0 msgr2=0x7fdb54104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 shutdown_connections 2024-08-31T04:37:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:40.645+0000 7fdb58ab1640 1 -- 172.21.15.2:0/279817490 wait complete. 2024-08-31T04:37:40.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:40 smithi002 ceph-mon[18656]: pgmap v718: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 973 KiB/s wr, 42 op/s 2024-08-31T04:37:40.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:40 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/279817490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:41.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:40 smithi064 ceph-mon[22007]: pgmap v718: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 973 KiB/s wr, 42 op/s 2024-08-31T04:37:41.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:40 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/279817490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:41.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:40 smithi132 ceph-mon[22335]: pgmap v718: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 973 KiB/s wr, 42 op/s 2024-08-31T04:37:41.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:40 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/279817490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:37:41.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-31T04:37:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 -- 172.21.15.2:0/489850558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102840 msgr2=0x7f1ea0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 --2- 172.21.15.2:0/489850558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102840 0x7f1ea0102c50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009900 tx=0x7f1e9c02a410 comp rx=0 tx=0).stop 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 -- 172.21.15.2:0/489850558 shutdown_connections 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 --2- 172.21.15.2:0/489850558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 --2- 172.21.15.2:0/489850558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0108180 0x7f1ea0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 --2- 172.21.15.2:0/489850558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102840 0x7f1ea0102c50 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.129+0000 7f1ea8572640 1 -- 172.21.15.2:0/489850558 >> 172.21.15.2:0/489850558 conn(0x7f1ea00793f0 msgr2=0x7f1ea0079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 -- 172.21.15.2:0/489850558 shutdown_connections 2024-08-31T04:37:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 -- 172.21.15.2:0/489850558 wait complete. 2024-08-31T04:37:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 Processor -- start 2024-08-31T04:37:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 -- start start 2024-08-31T04:37:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 0x7f1ea0198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.130+0000 7f1ea8572640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01127a0 con 0x7f1ea0108180 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea8572640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0112620 con 0x7f1ea0102840 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea8572640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0112920 con 0x7f1ea0108ad0 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34678/0 (socket says 172.21.15.2:34678) 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 -- 172.21.15.2:0/416174101 learned_addr learned my addr 172.21.15.2:0/416174101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea6b0f640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea630e640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 0x7f1ea0198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 -- 172.21.15.2:0/416174101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 msgr2=0x7f1ea01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea01999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 -- 172.21.15.2:0/416174101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 msgr2=0x7f1ea0198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 0x7f1ea0198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 -- 172.21.15.2:0/416174101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea01a85d0 con 0x7f1ea0108180 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea630e640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 0x7f1ea0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea6b0f640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea5b0d640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c970 tx=0x7f1e9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90007bb0 con 0x7f1ea0108180 2024-08-31T04:37:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e90007d50 con 0x7f1ea0108180 2024-08-31T04:37:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.131+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea01a88c0 con 0x7f1ea0108180 2024-08-31T04:37:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.132+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000f450 con 0x7f1ea0108180 2024-08-31T04:37:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.132+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea01a8e00 con 0x7f1ea0108180 2024-08-31T04:37:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.132+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea0103ac0 con 0x7f1ea0108180 2024-08-31T04:37:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.134+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1e90004eb0 con 0x7f1ea0108180 2024-08-31T04:37:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.135+0000 7f1e977fe640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 0x7f1e8c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.135+0000 7f1ea630e640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 0x7f1e8c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.135+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9664+0+0 (secure 0 0 0) 0x7f1e900e5ba0 con 0x7f1ea0108180 2024-08-31T04:37:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.135+0000 7f1ea630e640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 0x7f1e8c0b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.138+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e90014030 con 0x7f1ea0108180 2024-08-31T04:37:42.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.361+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1ea006bcd0 con 0x7f1ea0108180 2024-08-31T04:37:42.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.363+0000 7f1e977fe640 1 -- 172.21.15.2:0/416174101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f1e900ac520 con 0x7f1ea0108180 2024-08-31T04:37:42.365 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T04:37:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 msgr2=0x7f1e8c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 0x7f1e8c0b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c031400 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 msgr2=0x7f1ea0199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c970 tx=0x7f1e9000ce30 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 shutdown_connections 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f1e8c0b4ca0 0x7f1e8c0b71b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0108180 0x7f1ea0199460 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea0108ad0 0x7f1ea01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 --2- 172.21.15.2:0/416174101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ea0102840 0x7f1ea0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 >> 172.21.15.2:0/416174101 conn(0x7f1ea00793f0 msgr2=0x7f1ea01062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:42.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 shutdown_connections 2024-08-31T04:37:42.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:42.367+0000 7f1ea8572640 1 -- 172.21.15.2:0/416174101 wait complete. 2024-08-31T04:37:42.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a[18652]: 2024-08-31T04:37:42.362+0000 7fa5fbcea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:37:42.817 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.817 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.817 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mds[52786]: -- 172.21.15.64:0/1490382759 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564fd8b3b860 con 0x564fdcce1180 2024-08-31T04:37:42.817 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: starting mds.e at 2024-08-31T04:37:42.818 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.818 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.818 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mds[53391]: -- 172.21.15.64:0/154117608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef53349860 con 0x55ef574ef180 2024-08-31T04:37:42.818 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: starting mds.b at 2024-08-31T04:37:42.818 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mds[53088]: -- 172.21.15.64:0/1284918119 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b29a5f860 con 0x562b2dc05180 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: starting mds.h at 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mds[52488]: -- 172.21.15.64:0/1008319168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55798ed55860 con 0x557992efba80 2024-08-31T04:37:42.819 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: starting mds.k at 2024-08-31T04:37:42.820 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.820 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.820 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mds[53611]: -- 172.21.15.132:0/1450349666 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b1a7b5c20 con 0x556b1e95b600 2024-08-31T04:37:42.820 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: starting mds.c at 2024-08-31T04:37:42.820 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: ignoring --setuser ceph since I am not root 2024-08-31T04:37:42.821 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: ignoring --setgroup ceph since I am not root 2024-08-31T04:37:42.821 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mds[53910]: -- 172.21.15.132:0/1454260291 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593af453860 con 0x5593b35f9180 2024-08-31T04:37:42.821 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: starting mds.i at 2024-08-31T04:37:43.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: pgmap v719: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 823 KiB/s wr, 40 op/s 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T04:37:43.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:42 smithi002 ceph-mon[18656]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: pgmap v719: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 823 KiB/s wr, 40 op/s 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T04:37:43.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:42 smithi064 ceph-mon[22007]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T04:37:43.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T04:37:43.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: pgmap v719: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 823 KiB/s wr, 40 op/s 2024-08-31T04:37:43.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:37:43.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:37:43.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:37:43.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/416174101' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:37:43.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T04:37:43.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:42 smithi132 ceph-mon[22335]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T04:37:43.339 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:43.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/2656444223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4410dc50 msgr2=0x7f8c44110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/2656444223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4410dc50 0x7f8c44110120 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009ca0 tx=0x7f8c3c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/2656444223 shutdown_connections 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/2656444223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4410dc50 0x7f8c44110120 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/2656444223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441050d0 0x7f8c4410d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/2656444223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c441046a0 0x7f8c44104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.815+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/2656444223 >> 172.21.15.2:0/2656444223 conn(0x7f8c44079510 msgr2=0x7f8c44079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.816+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/2656444223 shutdown_connections 2024-08-31T04:37:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.816+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/2656444223 wait complete. 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.816+0000 7f8c4bfa9640 1 Processor -- start 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.816+0000 7f8c4bfa9640 1 -- start start 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441046a0 0x7f8c4419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4410dc50 0x7f8c4419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44113890 con 0x7f8c441050d0 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44113710 con 0x7f8c441046a0 2024-08-31T04:37:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4bfa9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44113a10 con 0x7f8c4410dc50 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34702/0 (socket says 172.21.15.2:34702) 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 -- 172.21.15.2:0/358171898 learned_addr learned my addr 172.21.15.2:0/358171898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49d45640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441046a0 0x7f8c4419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c4a546640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4410dc50 0x7f8c4419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 -- 172.21.15.2:0/358171898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4410dc50 msgr2=0x7f8c4419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4410dc50 0x7f8c4419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 -- 172.21.15.2:0/358171898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441046a0 msgr2=0x7f8c4419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441046a0 0x7f8c4419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 -- 172.21.15.2:0/358171898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c441a00b0 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.817+0000 7f8c49544640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400e9c0 tx=0x7f8c3400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.819+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400ccc0 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.819+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c340054d0 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.819+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c441a03a0 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.819+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34010430 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.819+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441a6bc0 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4406bf60 con 0x7f8c441050d0 2024-08-31T04:37:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.821+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8c34004f20 con 0x7f8c441050d0 2024-08-31T04:37:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.822+0000 7f8c3affd640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 0x7f8c300b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.822+0000 7f8c49d45640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 0x7f8c300b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.822+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9834+0+0 (secure 0 0 0) 0x7f8c340e6010 con 0x7f8c441050d0 2024-08-31T04:37:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.823+0000 7f8c49d45640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 0x7f8c300b71e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000abe0 tx=0x7f8c4000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:43.825+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c34056130 con 0x7f8c441050d0 2024-08-31T04:37:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.048+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8c441a6df0 con 0x7f8c441050d0 2024-08-31T04:37:44.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: pgmap v721: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 291 KiB/s wr, 25 op/s 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6837/2010151817,v1:172.21.15.132:6838/2010151817] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.132:6836/3962051012,v1:172.21.15.132:6839/3962051012] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6832/1644039974,v1:172.21.15.64:6834/1644039974] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6833/2688787692,v1:172.21.15.64:6835/2688787692] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6836/2649121503,v1:172.21.15.64:6837/2649121503] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: mds.? [v2:172.21.15.64:6838/2872382194,v1:172.21.15.64:6839/2872382194] up:boot 2024-08-31T04:37:44.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:37:44.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:44 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:37:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: pgmap v721: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 291 KiB/s wr, 25 op/s 2024-08-31T04:37:44.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6837/2010151817,v1:172.21.15.132:6838/2010151817] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.132:6836/3962051012,v1:172.21.15.132:6839/3962051012] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6832/1644039974,v1:172.21.15.64:6834/1644039974] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6833/2688787692,v1:172.21.15.64:6835/2688787692] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6836/2649121503,v1:172.21.15.64:6837/2649121503] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: mds.? [v2:172.21.15.64:6838/2872382194,v1:172.21.15.64:6839/2872382194] up:boot 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:37:44.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:37:44.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:37:44.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:37:44.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:37:44.819 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:44 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:37:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.817+0000 7f8c3affd640 1 -- 172.21.15.2:0/358171898 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f8c340ac8e0 con 0x7f8c441050d0 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: pgmap v721: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 291 KiB/s wr, 25 op/s 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6837/2010151817,v1:172.21.15.132:6838/2010151817] up:boot 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.132:6836/3962051012,v1:172.21.15.132:6839/3962051012] up:boot 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6832/1644039974,v1:172.21.15.64:6834/1644039974] up:boot 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6833/2688787692,v1:172.21.15.64:6835/2688787692] up:boot 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6836/2649121503,v1:172.21.15.64:6837/2649121503] up:boot 2024-08-31T04:37:44.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: mds.? [v2:172.21.15.64:6838/2872382194,v1:172.21.15.64:6839/2872382194] up:boot 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='mgr.14220 172.21.15.2:0/1229810094' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:37:44.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:44 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:37:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 msgr2=0x7f8c300b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 0x7f8c300b71e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000abe0 tx=0x7f8c4000a2d0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 msgr2=0x7f8c4419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400e9c0 tx=0x7f8c3400edc0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 shutdown_connections 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f8c300b4cd0 0x7f8c300b71e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c441050d0 0x7f8c4419a7a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4410dc50 0x7f8c4419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 --2- 172.21.15.2:0/358171898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c441046a0 0x7f8c4419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 >> 172.21.15.2:0/358171898 conn(0x7f8c44079510 msgr2=0x7f8c441004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 shutdown_connections 2024-08-31T04:37:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:44.820+0000 7f8c4bfa9640 1 -- 172.21.15.2:0/358171898 wait complete. 2024-08-31T04:37:45.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:45 smithi002 ceph-mon[18656]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:37:45.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:45 smithi002 ceph-mon[18656]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:37:45.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:45 smithi002 ceph-mon[18656]: Cluster is now healthy 2024-08-31T04:37:45.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:45 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:37:45.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:45 smithi002 ceph-mon[18656]: fsmap 12 up:standby 2024-08-31T04:37:45.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T04:37:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:45 smithi064 ceph-mon[22007]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:37:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:45 smithi064 ceph-mon[22007]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:37:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:45 smithi064 ceph-mon[22007]: Cluster is now healthy 2024-08-31T04:37:45.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:45 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:37:45.818 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:45 smithi064 ceph-mon[22007]: fsmap 12 up:standby 2024-08-31T04:37:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:45 smithi132 ceph-mon[22335]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:37:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:45 smithi132 ceph-mon[22335]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:37:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:45 smithi132 ceph-mon[22335]: Cluster is now healthy 2024-08-31T04:37:45.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:45 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/358171898' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:37:45.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:45 smithi132 ceph-mon[22335]: fsmap 12 up:standby 2024-08-31T04:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 -- 172.21.15.2:0/337045217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464103900 msgr2=0x7f9464103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 --2- 172.21.15.2:0/337045217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464103900 0x7f9464103d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9460009900 tx=0x7f946002a410 comp rx=0 tx=0).stop 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 -- 172.21.15.2:0/337045217 shutdown_connections 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 --2- 172.21.15.2:0/337045217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f94641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 --2- 172.21.15.2:0/337045217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464109240 0x7f9464109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 --2- 172.21.15.2:0/337045217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464103900 0x7f9464103d10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 -- 172.21.15.2:0/337045217 >> 172.21.15.2:0/337045217 conn(0x7f946407b5f0 msgr2=0x7f946407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 -- 172.21.15.2:0/337045217 shutdown_connections 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 -- 172.21.15.2:0/337045217 wait complete. 2024-08-31T04:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.336+0000 7f946b694640 1 Processor -- start 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 -- start start 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464103900 0x7f946419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f946419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9464113850 con 0x7f9464109240 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f94641136d0 con 0x7f9464109b90 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f946b694640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f94641139d0 con 0x7f9464103900 2024-08-31T04:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52396/0 (socket says 172.21.15.2:52396) 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 -- 172.21.15.2:0/2615852003 learned_addr learned my addr 172.21.15.2:0/2615852003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9469430640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464103900 0x7f946419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9469c31640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f946419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 -- 172.21.15.2:0/2615852003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464103900 msgr2=0x7f946419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464103900 0x7f946419a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 -- 172.21.15.2:0/2615852003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 msgr2=0x7f946419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f946419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 -- 172.21.15.2:0/2615852003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94641a01b0 con 0x7f9464109240 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9469c31640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f946419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.337+0000 7f9468c2f640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f945400d750 tx=0x7f945400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.338+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454017070 con 0x7f9464109240 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.338+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94540054d0 con 0x7f9464109240 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.338+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454004c30 con 0x7f9464109240 2024-08-31T04:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.338+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94641a04a0 con 0x7f9464109240 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.338+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94641a6c00 con 0x7f9464109240 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.339+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9464103d10 con 0x7f9464109240 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.340+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9454004dd0 con 0x7f9464109240 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.341+0000 7f945a7fc640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 0x7f94500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.341+0000 7f9469430640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 0x7f94500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.341+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9834+0+0 (secure 0 0 0) 0x7f94540e58e0 con 0x7f9464109240 2024-08-31T04:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.342+0000 7f9469430640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 0x7f94500b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9460031440 tx=0x7f9460009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.344+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94540ac150 con 0x7f9464109240 2024-08-31T04:37:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.530+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f946419b370 con 0x7f9464109240 2024-08-31T04:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.820+0000 7f945a7fc640 1 -- 172.21.15.2:0/2615852003 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7f946419b370 con 0x7f9464109240 2024-08-31T04:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 msgr2=0x7f94500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 0x7f94500b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9460031440 tx=0x7f9460009560 comp rx=0 tx=0).stop 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 msgr2=0x7f946419a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f945400d750 tx=0x7f945400dc10 comp rx=0 tx=0).stop 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 shutdown_connections 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f94500b4ca0 0x7f94500b71b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9464109240 0x7f946419a7e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9464109b90 0x7f946419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 --2- 172.21.15.2:0/2615852003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464103900 0x7f946419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.824+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 >> 172.21.15.2:0/2615852003 conn(0x7f946407b5f0 msgr2=0x7f94641072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.825+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 shutdown_connections 2024-08-31T04:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:46.825+0000 7f946b694640 1 -- 172.21.15.2:0/2615852003 wait complete. 2024-08-31T04:37:47.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:46 smithi002 ceph-mon[18656]: pgmap v722: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T04:37:47.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:46 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:47.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:46 smithi064 ceph-mon[22007]: pgmap v722: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T04:37:47.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:46 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:47.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:46 smithi132 ceph-mon[22335]: pgmap v722: 129 pgs: 129 active+clean; 583 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T04:37:47.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:46 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:47.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T04:37:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:48.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:47 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:48.149 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:47 smithi002 ceph-mon[18656]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T04:37:48.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:47 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:48.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:47 smithi132 ceph-mon[22335]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T04:37:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 -- 172.21.15.2:0/3093965444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101d10 msgr2=0x7f6334102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 --2- 172.21.15.2:0/3093965444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101d10 0x7f6334102120 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6324009900 tx=0x7f632402a410 comp rx=0 tx=0).stop 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 -- 172.21.15.2:0/3093965444 shutdown_connections 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 --2- 172.21.15.2:0/3093965444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334109ba0 0x7f63341103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 --2- 172.21.15.2:0/3093965444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109250 0x7f6334109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 --2- 172.21.15.2:0/3093965444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334101d10 0x7f6334102120 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 -- 172.21.15.2:0/3093965444 >> 172.21.15.2:0/3093965444 conn(0x7f6334077a00 msgr2=0x7f6334077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 -- 172.21.15.2:0/3093965444 shutdown_connections 2024-08-31T04:37:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.296+0000 7f633a77f640 1 -- 172.21.15.2:0/3093965444 wait complete. 2024-08-31T04:37:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 Processor -- start 2024-08-31T04:37:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 -- start start 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334101d10 0x7f633419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109ba0 0x7f633419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6334113860 con 0x7f6334109250 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63341136e0 con 0x7f6334109ba0 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f633a77f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f63341139e0 con 0x7f6334101d10 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f63337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f63337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52414/0 (socket says 172.21.15.2:52414) 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f63337fe640 1 -- 172.21.15.2:0/1899839658 learned_addr learned my addr 172.21.15.2:0/1899839658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.297+0000 7f6333fff640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334101d10 0x7f633419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f6338d1c640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109ba0 0x7f633419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 -- 172.21.15.2:0/1899839658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334101d10 msgr2=0x7f633419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334101d10 0x7f633419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 -- 172.21.15.2:0/1899839658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109ba0 msgr2=0x7f633419fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109ba0 0x7f633419fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 -- 172.21.15.2:0/1899839658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63341a0200 con 0x7f6334109250 2024-08-31T04:37:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63337fe640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f632800d740 tx=0x7f632800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:48.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328017070 con 0x7f6334109250 2024-08-31T04:37:48.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f632800de50 con 0x7f6334109250 2024-08-31T04:37:48.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800f620 con 0x7f6334109250 2024-08-31T04:37:48.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63341a04f0 con 0x7f6334109250 2024-08-31T04:37:48.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.298+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341a6c50 con 0x7f6334109250 2024-08-31T04:37:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.299+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6334102120 con 0x7f6334109250 2024-08-31T04:37:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.301+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f632801a070 con 0x7f6334109250 2024-08-31T04:37:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.302+0000 7f63317fa640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 0x7f631c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.302+0000 7f6333fff640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 0x7f631c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.302+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9164+0+0 (secure 0 0 0) 0x7f63280e5210 con 0x7f6334109250 2024-08-31T04:37:48.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.302+0000 7f6333fff640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 0x7f631c0b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6324031440 tx=0x7f6324009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:48.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.305+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f63280abd20 con 0x7f6334109250 2024-08-31T04:37:48.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:47 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/2615852003' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:48.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:47 smithi064 ceph-mon[22007]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T04:37:48.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.490+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f633419b3c0 con 0x7f6334109250 2024-08-31T04:37:48.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.837+0000 7f63317fa640 1 -- 172.21.15.2:0/1899839658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f633419b3c0 con 0x7f6334109250 2024-08-31T04:37:48.839 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-08-31T04:37:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 msgr2=0x7f631c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 0x7f631c0b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6324031440 tx=0x7f6324009560 comp rx=0 tx=0).stop 2024-08-31T04:37:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 msgr2=0x7f633419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f632800d740 tx=0x7f632800dc00 comp rx=0 tx=0).stop 2024-08-31T04:37:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 shutdown_connections 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f631c0b4ca0 0x7f631c0b71b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6334109250 0x7f633419a830 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6334109ba0 0x7f633419fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 --2- 172.21.15.2:0/1899839658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6334101d10 0x7f633419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 >> 172.21.15.2:0/1899839658 conn(0x7f6334077a00 msgr2=0x7f6334107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 shutdown_connections 2024-08-31T04:37:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:48.842+0000 7f633a77f640 1 -- 172.21.15.2:0/1899839658 wait complete. 2024-08-31T04:37:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:48 smithi002 ceph-mon[18656]: pgmap v724: 97 pgs: 97 active+clean; 51 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:48 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:49.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:48 smithi064 ceph-mon[22007]: pgmap v724: 97 pgs: 97 active+clean; 51 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:49.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:48 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:49.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:48 smithi132 ceph-mon[22335]: pgmap v724: 97 pgs: 97 active+clean; 51 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:49.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:48 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:49.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 4070480a-674f-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-31T04:37:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:37:50.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:49 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:50.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:49 smithi002 ceph-mon[18656]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 -- 172.21.15.2:0/1011066166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8102820 msgr2=0x7f0dd8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 --2- 172.21.15.2:0/1011066166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8102820 0x7f0dd8102c30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800b880 tx=0x7f0dc8005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 -- 172.21.15.2:0/1011066166 shutdown_connections 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 --2- 172.21.15.2:0/1011066166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 --2- 172.21.15.2:0/1011066166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8108ab0 0x7f0dd810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 --2- 172.21.15.2:0/1011066166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8102820 0x7f0dd8102c30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.305+0000 7f0dde54a640 1 -- 172.21.15.2:0/1011066166 >> 172.21.15.2:0/1011066166 conn(0x7f0dd80794e0 msgr2=0x7f0dd80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:50.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.306+0000 7f0dde54a640 1 -- 172.21.15.2:0/1011066166 shutdown_connections 2024-08-31T04:37:50.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.306+0000 7f0dde54a640 1 -- 172.21.15.2:0/1011066166 wait complete. 2024-08-31T04:37:50.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.306+0000 7f0dde54a640 1 Processor -- start 2024-08-31T04:37:50.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.306+0000 7f0dde54a640 1 -- start start 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8102820 0x7f0dd8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 0x7f0dd819d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8111620 con 0x7f0dd8108160 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd81114a0 con 0x7f0dd8108ab0 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dde54a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd81117a0 con 0x7f0dd8102820 2024-08-31T04:37:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52424/0 (socket says 172.21.15.2:52424) 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 -- 172.21.15.2:0/3456839451 learned_addr learned my addr 172.21.15.2:0/3456839451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dd7fff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8102820 0x7f0dd8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0ddcae7640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 0x7f0dd819d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 -- 172.21.15.2:0/3456839451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8102820 msgr2=0x7f0dd8198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8102820 0x7f0dd8198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 -- 172.21.15.2:0/3456839451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 msgr2=0x7f0dd819d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 0x7f0dd819d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 -- 172.21.15.2:0/3456839451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd819dfe0 con 0x7f0dd8108160 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0ddcae7640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 0x7f0dd819d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dcffff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e9a0 tx=0x7f0dc000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.307+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000cd80 con 0x7f0dd8108160 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.308+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd819e2d0 con 0x7f0dd8108160 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.308+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc00035f0 con 0x7f0dd8108160 2024-08-31T04:37:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.308+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0010690 con 0x7f0dd8108160 2024-08-31T04:37:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.308+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd81a4a30 con 0x7f0dd8108160 2024-08-31T04:37:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.309+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd8103aa0 con 0x7f0dd8108160 2024-08-31T04:37:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.310+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0dc0004000 con 0x7f0dd8108160 2024-08-31T04:37:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.311+0000 7f0dd5ffb640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 0x7f0dc40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.311+0000 7f0dd7fff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 0x7f0dc40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.311+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8539+0+0 (secure 0 0 0) 0x7f0dc00e58f0 con 0x7f0dd8108160 2024-08-31T04:37:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.311+0000 7f0dd7fff640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 0x7f0dc40b7230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80057c0 tx=0x7f0dc8005c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.314+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0dc00042f0 con 0x7f0dd8108160 2024-08-31T04:37:50.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:49 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:50.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:49 smithi064 ceph-mon[22007]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T04:37:50.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:49 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/1899839658' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:50.317 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:49 smithi132 ceph-mon[22335]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T04:37:50.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.499+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0dd8102c30 con 0x7f0dd8108160 2024-08-31T04:37:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.860+0000 7f0dd5ffb640 1 -- 172.21.15.2:0/3456839451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v101) ==== 178+0+0 (secure 0 0 0) 0x7f0dd8102c30 con 0x7f0dd8108160 2024-08-31T04:37:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' removed 2024-08-31T04:37:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 msgr2=0x7f0dc40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 0x7f0dc40b7230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80057c0 tx=0x7f0dc8005c90 comp rx=0 tx=0).stop 2024-08-31T04:37:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 msgr2=0x7f0dd8198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e9a0 tx=0x7f0dc000ee60 comp rx=0 tx=0).stop 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 shutdown_connections 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:6800/1444417427,v1:172.21.15.2:6801/1444417427] conn(0x7f0dc40b4d20 0x7f0dc40b7230 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dd8108160 0x7f0dd8198610 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dd8108ab0 0x7f0dd819d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 --2- 172.21.15.2:0/3456839451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd8102820 0x7f0dd8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 >> 172.21.15.2:0/3456839451 conn(0x7f0dd80794e0 msgr2=0x7f0dd81011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 shutdown_connections 2024-08-31T04:37:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-31T04:37:50.864+0000 7f0dde54a640 1 -- 172.21.15.2:0/3456839451 wait complete. 2024-08-31T04:37:51.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:50 smithi002 ceph-mon[18656]: pgmap v726: 33 pgs: 33 active+clean; 51 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:51.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:50 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:51.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:50 smithi064 ceph-mon[22007]: pgmap v726: 33 pgs: 33 active+clean; 51 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:51.317 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:50 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:51.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:50 smithi132 ceph-mon[22335]: pgmap v726: 33 pgs: 33 active+clean; 51 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:37:51.318 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:50 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:37:51.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:37:51.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:37:51.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:37:51.760 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T04:37:51.761 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:37:51.776 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:37:51.794 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:37:51.817 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T04:37:51.818 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T04:37:51.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a 2024-08-31T04:37:51.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:51 smithi002 systemd[1]: Stopping Ceph mon.a for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:51 smithi064 ceph-mon[22007]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:52.067 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:51 smithi064 ceph-mon[22007]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T04:37:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:51 smithi132 ceph-mon[22335]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:52.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:51 smithi132 ceph-mon[22335]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T04:37:52.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:51 smithi002 ceph-mon[18656]: from='client.? 172.21.15.2:0/3456839451' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:37:52.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:51 smithi002 ceph-mon[18656]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T04:37:52.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a[18652]: 2024-08-31T04:37:52.138+0000 7fa6014f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:37:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a[18652]: 2024-08-31T04:37:52.138+0000 7fa6014f5640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T04:37:52.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 podman[98622]: 2024-08-31 04:37:52.241139285 +0000 UTC m=+0.226637439 container died 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1) 2024-08-31T04:37:52.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 podman[98622]: 2024-08-31 04:37:52.605228953 +0000 UTC m=+0.590727099 container cleanup 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T04:37:52.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 bash[98622]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a 2024-08-31T04:37:52.909 INFO:journalctl@ceph.mon.a.smithi002.stdout:Aug 31 04:37:52 smithi002 podman[98634]: 2024-08-31 04:37:52.907030845 +0000 UTC m=+0.659267644 container remove 4c59e47fdc1893706644ea9e350e192ff21d96521dab8c1182b26b55b6fd3c93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-a, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T04:37:53.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T04:37:53.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:53.138 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T04:37:53.138 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T04:37:53.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.b 2024-08-31T04:37:53.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 systemd[1]: Stopping Ceph mon.b for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-b[22003]: 2024-08-31T04:37:53.498+0000 7f2b1fe5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:37:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-b[22003]: 2024-08-31T04:37:53.498+0000 7f2b1fe5c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T04:37:53.817 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 podman[58551]: 2024-08-31 04:37:53.560002898 +0000 UTC m=+0.201451257 container died 2d4e22f94ddce85c45edc1b1b7cd0eb47f7358d47dbd79e86d84ea3dbfc4e427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T04:37:54.243 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 podman[58551]: 2024-08-31 04:37:53.974111597 +0000 UTC m=+0.615559965 container cleanup 2d4e22f94ddce85c45edc1b1b7cd0eb47f7358d47dbd79e86d84ea3dbfc4e427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-b, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T04:37:54.243 INFO:journalctl@ceph.mon.b.smithi064.stdout:Aug 31 04:37:53 smithi064 bash[58551]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-b 2024-08-31T04:37:54.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T04:37:54.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:54.443 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T04:37:54.443 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T04:37:54.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.c 2024-08-31T04:37:54.793 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:54 smithi132 systemd[1]: Stopping Ceph mon.c for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:55.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-c[22331]: 2024-08-31T04:37:54.790+0000 7f38450b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:37:55.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-c[22331]: 2024-08-31T04:37:54.790+0000 7f38450b2640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T04:37:55.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:54 smithi132 podman[58952]: 2024-08-31 04:37:54.863651146 +0000 UTC m=+0.216595321 container died ee8d0cd371086051618816ae59fa01af2c212744d586eeada16b1c1cee0bbcc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:37:55.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:55 smithi132 podman[58952]: 2024-08-31 04:37:55.267998294 +0000 UTC m=+0.620942511 container cleanup ee8d0cd371086051618816ae59fa01af2c212744d586eeada16b1c1cee0bbcc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:37:55.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Aug 31 04:37:55 smithi132 bash[58952]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mon-c 2024-08-31T04:37:55.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T04:37:55.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:55.737 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T04:37:55.738 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T04:37:55.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T04:37:56.061 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:55 smithi002 systemd[1]: Stopping Ceph mgr.x for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:56.397 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:37:56.059+0000 7f28f9fd1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:37:56.398 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x[18882]: 2024-08-31T04:37:56.059+0000 7f28f9fd1640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-31T04:37:56.398 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:56 smithi002 podman[98740]: 2024-08-31 04:37:56.10078162 +0000 UTC m=+0.165949339 container died 9f6b9dc37523b7079a09420b3c6736e1c1f522aa1b8b2ce9fa1b614e3586e71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:37:57.038 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:56 smithi002 podman[98740]: 2024-08-31 04:37:56.819480408 +0000 UTC m=+0.884648136 container cleanup 9f6b9dc37523b7079a09420b3c6736e1c1f522aa1b8b2ce9fa1b614e3586e71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T04:37:57.039 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:56 smithi002 bash[98740]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T04:37:57.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T04:37:57.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:57 smithi002 podman[98753]: 2024-08-31 04:37:57.037804085 +0000 UTC m=+0.938837780 container remove 9f6b9dc37523b7079a09420b3c6736e1c1f522aa1b8b2ce9fa1b614e3586e71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:37:57.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:57 smithi002 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service: Deactivated successfully. 2024-08-31T04:37:57.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:57 smithi002 systemd[1]: Stopped Ceph mgr.x for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:37:57.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Aug 31 04:37:57 smithi002 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.x.service: Consumed 58.529s CPU time. 2024-08-31T04:37:57.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:57.302 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T04:37:57.302 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T04:37:57.302 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T04:37:57.642 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:57 smithi064 systemd[1]: Stopping Ceph mgr.y for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:57.972 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:57 smithi064 podman[58676]: 2024-08-31 04:37:57.641320563 +0000 UTC m=+0.143991032 container died 17324dfcc8f775209b409796ef07d728371dfd49950b3dab1f14a8e0e1669768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:37:58.317 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 podman[58676]: 2024-08-31 04:37:58.071203117 +0000 UTC m=+0.573873574 container cleanup 17324dfcc8f775209b409796ef07d728371dfd49950b3dab1f14a8e0e1669768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-y, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T04:37:58.317 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 bash[58676]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T04:37:58.657 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T04:37:58.678 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 podman[58690]: 2024-08-31 04:37:58.414852766 +0000 UTC m=+0.768685481 container remove 17324dfcc8f775209b409796ef07d728371dfd49950b3dab1f14a8e0e1669768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-y, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T04:37:58.678 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-31T04:37:58.679 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-08-31T04:37:58.679 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 systemd[1]: Stopped Ceph mgr.y for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:37:58.679 INFO:journalctl@ceph.mgr.y.smithi064.stdout:Aug 31 04:37:58 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.y.service: Consumed 7.462s CPU time. 2024-08-31T04:37:58.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:58.692 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T04:37:58.692 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T04:37:58.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T04:37:59.027 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:58 smithi132 systemd[1]: Stopping Ceph mgr.z for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:37:59.317 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 podman[59075]: 2024-08-31 04:37:59.026850489 +0000 UTC m=+0.141969187 container died ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:37:59.693 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 podman[59075]: 2024-08-31 04:37:59.448838106 +0000 UTC m=+0.563956797 container cleanup ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-31T04:37:59.693 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 bash[59075]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T04:37:59.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T04:37:59.964 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 podman[59087]: 2024-08-31 04:37:59.692212018 +0000 UTC m=+0.657631294 container remove ba25d0b243a4a1257767abb1e840dc3d808fe9e1383ecfc944586490696136ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T04:37:59.964 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-08-31T04:37:59.965 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-08-31T04:37:59.965 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 systemd[1]: Stopped Ceph mgr.z for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:37:59.965 INFO:journalctl@ceph.mgr.z.smithi132.stdout:Aug 31 04:37:59 smithi132 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mgr.z.service: Consumed 7.087s CPU time. 2024-08-31T04:37:59.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:37:59.977 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T04:37:59.977 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T04:37:59.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.0 2024-08-31T04:38:00.300 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:00 smithi002 systemd[1]: Stopping Ceph osd.0 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:00.647 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:38:00.298+0000 7ff5c0018640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:00.647 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:38:00.298+0000 7ff5c0018640 -1 osd.0 101 *** Got signal Terminated *** 2024-08-31T04:38:00.648 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0[37365]: 2024-08-31T04:38:00.298+0000 7ff5c0018640 -1 osd.0 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:06.018 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:05 smithi002 podman[98864]: 2024-08-31 04:38:05.71867496 +0000 UTC m=+5.542302436 container died c0e8014a08c9b79bd1aad20e4a93b39245c059408bb0d3dd02c17d4400f39610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:38:06.369 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98864]: 2024-08-31 04:38:06.116332436 +0000 UTC m=+5.939959909 container cleanup c0e8014a08c9b79bd1aad20e4a93b39245c059408bb0d3dd02c17d4400f39610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:06.369 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 bash[98864]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0 2024-08-31T04:38:06.647 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98880]: 2024-08-31 04:38:06.368093203 +0000 UTC m=+0.643528613 container remove c0e8014a08c9b79bd1aad20e4a93b39245c059408bb0d3dd02c17d4400f39610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T04:38:06.955 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98973]: 2024-08-31 04:38:06.591168921 +0000 UTC m=+0.015666732 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:06.956 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98973]: 2024-08-31 04:38:06.710649373 +0000 UTC m=+0.135147174 container create 4838baec2803614784ce1a254f0604e4e36785790b34a8ba355ec51b8fb75998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:07.398 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98973]: 2024-08-31 04:38:06.955057514 +0000 UTC m=+0.379555325 container init 4838baec2803614784ce1a254f0604e4e36785790b34a8ba355ec51b8fb75998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T04:38:07.398 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:06 smithi002 podman[98973]: 2024-08-31 04:38:06.958412429 +0000 UTC m=+0.382910231 container start 4838baec2803614784ce1a254f0604e4e36785790b34a8ba355ec51b8fb75998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:38:07.398 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:07 smithi002 podman[98973]: 2024-08-31 04:38:07.054991397 +0000 UTC m=+0.479489211 container attach 4838baec2803614784ce1a254f0604e4e36785790b34a8ba355ec51b8fb75998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T04:38:07.398 INFO:journalctl@ceph.osd.0.smithi002.stdout:Aug 31 04:38:07 smithi002 podman[98973]: 2024-08-31 04:38:07.159360995 +0000 UTC m=+0.583858811 container died 4838baec2803614784ce1a254f0604e4e36785790b34a8ba355ec51b8fb75998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T04:38:07.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T04:38:07.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:07.921 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T04:38:07.921 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T04:38:07.921 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.1 2024-08-31T04:38:08.236 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:07 smithi064 systemd[1]: Stopping Ceph osd.1 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:08.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:38:08.234+0000 7f2787100640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:08.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:38:08.234+0000 7f2787100640 -1 osd.1 101 *** Got signal Terminated *** 2024-08-31T04:38:08.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1[27593]: 2024-08-31T04:38:08.234+0000 7f2787100640 -1 osd.1 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:14.067 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:13 smithi064 podman[58802]: 2024-08-31 04:38:13.811043862 +0000 UTC m=+5.690836105 container died 7cb1bd57f064ef3a8a800f8ec8c25e513f8c914ce89c11ed8dce70129936ca28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-08-31T04:38:14.479 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:14 smithi064 podman[58802]: 2024-08-31 04:38:14.260308608 +0000 UTC m=+6.140100828 container cleanup 7cb1bd57f064ef3a8a800f8ec8c25e513f8c914ce89c11ed8dce70129936ca28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:38:14.479 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:14 smithi064 bash[58802]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1 2024-08-31T04:38:14.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:14 smithi064 podman[58819]: 2024-08-31 04:38:14.478715424 +0000 UTC m=+0.661324882 container remove 7cb1bd57f064ef3a8a800f8ec8c25e513f8c914ce89c11ed8dce70129936ca28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:38:15.183 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:14 smithi064 podman[58904]: 2024-08-31 04:38:14.831769118 +0000 UTC m=+0.016251816 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:15.183 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:14 smithi064 podman[58904]: 2024-08-31 04:38:14.946471726 +0000 UTC m=+0.130954468 container create 318425d08398c093899c68fe9a75fb085060d7859f5be46c154fd151ddb15634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:15.183 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:15 smithi064 podman[58904]: 2024-08-31 04:38:15.182168143 +0000 UTC m=+0.366650841 container init 318425d08398c093899c68fe9a75fb085060d7859f5be46c154fd151ddb15634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T04:38:15.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:15 smithi064 podman[58904]: 2024-08-31 04:38:15.185658483 +0000 UTC m=+0.370141183 container start 318425d08398c093899c68fe9a75fb085060d7859f5be46c154fd151ddb15634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T04:38:15.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:15 smithi064 podman[58904]: 2024-08-31 04:38:15.290700012 +0000 UTC m=+0.475182712 container attach 318425d08398c093899c68fe9a75fb085060d7859f5be46c154fd151ddb15634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:38:15.567 INFO:journalctl@ceph.osd.1.smithi064.stdout:Aug 31 04:38:15 smithi064 podman[58904]: 2024-08-31 04:38:15.427448757 +0000 UTC m=+0.611931455 container died 318425d08398c093899c68fe9a75fb085060d7859f5be46c154fd151ddb15634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T04:38:16.185 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T04:38:16.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:16.227 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T04:38:16.227 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T04:38:16.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.2 2024-08-31T04:38:16.567 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:16 smithi132 systemd[1]: Stopping Ceph osd.2 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:17.068 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:38:16.661+0000 7f3086997640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:17.068 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:38:16.661+0000 7f3086997640 -1 osd.2 101 *** Got signal Terminated *** 2024-08-31T04:38:17.068 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2[28621]: 2024-08-31T04:38:16.661+0000 7f3086997640 -1 osd.2 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:22.474 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:22 smithi132 podman[59204]: 2024-08-31 04:38:22.21599187 +0000 UTC m=+5.795198373 container died 7c6ee6c7ba7b2ee3aea9f88454399906db95019b92f21f79130e37e9fe734354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:38:22.817 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:22 smithi132 podman[59204]: 2024-08-31 04:38:22.628089499 +0000 UTC m=+6.207296001 container cleanup 7c6ee6c7ba7b2ee3aea9f88454399906db95019b92f21f79130e37e9fe734354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:22.817 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:22 smithi132 bash[59204]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2 2024-08-31T04:38:23.222 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:22 smithi132 podman[59220]: 2024-08-31 04:38:22.913329133 +0000 UTC m=+0.689272004 container remove 7c6ee6c7ba7b2ee3aea9f88454399906db95019b92f21f79130e37e9fe734354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T04:38:23.534 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.124354903 +0000 UTC m=+0.015874028 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:23.534 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.247600513 +0000 UTC m=+0.139119641 container create 2c4800c0bbb5bab60d874c25d8b24efaae0674d91911ab8947d1e5d748acc44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T04:38:23.818 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.53368108 +0000 UTC m=+0.425200199 container init 2c4800c0bbb5bab60d874c25d8b24efaae0674d91911ab8947d1e5d748acc44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:38:23.818 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.537028632 +0000 UTC m=+0.428547756 container start 2c4800c0bbb5bab60d874c25d8b24efaae0674d91911ab8947d1e5d748acc44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T04:38:23.818 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.63382408 +0000 UTC m=+0.525343200 container attach 2c4800c0bbb5bab60d874c25d8b24efaae0674d91911ab8947d1e5d748acc44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T04:38:23.818 INFO:journalctl@ceph.osd.2.smithi132.stdout:Aug 31 04:38:23 smithi132 podman[59308]: 2024-08-31 04:38:23.729899794 +0000 UTC m=+0.621418916 container died 2c4800c0bbb5bab60d874c25d8b24efaae0674d91911ab8947d1e5d748acc44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:38:24.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T04:38:24.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:24.480 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T04:38:24.481 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T04:38:24.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.3 2024-08-31T04:38:24.771 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:24 smithi002 systemd[1]: Stopping Ceph osd.3 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:25.147 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:24 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:38:24.769+0000 7fa915743640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:25.147 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:24 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:38:24.769+0000 7fa915743640 -1 osd.3 101 *** Got signal Terminated *** 2024-08-31T04:38:25.148 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:24 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3[43806]: 2024-08-31T04:38:24.769+0000 7fa915743640 -1 osd.3 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:27.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:27 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:27.031+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:28.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:28 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:28.029+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:28.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:28 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:28.088+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:28.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:28.271+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:29.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:29 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:29.044+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:29.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:29 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:29.099+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:29.567 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:29.443+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:29.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:29.246+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:29.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:29.256+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:30.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:30 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:30.003+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:30.397 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:30 smithi002 podman[99076]: 2024-08-31 04:38:30.29220541 +0000 UTC m=+5.616399304 container died cd50be53946d03cdac00dd7bffbb90b8ffda7d8cd2a6775a630d54444cacace0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T04:38:30.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:30 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:30.086+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:30.567 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:30.453+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:30.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:30.223+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:30.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:30.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:30.897 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:30 smithi002 podman[99076]: 2024-08-31 04:38:30.761179765 +0000 UTC m=+6.085373708 container cleanup cd50be53946d03cdac00dd7bffbb90b8ffda7d8cd2a6775a630d54444cacace0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T04:38:30.897 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:30 smithi002 bash[99076]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3 2024-08-31T04:38:31.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:31 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:31.013+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:31.381 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99091]: 2024-08-31 04:38:31.038011387 +0000 UTC m=+0.748715657 container remove cd50be53946d03cdac00dd7bffbb90b8ffda7d8cd2a6775a630d54444cacace0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-08-31T04:38:31.381 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:31 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:31.044+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:31.491 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:31.198+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:31.492 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:31.300+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:31.633 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.380444783 +0000 UTC m=+0.106759699 container create c7a3a5cd99dbe32895749b9e00a41b7b5279e47d6d7ee1d8fd18d620567197fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-31T04:38:31.633 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.289637028 +0000 UTC m=+0.015951909 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:31.634 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.632913766 +0000 UTC m=+0.359228637 container init c7a3a5cd99dbe32895749b9e00a41b7b5279e47d6d7ee1d8fd18d620567197fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T04:38:31.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:31.491+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:31.897 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.636181905 +0000 UTC m=+0.362496777 container start c7a3a5cd99dbe32895749b9e00a41b7b5279e47d6d7ee1d8fd18d620567197fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T04:38:31.897 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.724640079 +0000 UTC m=+0.450954953 container attach c7a3a5cd99dbe32895749b9e00a41b7b5279e47d6d7ee1d8fd18d620567197fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-31T04:38:31.898 INFO:journalctl@ceph.osd.3.smithi002.stdout:Aug 31 04:38:31 smithi002 podman[99179]: 2024-08-31 04:38:31.834682993 +0000 UTC m=+0.560997865 container died c7a3a5cd99dbe32895749b9e00a41b7b5279e47d6d7ee1d8fd18d620567197fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T04:38:32.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:32 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:32.050+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:32.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:32 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:32.060+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:32.443 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:32.175+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:32.443 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:32.289+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:32.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T04:38:32.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:32.656 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T04:38:32.656 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T04:38:32.657 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.4 2024-08-31T04:38:32.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:32.440+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:32.974 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:32 smithi064 systemd[1]: Stopping Ceph osd.4 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:33.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:33 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:33.031+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:33.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:32 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:38:32.972+0000 7f02e58d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:33.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:32 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:38:32.972+0000 7f02e58d1640 -1 osd.4 101 *** Got signal Terminated *** 2024-08-31T04:38:33.317 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:32 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:38:32.972+0000 7f02e58d1640 -1 osd.4 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:33.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:33 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:33.029+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:33.488 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:33.144+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:33.489 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:33.301+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:33.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:33.486+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:34.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:34 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:34.060+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:34.517 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:34 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:34.133+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:34.517 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:34 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:34.342+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:34.518 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:34 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:34.342+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:34.567 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:34 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:34.076+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:34.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:34 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:34.514+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:35.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:35 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:35.064+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:35.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:35 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:35.025+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:35.555 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:35.162+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:35.556 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:35.367+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:35.556 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:35.367+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:35.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:35 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:35.554+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:36.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:36 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:36.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:36.511 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:36 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:36.178+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:36.512 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:36 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:36.348+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:36.512 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:36 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:36.348+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:36.567 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:36 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:36.069+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:36.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:36 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:36.508+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:37.039 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:36 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:38:36.655+0000 7f02e1ebc640 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:10.306408+0000 front 2024-08-31T04:38:10.306443+0000 (oldest deadline 2024-08-31T04:38:36.107254+0000) 2024-08-31T04:38:37.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:37 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:37.038+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:37.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:37 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:37.038+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:37.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:37 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:37.087+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:37.514 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:37 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:37.202+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:37.515 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:37 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:37.373+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:37.515 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:37 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:37.373+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:37.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:37 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:37.512+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:37.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:37 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:37.512+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:38.031 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:37 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4[34007]: 2024-08-31T04:38:37.617+0000 7f02e1ebc640 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:10.306408+0000 front 2024-08-31T04:38:10.306443+0000 (oldest deadline 2024-08-31T04:38:36.107254+0000) 2024-08-31T04:38:38.147 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:38 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:38.047+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:38.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:37 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:37.827+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:38.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:38 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:38.030+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:38.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:38 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:38.030+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:38.559 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:38.183+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:38.560 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:38.369+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:38.560 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:38.369+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:38.817 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:38 smithi064 podman[59023]: 2024-08-31 04:38:38.494200022 +0000 UTC m=+5.639566737 container died 5fb66da245af343469416d7c030ea75ef506e69223e76723df6cb82327d0d9fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T04:38:38.817 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:38.558+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:38.818 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:38 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:38.558+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:39.098 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:38 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:38.819+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:39.143 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:38 smithi064 podman[59023]: 2024-08-31 04:38:38.932128505 +0000 UTC m=+6.077495217 container cleanup 5fb66da245af343469416d7c030ea75ef506e69223e76723df6cb82327d0d9fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-31T04:38:39.143 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:38 smithi064 bash[59023]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4 2024-08-31T04:38:39.143 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:39 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:39.068+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:39.144 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:39 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:39.068+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:39.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:39 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:39.096+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:39.541 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:39 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:39.153+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:39.542 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:39 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:39.380+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:39.542 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:39 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:39.380+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:39.542 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:39 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:39.540+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:39.542 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:39 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:39.540+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:39.548 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59040]: 2024-08-31 04:38:39.142120838 +0000 UTC m=+0.648594255 container remove 5fb66da245af343469416d7c030ea75ef506e69223e76723df6cb82327d0d9fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-31T04:38:39.548 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:39 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:39.172+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:39.817 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.450100021 +0000 UTC m=+0.016094397 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:39.817 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.551482542 +0000 UTC m=+0.117476953 container create f37aa798299f00e38821366e7918217b03d385bc62b28f38782c801868bbfa4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-31T04:38:39.817 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.770893558 +0000 UTC m=+0.336887936 container init f37aa798299f00e38821366e7918217b03d385bc62b28f38782c801868bbfa4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:38:39.818 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.774485476 +0000 UTC m=+0.340479843 container start f37aa798299f00e38821366e7918217b03d385bc62b28f38782c801868bbfa4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T04:38:40.107 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:39 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:39.839+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:40.148 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.870629392 +0000 UTC m=+0.436623763 container attach f37aa798299f00e38821366e7918217b03d385bc62b28f38782c801868bbfa4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T04:38:40.148 INFO:journalctl@ceph.osd.4.smithi064.stdout:Aug 31 04:38:39 smithi064 podman[59127]: 2024-08-31 04:38:39.966991986 +0000 UTC m=+0.532986364 container died f37aa798299f00e38821366e7918217b03d385bc62b28f38782c801868bbfa4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T04:38:40.148 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:40 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:40.045+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:40.149 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:40 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:40.045+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:40.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:40 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:40.105+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:40.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:40 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:40.105+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:40.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:40 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:40.147+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:40.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:40 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:40.164+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:40.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:40 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:40.357+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:40.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:40 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:40.357+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:40.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T04:38:40.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:40.743 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T04:38:40.744 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T04:38:40.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.5 2024-08-31T04:38:41.059 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:40 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:40.589+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:41.059 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:40 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:40.589+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:41.059 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:40 smithi132 systemd[1]: Stopping Ceph osd.5 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:41.059 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:41.056+0000 7f3ea1d9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:41.059 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:41.056+0000 7f3ea1d9a640 -1 osd.5 101 *** Got signal Terminated *** 2024-08-31T04:38:41.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:40 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:40.837+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:41.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:41 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:41.141+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:41.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:40 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:40.999+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:41.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:40 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:40.999+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:41.318 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:41.184+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:41.318 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:41.056+0000 7f3ea1d9a640 -1 osd.5 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:41.635 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:41.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:41.636 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:41.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:41.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:41 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:41.146+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:41.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:41 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:41.146+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:42.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:41.633+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:42.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:41 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:41.633+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:42.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:41 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:41.794+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:42.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:42.170+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:42.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:42.010+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:42.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:42.010+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:42.430 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:42 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:42.189+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:42.430 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:42 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:42.189+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:42.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:42.146+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:42.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:42.344+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:42.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:42.344+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:43.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:42.613+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:43.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:42 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:42.613+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:43.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:42 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:42.809+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:43.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:43 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:43.215+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:43.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:43 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:43.215+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:43.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:42.985+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:43.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:42 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:42.985+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:43.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:43.154+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:43.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:43.154+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:43.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:43.348+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:43.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:43.348+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:43.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:43 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:43.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:43.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:43 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:43.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:44.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:43.603+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:44.068 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:43.603+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:44.068 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:43 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:43.603+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.351655+0000 front 2024-08-31T04:38:17.351680+0000 (oldest deadline 2024-08-31T04:38:43.251633+0000) 2024-08-31T04:38:44.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:43 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:43.851+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:44.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:43 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:43.851+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:44.249 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:43 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:43.943+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:44.250 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:43 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:43.943+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:44.250 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:43 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:43.943+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:44.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:44 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:44.248+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:44.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:44 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:44.248+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:44.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:44.185+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:44.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:44.185+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:44.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:44.357+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:44.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:44.357+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:44.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:44.357+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:44.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:44.217+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:44.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:44.217+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:44.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:44.217+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:45.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:44.651+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:45.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:44.651+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:45.068 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:44 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:44.651+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.351655+0000 front 2024-08-31T04:38:17.351680+0000 (oldest deadline 2024-08-31T04:38:43.251633+0000) 2024-08-31T04:38:45.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:44.892+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:45.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:44 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:44.892+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:45.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:45 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:45.220+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:45.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:45 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:45.220+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:45.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:44 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:44.990+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:45.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:44 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:44.990+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:45.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:44 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:44.990+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:45.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:45.234+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:45.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:45.234+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:45.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:45.338+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:45.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:45.338+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:45.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:45.338+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:45.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:45 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:45.228+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:45.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:45 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:45.228+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:45.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:45 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:45.228+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:46.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:45.642+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:03.850010+0000 front 2024-08-31T04:38:03.850109+0000 (oldest deadline 2024-08-31T04:38:28.550164+0000) 2024-08-31T04:38:46.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:45.642+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.051432+0000 front 2024-08-31T04:38:12.051603+0000 (oldest deadline 2024-08-31T04:38:37.351307+0000) 2024-08-31T04:38:46.068 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:45 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5[35056]: 2024-08-31T04:38:45.642+0000 7f3e9a37d640 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.351655+0000 front 2024-08-31T04:38:17.351680+0000 (oldest deadline 2024-08-31T04:38:43.251633+0000) 2024-08-31T04:38:46.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:45 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:45.867+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:46.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:45 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:45.867+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:46.235 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:45 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:45.941+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:46.235 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:45 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:45.941+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:46.235 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:45 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:45.941+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:46.474 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:46.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:46.474 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:46.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:46.474 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:46.326+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:46.474 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:46.326+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:46.475 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:46 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:46.326+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:46.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:46 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:46.234+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:46.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:46 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:46.234+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:46.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:46.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:46.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:46.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:46.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:46.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:46.801 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:46 smithi132 podman[59424]: 2024-08-31 04:38:46.472863475 +0000 UTC m=+5.533192696 container died d3dcbdbcda31d8216ead54cc1b3fe28e4a90f5baa8f481a52bd0541523526f08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:38:47.067 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:46 smithi132 podman[59424]: 2024-08-31 04:38:46.915985036 +0000 UTC m=+5.976314250 container cleanup d3dcbdbcda31d8216ead54cc1b3fe28e4a90f5baa8f481a52bd0541523526f08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:38:47.068 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:46 smithi132 bash[59424]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5 2024-08-31T04:38:47.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:46.861+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:47.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:46.861+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:47.267 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:46 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:46.977+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:47.267 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:46 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:46.977+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:47.267 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:46 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:46.977+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:47.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:47.266+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:47.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:47.266+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:47.568 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59439]: 2024-08-31 04:38:47.1510421 +0000 UTC m=+0.673781128 container remove d3dcbdbcda31d8216ead54cc1b3fe28e4a90f5baa8f481a52bd0541523526f08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T04:38:47.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:47 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:47.224+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:47.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:47 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:47.225+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:47.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:47 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:47.284+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:47.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:47 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:47.284+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:47.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:47 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:47.284+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:47.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:47 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:47.207+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:47.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:47 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:47.207+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:47.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:47 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:47.207+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:47.872 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59529]: 2024-08-31 04:38:47.477113918 +0000 UTC m=+0.015950717 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:47.872 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59529]: 2024-08-31 04:38:47.60524406 +0000 UTC m=+0.144080897 container create 657188de60d3cd8c88c2c36e447d1bb40c3e7c52ded1910c8c9b9b2349d9a068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:38:47.872 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59529]: 2024-08-31 04:38:47.871219151 +0000 UTC m=+0.410055940 container init 657188de60d3cd8c88c2c36e447d1bb40c3e7c52ded1910c8c9b9b2349d9a068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T04:38:48.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:47 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:47.826+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:48.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:47 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:47.826+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:48.188 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59529]: 2024-08-31 04:38:47.874614608 +0000 UTC m=+0.413451397 container start 657188de60d3cd8c88c2c36e447d1bb40c3e7c52ded1910c8c9b9b2349d9a068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T04:38:48.188 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:47 smithi132 podman[59529]: 2024-08-31 04:38:47.979679689 +0000 UTC m=+0.518516496 container attach 657188de60d3cd8c88c2c36e447d1bb40c3e7c52ded1910c8c9b9b2349d9a068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:48.188 INFO:journalctl@ceph.osd.5.smithi132.stdout:Aug 31 04:38:48 smithi132 podman[59529]: 2024-08-31 04:38:48.059142164 +0000 UTC m=+0.597978954 container died 657188de60d3cd8c88c2c36e447d1bb40c3e7c52ded1910c8c9b9b2349d9a068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-31T04:38:48.248 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:47.956+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:48.248 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:47.956+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:48.248 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:47 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:47.956+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:48.442 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:48.186+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:48.442 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:48.186+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:48.443 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:48.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:48.443 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:48.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:48.443 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:48 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:48.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:48.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:48 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:48.247+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:48.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:48 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:48.247+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:48.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:48 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:48.196+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:48.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:48 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:48.196+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:48.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:48 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:48.196+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:48.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T04:38:48.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:48.796 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T04:38:48.796 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T04:38:48.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.6 2024-08-31T04:38:49.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:48 smithi002 systemd[1]: Stopping Ceph osd.6 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:49.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:48 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:48.873+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:49.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:48 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:48.873+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:49.112 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:49.109+0000 7fc6b0b13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:49.112 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:49.109+0000 7fc6b0b13640 -1 osd.6 101 *** Got signal Terminated *** 2024-08-31T04:38:49.112 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:49.109+0000 7fc6b0b13640 -1 osd.6 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:49.251 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:48 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:48.939+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:49.251 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:48 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:48.939+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:49.251 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:48 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:48.939+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:49.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:49.173+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:49.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:49.173+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:49.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:49.173+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:49.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:49 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:49.250+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:49.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:49 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:49.250+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:49.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:49 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:49.215+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:49.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:49 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:49.215+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:49.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:49 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:49.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:49.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:49 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:49.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:49.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:49 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:49.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:50.171 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:49.898+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:50.171 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:49 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:49.898+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:50.220 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:49 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:49.890+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:50.220 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:49 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:49.890+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:50.220 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:49 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:49.890+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:50.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:50 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:50.219+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:50.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:50 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:50.219+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:50.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:50 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:50.215+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:50.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:50 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:50.215+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:50.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:50 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:50.277+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:50.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:50 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:50.277+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:50.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:50 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:50.277+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:50.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:50.170+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:50.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:50.170+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:50.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:50.170+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:51.147 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:50.858+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:51.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:50.858+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:51.265 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:50 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:50.888+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:51.265 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:50 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:50.888+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:51.266 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:50 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:50.888+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:51.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:51 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:51.264+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:51.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:51 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:51.264+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:51.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:51 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:51.182+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:51.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:51 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:51.182+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:51.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:51 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:51.301+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:51.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:51 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:51.301+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:51.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:51 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:51.301+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:51.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:51 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:51.158+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:51.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:51 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:51.158+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:51.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:51 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:51.158+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:52.117 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:51 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:51.849+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:52.117 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:51 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:51.849+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:52.244 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:51 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:51.877+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:52.244 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:51 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:51.877+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:52.244 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:51 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:51.877+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:52.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:52.116+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:52.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:52.116+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:52.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:52.116+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:52.469 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:52 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:52.136+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:52.469 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:52 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:52.136+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:52.469 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:52 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:52.347+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:52.469 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:52 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:52.347+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:52.470 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:52 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:52.347+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:52.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:52 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:52.243+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:52.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:52 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:52.243+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:53.147 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:53 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:53.078+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:53.148 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:53 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:53.078+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:53.148 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:53 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:53.078+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:53.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:52.877+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:53.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:52 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:52.877+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:53.229 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:52 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:52.880+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:53.229 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:52 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:52.880+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:53.229 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:52 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:52.880+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:53.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:53.228+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:53.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:53.228+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:53.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:53.228+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:53.163+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:53.163+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:53.163+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:53.351+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:53.351+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:53.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:53 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:53.351+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:54.147 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:54 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:54.081+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:54.148 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:54 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:54.081+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:54.148 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:54 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:54.081+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:54.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:53 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:53.881+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.533479+0000 front 2024-08-31T04:38:11.533571+0000 (oldest deadline 2024-08-31T04:38:37.433517+0000) 2024-08-31T04:38:54.148 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:53 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6[50581]: 2024-08-31T04:38:53.881+0000 7fc6a90f6640 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:17.434067+0000 front 2024-08-31T04:38:17.434176+0000 (oldest deadline 2024-08-31T04:38:43.334164+0000) 2024-08-31T04:38:54.188 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:53.837+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:54.188 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:53.837+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:54.188 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:53 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:53.837+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:54.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:54.186+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:54.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:54.186+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:54.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:54.186+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:54.185+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:54.185+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:54.185+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:54.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:54.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:54.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:54 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:54.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:54.775 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:54 smithi002 podman[99294]: 2024-08-31 04:38:54.481170896 +0000 UTC m=+5.488613474 container died 728521699ed4f8f13e3258c5762d3c52e2e23475ba5febb511d045b2c628ceaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:38:55.089 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:54 smithi002 podman[99294]: 2024-08-31 04:38:54.964854742 +0000 UTC m=+5.972297363 container cleanup 728521699ed4f8f13e3258c5762d3c52e2e23475ba5febb511d045b2c628ceaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T04:38:55.089 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:54 smithi002 bash[99294]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6 2024-08-31T04:38:55.204 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:54.852+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:55.204 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:54.852+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:55.204 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:54.852+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:55.205 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:54 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:54.852+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:38:55.397 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99309]: 2024-08-31 04:38:55.158019039 +0000 UTC m=+0.675903795 container remove 728521699ed4f8f13e3258c5762d3c52e2e23475ba5febb511d045b2c628ceaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T04:38:55.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:55 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:55.087+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:55.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:55 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:55.087+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:55.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:55 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:55.087+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:55.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:55 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:55.087+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:38:55.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:55.202+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:55.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:55.202+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:55.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:55.202+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:55.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:55.319+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:55.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:55.319+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:55.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:55.319+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:55.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:55.209+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:55.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:55.209+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:55.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:55 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:55.209+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:55.832 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99403]: 2024-08-31 04:38:55.483817429 +0000 UTC m=+0.015888344 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:38:55.833 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99403]: 2024-08-31 04:38:55.617140898 +0000 UTC m=+0.149211799 container create dafcaab0cd971df0da0ea215f3869c95f5e79a9a072c3bdae4e9beeebc7478dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-31T04:38:55.833 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99403]: 2024-08-31 04:38:55.828284803 +0000 UTC m=+0.360355706 container init dafcaab0cd971df0da0ea215f3869c95f5e79a9a072c3bdae4e9beeebc7478dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:38:55.833 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99403]: 2024-08-31 04:38:55.831538754 +0000 UTC m=+0.363609655 container start dafcaab0cd971df0da0ea215f3869c95f5e79a9a072c3bdae4e9beeebc7478dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-08-31T04:38:56.136 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:55 smithi002 podman[99403]: 2024-08-31 04:38:55.928239227 +0000 UTC m=+0.460310128 container attach dafcaab0cd971df0da0ea215f3869c95f5e79a9a072c3bdae4e9beeebc7478dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:38:56.136 INFO:journalctl@ceph.osd.6.smithi002.stdout:Aug 31 04:38:56 smithi002 podman[99403]: 2024-08-31 04:38:56.023352737 +0000 UTC m=+0.555423648 container died dafcaab0cd971df0da0ea215f3869c95f5e79a9a072c3bdae4e9beeebc7478dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:38:56.155 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:55.818+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:56.156 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:55.818+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:56.156 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:55.818+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:56.156 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:55.818+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:38:56.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:56.134+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:56.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:56.134+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:56.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:56.134+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:56.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:56 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:56.134+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:38:56.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:56.153+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:56.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:56.153+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:56.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:56.153+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:56.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:56.299+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:56.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:56.299+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:56.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:56.299+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:56.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:56.197+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:56.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:56.197+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:56.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:56 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:56.197+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:56.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T04:38:56.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:38:56.744 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T04:38:56.744 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T04:38:56.744 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.7 2024-08-31T04:38:57.067 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:56 smithi064 systemd[1]: Stopping Ceph osd.7 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:38:57.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:56.779+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:57.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:56.779+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:57.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:56.779+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:57.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:56 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:56.779+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:38:57.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:57 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:57.110+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:57.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:57 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:57.110+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:57.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:57 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:57.110+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:57.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:57 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:57.110+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:38:57.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.076+0000 7f97c6d13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:38:57.568 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.076+0000 7f97c6d13640 -1 osd.7 101 *** Got signal Terminated *** 2024-08-31T04:38:57.568 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.076+0000 7f97c6d13640 -1 osd.7 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:38:57.568 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.196+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:57.568 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.196+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:57.568 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:57.196+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:57.264+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:57.264+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:57.264+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:57.216+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:57.216+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:57.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:57 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:57.216+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:58.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:57.778+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:58.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:57.778+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:58.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:57.778+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:58.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:57 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:57.778+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:38:58.347 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:58.206+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:58.348 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:58.206+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:58.348 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:58.206+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:58.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:58.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:58.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:58.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:58.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:58.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:58.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:58.190+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:58.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:58.190+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:58.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:58 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:58.190+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:58.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:58 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:58.151+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:58.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:58 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:58.151+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:58.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:58 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:58.151+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:58.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:58 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:58.151+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:38:59.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:58.795+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:38:59.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:58.795+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:38:59.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:58.795+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:38:59.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:58.795+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:38:59.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:58 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:58.795+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:38:59.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:59.180+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:38:59.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:59.180+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:38:59.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:38:59.180+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:38:59.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:59.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:38:59.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:59.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:38:59.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:38:59.242+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:38:59.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:59.165+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:38:59.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:59.165+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:38:59.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:59.165+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:38:59.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:38:59 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:38:59.165+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:38:59.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:59.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:38:59.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:59.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:38:59.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:59.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:38:59.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:38:59 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:38:59.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:00.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:59.789+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:00.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:59.789+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:00.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:59.789+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:00.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:59.789+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:00.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:38:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:38:59.789+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:00.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:00.179+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:39:00.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:00.179+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:39:00.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:00.179+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:39:00.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:00.199+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:00.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:00.199+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:00.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:00.199+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:00.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:00.178+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:00.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:00.178+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:00.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:00.178+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:00.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:00 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:00.178+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:00.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:00.180+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:00.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:00.180+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:00.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:00.180+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:00.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:00 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:00.180+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:01.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:00.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:01.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:00.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:01.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:00.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:01.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:00.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:01.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:00 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:00.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:01.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:01.226+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:12.878416+0000 front 2024-08-31T04:38:12.878472+0000 (oldest deadline 2024-08-31T04:38:38.778568+0000) 2024-08-31T04:39:01.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:01.226+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.480046+0000 front 2024-08-31T04:38:20.480088+0000 (oldest deadline 2024-08-31T04:38:42.780053+0000) 2024-08-31T04:39:01.567 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7[40924]: 2024-08-31T04:39:01.226+0000 7f97bf2f6640 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.583373+0000 front 2024-08-31T04:38:29.583339+0000 (oldest deadline 2024-08-31T04:38:52.983512+0000) 2024-08-31T04:39:01.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:01.171+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:01.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:01.171+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:01.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:01.171+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:01.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:01.171+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:01.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:01.170+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:01.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:01.170+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:01.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:01.170+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:01.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:01 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:01.170+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:01.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:01 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:01.215+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:01.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:01 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:01.215+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:01.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:01 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:01.215+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:01.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:01 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:01.215+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:02.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:01.841+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:02.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:01.841+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:02.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:01.841+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:02.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:01.841+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:02.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:01 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:01.841+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:02.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:02.170+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:02.170+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:02.170+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:02.170+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:02.193+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:02.193+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:02.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:02.193+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:02.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:02 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:02.193+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:02.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:02.208+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:02.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:02.208+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:02.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:02.208+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:02.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:02 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:02.208+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:02.817 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:02 smithi064 podman[59231]: 2024-08-31 04:39:02.547786383 +0000 UTC m=+5.609333945 container died b4b5009bf5c104dc330690d9decc5f5674f3eceb60e2f82d57a584f79192a158 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:03.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59231]: 2024-08-31 04:39:03.035775543 +0000 UTC m=+6.097323103 container cleanup b4b5009bf5c104dc330690d9decc5f5674f3eceb60e2f82d57a584f79192a158 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:03.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 bash[59231]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7 2024-08-31T04:39:03.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:02.864+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:03.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:02.864+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:03.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:02.864+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:03.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:02.864+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:03.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:02 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:02.864+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:03.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:03.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:03.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:03.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:03.188+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:03.172+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:03.172+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:03.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:03.172+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:03.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:03 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:03.172+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:03.630 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59259]: 2024-08-31 04:39:03.320493368 +0000 UTC m=+0.773739629 container remove b4b5009bf5c104dc330690d9decc5f5674f3eceb60e2f82d57a584f79192a158 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-08-31T04:39:03.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:03 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:03.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:03.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:03 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:03.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:03.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:03 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:03.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:03.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:03 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:03.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:03.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:03 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:03.194+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:03.967 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59349]: 2024-08-31 04:39:03.629756647 +0000 UTC m=+0.111487440 container create 8696811832d8f783797072623d1998d4c09f65b1539904fb00012175ea252d00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T04:39:03.967 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59349]: 2024-08-31 04:39:03.534176632 +0000 UTC m=+0.015907428 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:03.967 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59349]: 2024-08-31 04:39:03.86579433 +0000 UTC m=+0.347525124 container init 8696811832d8f783797072623d1998d4c09f65b1539904fb00012175ea252d00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T04:39:03.967 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59349]: 2024-08-31 04:39:03.868974945 +0000 UTC m=+0.350705748 container start 8696811832d8f783797072623d1998d4c09f65b1539904fb00012175ea252d00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T04:39:03.967 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:03 smithi064 podman[59349]: 2024-08-31 04:39:03.965737992 +0000 UTC m=+0.447468794 container attach 8696811832d8f783797072623d1998d4c09f65b1539904fb00012175ea252d00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:03.968 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:03.859+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:03.968 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:03.859+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:03.968 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:03.859+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:03.968 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:03.859+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:03.968 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:03.859+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:04.317 INFO:journalctl@ceph.osd.7.smithi064.stdout:Aug 31 04:39:04 smithi064 podman[59349]: 2024-08-31 04:39:04.070636371 +0000 UTC m=+0.552367165 container died 8696811832d8f783797072623d1998d4c09f65b1539904fb00012175ea252d00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:04.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:04.197+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:04.197+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:04.197+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:04.197+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:04.236+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:04.236+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:04.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:04.236+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:04.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:04 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:04.236+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:04.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:04 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:04.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:04.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:04 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:04.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:04.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:04 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:04.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:04.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:04 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:04.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:04.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:04 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:04.198+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:04.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T04:39:04.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:04.731 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T04:39:04.732 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T04:39:04.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.8 2024-08-31T04:39:05.046 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:04 smithi132 systemd[1]: Stopping Ceph osd.8 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:05.046 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.044+0000 7f042da16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:05.046 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.044+0000 7f042da16640 -1 osd.8 101 *** Got signal Terminated *** 2024-08-31T04:39:05.047 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.044+0000 7f042da16640 -1 osd.8 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:05.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:04 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:04.834+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:05.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:04 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:04.834+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:05.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:04 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:04.834+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:05.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:04 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:04.834+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:05.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:04 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:04.834+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:05.317 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:05.241+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:05.317 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:05.241+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:05.241+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:05.241+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.204+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.204+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.204+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:05.318 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:05 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:05.204+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:05.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:05 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:05.157+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:05.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:05 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:05.157+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:05.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:05 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:05.157+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:05.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:05 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:05.157+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:05.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:05 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:05.157+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:06.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:05 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:05.831+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:06.317 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:05 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:05.831+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:06.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:05 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:05.831+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:06.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:05 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:05.831+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:06.318 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:05 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:05.831+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:06.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:06.287+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:06.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:06.287+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:06.287+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:06.287+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:06.225+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:06.225+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:06.225+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:06.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:06 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:06.225+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:06.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:06 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:06.193+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:06.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:06 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:06.193+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:06.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:06 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:06.193+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:06.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:06 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:06.193+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:06.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:06 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:06.193+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:07.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:06 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:06.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:07.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:06 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:06.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:07.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:06 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:06.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:07.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:06 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:06.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:07.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:06 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:06.813+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:07.576 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:07.267+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:07.576 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:07.267+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:07.576 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:07.267+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:07.577 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:07.267+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:07.577 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:07.249+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:07.577 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:07.249+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:07.577 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:07.249+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:07.577 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:07 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:07.249+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:07.648 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:07.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:07.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:07.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:07.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:07.649 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:07 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:07.168+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:08.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:08.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:08.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:08.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:08.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:08.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:07.771+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:08.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:08.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:08.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:08.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:08.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:08.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:08 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:08.145+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:08.567 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:08.227+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:08.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:08.227+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:08.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:08.227+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:08.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:08.227+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:08.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:08.218+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:08.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:08.218+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:08.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:08.218+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:08.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:08.218+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:08.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:08 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:08.218+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:09.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:09.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:09.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:09.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:09.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:09.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:08 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:08.744+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:09.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:09.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:09.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:09.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:09.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:09.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:09 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:09.127+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:09.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:09.263+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:09.263+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:09.263+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:09.263+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:09.263+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:09.196+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.540930+0000 front 2024-08-31T04:38:02.541025+0000 (oldest deadline 2024-08-31T04:38:28.440977+0000) 2024-08-31T04:39:09.568 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:09.196+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.143978+0000 front 2024-08-31T04:38:21.144060+0000 (oldest deadline 2024-08-31T04:38:42.244115+0000) 2024-08-31T04:39:09.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:09.196+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:25.745022+0000 front 2024-08-31T04:38:25.745119+0000 (oldest deadline 2024-08-31T04:38:52.745708+0000) 2024-08-31T04:39:09.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:09.196+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:36.246742+0000 front 2024-08-31T04:38:36.246824+0000 (oldest deadline 2024-08-31T04:38:58.546803+0000) 2024-08-31T04:39:09.569 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:09 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8[41827]: 2024-08-31T04:39:09.196+0000 7f042a001640 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.948177+0000 front 2024-08-31T04:38:44.948141+0000 (oldest deadline 2024-08-31T04:39:08.448236+0000) 2024-08-31T04:39:10.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:10.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:10.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:10.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:10.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:10.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:09 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:09.745+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:10.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:10.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:10.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:10.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:10.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:10.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:10 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:10.128+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:10.525 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:10 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:10.273+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:10.526 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:10 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:10.273+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:10.526 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:10 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:10.273+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:10.526 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:10 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:10.273+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:10.526 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:10 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:10.273+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:10.817 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:10 smithi132 podman[59644]: 2024-08-31 04:39:10.524913726 +0000 UTC m=+5.601094801 container died 9b50450c3025e23695b98b3803e08fac4e0e3ced945e07a099ad939ac05fafc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:39:11.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:11.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:11.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:11.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:11.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:11.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:10 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:10.711+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:11.180 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:10 smithi132 podman[59644]: 2024-08-31 04:39:10.936335731 +0000 UTC m=+6.012516805 container cleanup 9b50450c3025e23695b98b3803e08fac4e0e3ced945e07a099ad939ac05fafc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T04:39:11.180 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:10 smithi132 bash[59644]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8 2024-08-31T04:39:11.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:11.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:11.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:11.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:11.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:11.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:11 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:11.094+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:11.500 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59658]: 2024-08-31 04:39:11.179290888 +0000 UTC m=+0.648865611 container remove 9b50450c3025e23695b98b3803e08fac4e0e3ced945e07a099ad939ac05fafc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T04:39:11.501 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:11.313+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:11.501 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:11.313+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:11.501 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:11.313+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:11.501 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:11.313+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:11.502 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:11.313+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:11.754 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.402397298 +0000 UTC m=+0.015862435 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:11.754 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.505246564 +0000 UTC m=+0.118711695 container create 51aeda29926c6ab882e9c51379d1bcc626e73e67651080e42623b389002ea96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T04:39:11.754 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.749957358 +0000 UTC m=+0.363422496 container init 51aeda29926c6ab882e9c51379d1bcc626e73e67651080e42623b389002ea96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T04:39:11.755 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.753184458 +0000 UTC m=+0.366649587 container start 51aeda29926c6ab882e9c51379d1bcc626e73e67651080e42623b389002ea96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T04:39:12.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:12.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:12.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:12.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:12.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:12.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:11 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:11.675+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:12.069 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.866786388 +0000 UTC m=+0.480251523 container attach 51aeda29926c6ab882e9c51379d1bcc626e73e67651080e42623b389002ea96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T04:39:12.069 INFO:journalctl@ceph.osd.8.smithi132.stdout:Aug 31 04:39:11 smithi132 podman[59744]: 2024-08-31 04:39:11.939093321 +0000 UTC m=+0.552558455 container died 51aeda29926c6ab882e9c51379d1bcc626e73e67651080e42623b389002ea96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T04:39:12.299 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:12.299 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:12.299 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:12.299 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:12.299 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:12.300 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.046+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:12.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:12 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:12.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:12.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:12 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:12.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:12.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:12 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:12.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:12.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:12 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:12.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:12.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:12 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:12.324+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:12.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T04:39:12.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:12.665 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T04:39:12.665 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T04:39:12.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.9 2024-08-31T04:39:12.969 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 systemd[1]: Stopping Ceph osd.9 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:12.970 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.967+0000 7f377ed9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:13.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:13.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:13.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:13.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:13.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:13.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:12 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:12.653+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:13.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.967+0000 7f377ed9b640 -1 osd.9 101 *** Got signal Terminated *** 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:12 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:12.967+0000 7f377ed9b640 -1 osd.9 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:13.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:13.399 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:13 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:13.055+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:13.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:13 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:13.279+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:13.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:13 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:13.279+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:13.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:13 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:13.279+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:13.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:13 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:13.279+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:13.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:13 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:13.279+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:14.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:14.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:14.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:14.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:14.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:14.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:13 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:13.701+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:14.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:14.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:14.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:14.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:14.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:14.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:14 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:14.050+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:14.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:14 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:14.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:14.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:14 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:14.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:14.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:14 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:14.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:14.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:14 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:14.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:14.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:14 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:14.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:15.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:15.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:15.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:15.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:15.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:15.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:14 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:14.679+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:15.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:15.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:15.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:15.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:15.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:15.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:15 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:15.061+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:15.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:15.255+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:15.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:15.255+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:15.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:15.255+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:15.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:15.255+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:15.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:15.255+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:16.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:16.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:16.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:16.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:16.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:16.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:15 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:15.635+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:16.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:16.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:16.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:16.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:16.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:16.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:16 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:16.033+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:16.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:16.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:16.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:16.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:16.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:16.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:16.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:16.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:16.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:16 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:16.246+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:17.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:17.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:17.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:17.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:17.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:17.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:16 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:16.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:17.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:01.556822+0000 front 2024-08-31T04:38:01.556662+0000 (oldest deadline 2024-08-31T04:38:27.456808+0000) 2024-08-31T04:39:17.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:07.457234+0000 front 2024-08-31T04:38:07.457323+0000 (oldest deadline 2024-08-31T04:38:39.257849+0000) 2024-08-31T04:39:17.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:20.359073+0000 front 2024-08-31T04:38:20.359265+0000 (oldest deadline 2024-08-31T04:38:43.859076+0000) 2024-08-31T04:39:17.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:29.160004+0000 front 2024-08-31T04:38:29.160025+0000 (oldest deadline 2024-08-31T04:38:54.960562+0000) 2024-08-31T04:39:17.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:37.762411+0000 front 2024-08-31T04:38:37.762608+0000 (oldest deadline 2024-08-31T04:39:02.462306+0000) 2024-08-31T04:39:17.398 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:17 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9[57566]: 2024-08-31T04:39:17.009+0000 7f377737e640 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.163526+0000 front 2024-08-31T04:38:44.163394+0000 (oldest deadline 2024-08-31T04:39:07.063484+0000) 2024-08-31T04:39:17.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:17.262+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:17.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:17.262+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:17.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:17.262+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:17.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:17.262+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:17.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:17 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:17.262+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:18.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:18.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:18.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:18.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:18.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:18.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:18.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:17 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:17.572+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:18.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.301+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:18.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.302+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:18.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.302+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:18.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.302+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:18.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.302+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:18.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:18 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:18.302+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:18.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:18.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:18.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:18.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:18.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:18.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:18.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:18 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:18.548+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:18.869 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:18 smithi002 podman[99519]: 2024-08-31 04:39:18.470720616 +0000 UTC m=+5.600040867 container died 7fcc7dc5703faffc684b24bc16bcfd582b458bcc66cb8218f92804aa42c98e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T04:39:18.869 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:18 smithi002 podman[99519]: 2024-08-31 04:39:18.86763288 +0000 UTC m=+5.996953162 container cleanup 7fcc7dc5703faffc684b24bc16bcfd582b458bcc66cb8218f92804aa42c98e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T04:39:19.119 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:18 smithi002 bash[99519]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9 2024-08-31T04:39:19.397 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99535]: 2024-08-31 04:39:19.119043116 +0000 UTC m=+0.641392768 container remove 7fcc7dc5703faffc684b24bc16bcfd582b458bcc66cb8218f92804aa42c98e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:39:19.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:19.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:19.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:19.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:19.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:19.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:19 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:19.282+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:19.731 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.328888227 +0000 UTC m=+0.015817884 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:19.731 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.444805589 +0000 UTC m=+0.131735276 container create 2b27bc329cc0e18850970db3d0cf10af2b8ce1e98bac6c3c25974c5d291316bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:39:19.731 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.655295991 +0000 UTC m=+0.342225640 container init 2b27bc329cc0e18850970db3d0cf10af2b8ce1e98bac6c3c25974c5d291316bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-31T04:39:19.731 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.658601144 +0000 UTC m=+0.345530792 container start 2b27bc329cc0e18850970db3d0cf10af2b8ce1e98bac6c3c25974c5d291316bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T04:39:19.731 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.73033826 +0000 UTC m=+0.417267911 container attach 2b27bc329cc0e18850970db3d0cf10af2b8ce1e98bac6c3c25974c5d291316bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T04:39:20.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:20.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:20.067 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:20.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:20.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:20.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:20.068 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:19 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:19.579+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:20.142 INFO:journalctl@ceph.osd.9.smithi002.stdout:Aug 31 04:39:19 smithi002 podman[99623]: 2024-08-31 04:39:19.858047822 +0000 UTC m=+0.544977471 container died 2b27bc329cc0e18850970db3d0cf10af2b8ce1e98bac6c3c25974c5d291316bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:20.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T04:39:20.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:20.458 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T04:39:20.458 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T04:39:20.459 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.10 2024-08-31T04:39:20.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:20.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:20.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:20.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:20.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:20.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:20.288+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 systemd[1]: Stopping Ceph osd.10 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:20.774 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:20.775 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:20.775 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.585+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:20.775 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.771+0000 7f1749c13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:20.775 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.771+0000 7f1749c13640 -1 osd.10 101 *** Got signal Terminated *** 2024-08-31T04:39:20.775 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:20 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:20.771+0000 7f1749c13640 -1 osd.10 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:21.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:21.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:21.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:21.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:21.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:21.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:21 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:21.286+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:21.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:21.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:21.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:21.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:21.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:21.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:21.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:21 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:21.550+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:22.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:22.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:22.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:22.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:22.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:22.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:22 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:22.303+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:22.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:22.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:22.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:22.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:22.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:22.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:22.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:22 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:22.518+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:23.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:23.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:23.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:23.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:23.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:23.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:23.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:23 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:23.471+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:23.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:23.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:23.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:23.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:23.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:23.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:23.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:23.346+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:24.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:24.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:24 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:24.443+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:24.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:24.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:24 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:24.368+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:25.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.403970+0000 front 2024-08-31T04:38:02.403833+0000 (oldest deadline 2024-08-31T04:38:27.004584+0000) 2024-08-31T04:39:25.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:11.106024+0000 front 2024-08-31T04:38:11.105820+0000 (oldest deadline 2024-08-31T04:38:37.005934+0000) 2024-08-31T04:39:25.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:21.107192+0000 front 2024-08-31T04:38:21.107079+0000 (oldest deadline 2024-08-31T04:38:43.407031+0000) 2024-08-31T04:39:25.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-08-31T04:38:28.107766+0000 front 2024-08-31T04:38:28.107868+0000 (oldest deadline 2024-08-31T04:38:54.007791+0000) 2024-08-31T04:39:25.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:34.008409+0000 front 2024-08-31T04:38:34.008433+0000 (oldest deadline 2024-08-31T04:38:58.708439+0000) 2024-08-31T04:39:25.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:43.409570+0000 front 2024-08-31T04:38:43.409702+0000 (oldest deadline 2024-08-31T04:39:06.909361+0000) 2024-08-31T04:39:25.818 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:25 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10[47744]: 2024-08-31T04:39:25.488+0000 7f17421f6640 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:52.210245+0000 front 2024-08-31T04:38:52.210322+0000 (oldest deadline 2024-08-31T04:39:17.510096+0000) 2024-08-31T04:39:25.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:25.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:25 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:25.358+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:26.515 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:26 smithi064 podman[59453]: 2024-08-31 04:39:26.205998135 +0000 UTC m=+5.553220538 container died 7d190307c71df9af03bad286745c1b2e98403ac67c6147910b60e519f24d63a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:26.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:26 smithi064 podman[59453]: 2024-08-31 04:39:26.596996505 +0000 UTC m=+5.944218897 container cleanup 7d190307c71df9af03bad286745c1b2e98403ac67c6147910b60e519f24d63a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T04:39:26.817 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:26 smithi064 bash[59453]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10 2024-08-31T04:39:26.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:26.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:26.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:26.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:26.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:26.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:26.819 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:26 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:26.339+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:27.154 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:26 smithi064 podman[59470]: 2024-08-31 04:39:26.831569155 +0000 UTC m=+0.627996565 container remove 7d190307c71df9af03bad286745c1b2e98403ac67c6147910b60e519f24d63a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:27.408 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.056497089 +0000 UTC m=+0.015983797 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:27.408 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.30018006 +0000 UTC m=+0.259666807 container create 070ccf37dbf3da75c83e02a3d404100d4682b9f26edf656227bf86168a871f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T04:39:27.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:27.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:27.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:27.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:27.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:27.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:27.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:27 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:27.290+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:27.737 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.543132471 +0000 UTC m=+0.502619169 container init 070ccf37dbf3da75c83e02a3d404100d4682b9f26edf656227bf86168a871f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-08-31T04:39:27.737 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.546423189 +0000 UTC m=+0.505909885 container start 070ccf37dbf3da75c83e02a3d404100d4682b9f26edf656227bf86168a871f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T04:39:27.738 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.626240035 +0000 UTC m=+0.585726750 container attach 070ccf37dbf3da75c83e02a3d404100d4682b9f26edf656227bf86168a871f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T04:39:28.073 INFO:journalctl@ceph.osd.10.smithi064.stdout:Aug 31 04:39:27 smithi064 podman[59556]: 2024-08-31 04:39:27.736278504 +0000 UTC m=+0.695765216 container died 070ccf37dbf3da75c83e02a3d404100d4682b9f26edf656227bf86168a871f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T04:39:28.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T04:39:28.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:28.299 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T04:39:28.299 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T04:39:28.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.11 2024-08-31T04:39:28.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.312+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:28.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 systemd[1]: Stopping Ceph osd.11 for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:29.067 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.597+0000 7f62ad767640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:29.067 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.597+0000 7f62ad767640 -1 osd.11 101 *** Got signal Terminated *** 2024-08-31T04:39:29.068 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:28 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:28.597+0000 7f62ad767640 -1 osd.11 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:29.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:29.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:29.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:29.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:29.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:29.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:29.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:29 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:29.310+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:30.817 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:30.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:30 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:30.325+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:31.817 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:31.817 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:31.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:31.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:31.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:31.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:31.818 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:31 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:31.341+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:32.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:32.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:32.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:32.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:32.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:32.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:32.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:32.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:32 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:32.308+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6820 osd.8 since back 2024-08-31T04:39:07.910644+0000 front 2024-08-31T04:39:07.910614+0000 (oldest deadline 2024-08-31T04:39:31.410607+0000) 2024-08-31T04:39:33.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-08-31T04:38:02.200211+0000 front 2024-08-31T04:38:02.200465+0000 (oldest deadline 2024-08-31T04:38:28.100359+0000) 2024-08-31T04:39:33.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6804 osd.1 since back 2024-08-31T04:38:08.100819+0000 front 2024-08-31T04:38:08.100765+0000 (oldest deadline 2024-08-31T04:38:34.000885+0000) 2024-08-31T04:39:33.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-08-31T04:38:19.202417+0000 front 2024-08-31T04:38:19.202625+0000 (oldest deadline 2024-08-31T04:38:43.902552+0000) 2024-08-31T04:39:33.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6812 osd.4 since back 2024-08-31T04:38:35.604941+0000 front 2024-08-31T04:38:35.604890+0000 (oldest deadline 2024-08-31T04:39:00.904603+0000) 2024-08-31T04:39:33.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-08-31T04:38:44.706838+0000 front 2024-08-31T04:38:44.706902+0000 (oldest deadline 2024-08-31T04:39:07.606907+0000) 2024-08-31T04:39:33.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-08-31T04:38:51.707976+0000 front 2024-08-31T04:38:51.708008+0000 (oldest deadline 2024-08-31T04:39:17.607954+0000) 2024-08-31T04:39:33.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.64:6820 osd.7 since back 2024-08-31T04:38:59.308725+0000 front 2024-08-31T04:38:59.308805+0000 (oldest deadline 2024-08-31T04:39:22.808690+0000) 2024-08-31T04:39:33.569 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11[48779]: 2024-08-31T04:39:33.297+0000 7f62a5d4a640 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.132:6820 osd.8 since back 2024-08-31T04:39:07.910644+0000 front 2024-08-31T04:39:07.910614+0000 (oldest deadline 2024-08-31T04:39:31.410607+0000) 2024-08-31T04:39:34.233 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:33 smithi132 podman[59860]: 2024-08-31 04:39:33.959594356 +0000 UTC m=+5.463457187 container died 035b82873687d4cd3915ed1ffcbc2acf0cd9a681a237826dd61604ccd9cb084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:39:34.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:34 smithi132 podman[59860]: 2024-08-31 04:39:34.330640816 +0000 UTC m=+5.834503651 container cleanup 035b82873687d4cd3915ed1ffcbc2acf0cd9a681a237826dd61604ccd9cb084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T04:39:34.568 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:34 smithi132 bash[59860]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11 2024-08-31T04:39:34.992 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:34 smithi132 podman[59875]: 2024-08-31 04:39:34.65683996 +0000 UTC m=+0.698646855 container remove 035b82873687d4cd3915ed1ffcbc2acf0cd9a681a237826dd61604ccd9cb084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-31T04:39:35.310 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:34 smithi132 podman[59966]: 2024-08-31 04:39:34.893879698 +0000 UTC m=+0.015471197 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:35.311 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:35 smithi132 podman[59966]: 2024-08-31 04:39:35.007601801 +0000 UTC m=+0.129193329 container create 09315925c9172946e5e30d9529b42851c5030977e12657e41d32b58fab578d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T04:39:35.311 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:35 smithi132 podman[59966]: 2024-08-31 04:39:35.218434083 +0000 UTC m=+0.340025562 container init 09315925c9172946e5e30d9529b42851c5030977e12657e41d32b58fab578d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:39:35.311 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:35 smithi132 podman[59966]: 2024-08-31 04:39:35.22175465 +0000 UTC m=+0.343346142 container start 09315925c9172946e5e30d9529b42851c5030977e12657e41d32b58fab578d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:35.311 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:35 smithi132 podman[59966]: 2024-08-31 04:39:35.310035955 +0000 UTC m=+0.431627438 container attach 09315925c9172946e5e30d9529b42851c5030977e12657e41d32b58fab578d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:39:35.567 INFO:journalctl@ceph.osd.11.smithi132.stdout:Aug 31 04:39:35 smithi132 podman[59966]: 2024-08-31 04:39:35.412276511 +0000 UTC m=+0.533867993 container died 09315925c9172946e5e30d9529b42851c5030977e12657e41d32b58fab578d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:35.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T04:39:36.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:36.019 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T04:39:36.019 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T04:39:36.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.a 2024-08-31T04:39:36.320 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:36 smithi002 systemd[1]: Stopping Ceph mds.a for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:36.647 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:36 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a[64637]: 2024-08-31T04:39:36.318+0000 7f29b85cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:36.647 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:36 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a[64637]: 2024-08-31T04:39:36.318+0000 7f29b85cf640 -1 mds.a *** got signal Terminated *** 2024-08-31T04:39:40.602 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:40 smithi002 podman[99726]: 2024-08-31 04:39:40.326540394 +0000 UTC m=+4.109279552 container died 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:40.897 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:40 smithi002 podman[99726]: 2024-08-31 04:39:40.692783789 +0000 UTC m=+4.475522951 container cleanup 91fab9dfbc2e6b769a972320193e9c509c7974486ae318e68143af0370b8b2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T04:39:40.898 INFO:journalctl@ceph.mds.a.smithi002.stdout:Aug 31 04:39:40 smithi002 bash[99726]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-a 2024-08-31T04:39:41.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T04:39:41.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:41.114 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T04:39:41.114 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T04:39:41.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.d 2024-08-31T04:39:41.531 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:41 smithi002 systemd[1]: Stopping Ceph mds.d for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:41.897 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:41 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d[63450]: 2024-08-31T04:39:41.529+0000 7f79c68f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:41.898 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:41 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d[63450]: 2024-08-31T04:39:41.529+0000 7f79c68f2640 -1 mds.d *** got signal Terminated *** 2024-08-31T04:39:45.797 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:45 smithi002 podman[99848]: 2024-08-31 04:39:45.538578156 +0000 UTC m=+4.206640361 container died a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:46.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:45 smithi002 podman[99848]: 2024-08-31 04:39:45.896405319 +0000 UTC m=+4.564467524 container cleanup a4e052cf020f5437d6982acdb916b550718e0286de7329f433499b00c52a8b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T04:39:46.147 INFO:journalctl@ceph.mds.d.smithi002.stdout:Aug 31 04:39:45 smithi002 bash[99848]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-d 2024-08-31T04:39:46.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T04:39:46.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:46.348 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T04:39:46.349 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T04:39:46.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.g 2024-08-31T04:39:46.897 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:46 smithi002 systemd[1]: Stopping Ceph mds.g for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:46.897 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-g[64264]: 2024-08-31T04:39:46.648+0000 7f88ebca6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:46.898 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:46 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-g[64264]: 2024-08-31T04:39:46.648+0000 7f88ebca6640 -1 mds.g *** got signal Terminated *** 2024-08-31T04:39:49.647 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:49 smithi002 podman[99969]: 2024-08-31 04:39:49.37403959 +0000 UTC m=+2.811973704 container died 604f1ff561af144eada65c893d531bdbfc4f6792166aae4cbb96526a525012ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T04:39:49.993 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:49 smithi002 podman[99969]: 2024-08-31 04:39:49.724904052 +0000 UTC m=+3.162838155 container cleanup 604f1ff561af144eada65c893d531bdbfc4f6792166aae4cbb96526a525012ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T04:39:49.994 INFO:journalctl@ceph.mds.g.smithi002.stdout:Aug 31 04:39:49 smithi002 bash[99969]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-g 2024-08-31T04:39:50.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T04:39:50.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:50.186 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T04:39:50.186 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T04:39:50.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.j 2024-08-31T04:39:50.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:50 smithi002 systemd[1]: Stopping Ceph mds.j for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:50.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j[63053]: 2024-08-31T04:39:50.486+0000 7f57153c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:50.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:50 smithi002 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j[63053]: 2024-08-31T04:39:50.486+0000 7f57153c2640 -1 mds.j *** got signal Terminated *** 2024-08-31T04:39:54.380 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:54 smithi002 podman[100101]: 2024-08-31 04:39:54.123115582 +0000 UTC m=+3.715776944 container died 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T04:39:54.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:54 smithi002 podman[100101]: 2024-08-31 04:39:54.528568987 +0000 UTC m=+4.121230339 container cleanup 6997f8e0ef6dc61a914f016605fadac127472bcb92e53b948b1dbfab68ba3ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T04:39:54.647 INFO:journalctl@ceph.mds.j.smithi002.stdout:Aug 31 04:39:54 smithi002 bash[100101]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-j 2024-08-31T04:39:54.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T04:39:54.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:54.928 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T04:39:54.928 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T04:39:54.929 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.b 2024-08-31T04:39:55.232 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:54 smithi064 systemd[1]: Stopping Ceph mds.b for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:55.567 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: 2024-08-31T04:39:55.230+0000 7f2aeeb88640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:55.567 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:55 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b[53386]: 2024-08-31T04:39:55.230+0000 7f2aeeb88640 -1 mds.b *** got signal Terminated *** 2024-08-31T04:39:58.817 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:58 smithi064 podman[59671]: 2024-08-31 04:39:58.476694744 +0000 UTC m=+3.351706619 container died 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:59.208 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:58 smithi064 podman[59671]: 2024-08-31 04:39:58.972068804 +0000 UTC m=+3.847080720 container cleanup 25475801b8e486025e19dce59596a39d9d99cfe09a772b03f7a999ce6f2212ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T04:39:59.208 INFO:journalctl@ceph.mds.b.smithi064.stdout:Aug 31 04:39:58 smithi064 bash[59671]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-b 2024-08-31T04:39:59.363 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T04:39:59.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:59.398 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T04:39:59.398 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T04:39:59.399 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.e 2024-08-31T04:39:59.743 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:39:59 smithi064 systemd[1]: Stopping Ceph mds.e for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:00.067 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:39:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: 2024-08-31T04:39:59.741+0000 7fdebe1e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:00.067 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:39:59 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e[52782]: 2024-08-31T04:39:59.741+0000 7fdebe1e3640 -1 mds.e *** got signal Terminated *** 2024-08-31T04:40:02.727 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:40:02 smithi064 podman[59793]: 2024-08-31 04:40:02.474666611 +0000 UTC m=+2.856558633 container died 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T04:40:03.067 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:40:02 smithi064 podman[59793]: 2024-08-31 04:40:02.825729504 +0000 UTC m=+3.207621517 container cleanup 81742cf9c25e2c642fda0efaf5d34f59764c2be84f7e1eb877f14a7a529b840e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T04:40:03.067 INFO:journalctl@ceph.mds.e.smithi064.stdout:Aug 31 04:40:02 smithi064 bash[59793]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-e 2024-08-31T04:40:03.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T04:40:03.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:03.454 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T04:40:03.455 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T04:40:03.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.h 2024-08-31T04:40:03.797 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:03 smithi064 systemd[1]: Stopping Ceph mds.h for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:04.067 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: 2024-08-31T04:40:03.795+0000 7fa986980640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:04.067 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:03 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h[53084]: 2024-08-31T04:40:03.795+0000 7fa986980640 -1 mds.h *** got signal Terminated *** 2024-08-31T04:40:06.778 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:06 smithi064 podman[59928]: 2024-08-31 04:40:06.470244316 +0000 UTC m=+2.798654454 container died f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T04:40:07.040 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:06 smithi064 podman[59928]: 2024-08-31 04:40:06.892174817 +0000 UTC m=+3.220584955 container cleanup f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:07.040 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:06 smithi064 bash[59928]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h 2024-08-31T04:40:07.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T04:40:07.297 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:07 smithi064 podman[59941]: 2024-08-31 04:40:07.03959697 +0000 UTC m=+0.561395255 container remove f94244822c72b056e4bf538262abc3a66c0feeb97b4da0b44839ce668fa0beb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:40:07.298 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:07 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.h.service: Deactivated successfully. 2024-08-31T04:40:07.298 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:07 smithi064 systemd[1]: Stopped Ceph mds.h for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:40:07.298 INFO:journalctl@ceph.mds.h.smithi064.stdout:Aug 31 04:40:07 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.h.service: Consumed 43.122s CPU time. 2024-08-31T04:40:07.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:07.309 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T04:40:07.309 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T04:40:07.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.k 2024-08-31T04:40:07.567 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:07 smithi064 systemd[1]: Stopping Ceph mds.k for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:08.067 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: 2024-08-31T04:40:07.658+0000 7fbe666c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:08.067 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:07 smithi064 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k[52484]: 2024-08-31T04:40:07.658+0000 7fbe666c6640 -1 mds.k *** got signal Terminated *** 2024-08-31T04:40:10.743 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:10 smithi064 podman[60049]: 2024-08-31 04:40:10.480586311 +0000 UTC m=+2.953730263 container died add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-31T04:40:11.002 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:10 smithi064 podman[60049]: 2024-08-31 04:40:10.825308327 +0000 UTC m=+3.298452263 container cleanup add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T04:40:11.002 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:10 smithi064 bash[60049]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k 2024-08-31T04:40:11.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T04:40:11.256 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:11 smithi064 podman[60064]: 2024-08-31 04:40:11.001323504 +0000 UTC m=+0.510819454 container remove add45e878c73b151996bff91d04e132f46f52b744d86f7c0ca0621f3d89e60ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:11.256 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:11 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.k.service: Deactivated successfully. 2024-08-31T04:40:11.256 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:11 smithi064 systemd[1]: Stopped Ceph mds.k for 4070480a-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:40:11.256 INFO:journalctl@ceph.mds.k.smithi064.stdout:Aug 31 04:40:11 smithi064 systemd[1]: ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.k.service: Consumed 2.081s CPU time. 2024-08-31T04:40:11.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:11.266 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T04:40:11.267 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T04:40:11.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.c 2024-08-31T04:40:11.567 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:11 smithi132 systemd[1]: Stopping Ceph mds.c for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:12.067 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: 2024-08-31T04:40:11.579+0000 7f2800d61640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:12.068 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:11 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c[53607]: 2024-08-31T04:40:11.579+0000 7f2800d61640 -1 mds.c *** got signal Terminated *** 2024-08-31T04:40:14.817 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:14 smithi132 podman[60083]: 2024-08-31 04:40:14.457800826 +0000 UTC m=+2.990076787 container died 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T04:40:15.189 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:14 smithi132 podman[60083]: 2024-08-31 04:40:14.987570514 +0000 UTC m=+3.519846467 container cleanup 503d822a4f6ce65c62628382a27fb9bd4bc198e505ab7a16d0831824bd007d02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:15.190 INFO:journalctl@ceph.mds.c.smithi132.stdout:Aug 31 04:40:14 smithi132 bash[60083]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-c 2024-08-31T04:40:15.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T04:40:15.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:15.451 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T04:40:15.451 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T04:40:15.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.f 2024-08-31T04:40:15.801 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:15 smithi132 systemd[1]: Stopping Ceph mds.f for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:16.067 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f[53305]: 2024-08-31T04:40:15.799+0000 7f3be2f86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:16.068 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:15 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f[53305]: 2024-08-31T04:40:15.799+0000 7f3be2f86640 -1 mds.f *** got signal Terminated *** 2024-08-31T04:40:19.301 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:18 smithi132 podman[60203]: 2024-08-31 04:40:18.971430357 +0000 UTC m=+3.299902594 container died ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:40:19.567 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:19 smithi132 podman[60203]: 2024-08-31 04:40:19.391060499 +0000 UTC m=+3.719532690 container cleanup ee93736f8257677239483bf4a2ef5fa2f0b17a65324cce5ad61e3b676aca9b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-31T04:40:19.567 INFO:journalctl@ceph.mds.f.smithi132.stdout:Aug 31 04:40:19 smithi132 bash[60203]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-f 2024-08-31T04:40:19.736 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T04:40:19.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:19.769 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T04:40:19.769 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T04:40:19.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.i 2024-08-31T04:40:20.067 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:19 smithi132 systemd[1]: Stopping Ceph mds.i for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:20.567 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: 2024-08-31T04:40:20.236+0000 7f2ae2d34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:20.567 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:20 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i[53906]: 2024-08-31T04:40:20.236+0000 7f2ae2d34640 -1 mds.i *** got signal Terminated *** 2024-08-31T04:40:22.738 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:22 smithi132 podman[60324]: 2024-08-31 04:40:22.45933077 +0000 UTC m=+2.478245320 container died 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:23.067 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:22 smithi132 podman[60324]: 2024-08-31 04:40:22.845397633 +0000 UTC m=+2.864312182 container cleanup 8a3b2cc30c4d689e5645e504e498c43c41a9d5649acb2d66f285f9614aa99ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True) 2024-08-31T04:40:23.067 INFO:journalctl@ceph.mds.i.smithi132.stdout:Aug 31 04:40:22 smithi132 bash[60324]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-i 2024-08-31T04:40:23.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T04:40:23.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:23.271 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T04:40:23.271 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T04:40:23.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.l 2024-08-31T04:40:23.609 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:23 smithi132 systemd[1]: Stopping Ceph mds.l for 4070480a-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:24.067 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l[53006]: 2024-08-31T04:40:23.608+0000 7fb887e29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:24.067 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:23 smithi132 ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l[53006]: 2024-08-31T04:40:23.608+0000 7fb887e29640 -1 mds.l *** got signal Terminated *** 2024-08-31T04:40:27.975 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:27 smithi132 podman[60445]: 2024-08-31 04:40:27.617939097 +0000 UTC m=+4.128995391 container died f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T04:40:28.267 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:28 smithi132 podman[60445]: 2024-08-31 04:40:28.056833908 +0000 UTC m=+4.567890193 container cleanup f4bf515877a9ab2267744eaa8e0381d6e483d7ab8c0b77123eefc9d50ae2cce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:28.267 INFO:journalctl@ceph.mds.l.smithi132.stdout:Aug 31 04:40:28 smithi132 bash[60445]: ceph-4070480a-674f-11ef-bcd4-c7b262605968-mds-l 2024-08-31T04:40:28.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4070480a-674f-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T04:40:28.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:28.523 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T04:40:28.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:40:28.736 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:40:31.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:40:31.419 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:40:34.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:40:34.231 INFO:teuthology.orchestra.run.smithi132.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:40:36.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:40:36.614 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:40:36.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:40:36.673 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T04:40:36.675 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi002/crash 2024-08-31T04:40:36.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:40:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:40:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:40:36.718 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi064/crash 2024-08-31T04:40:36.719 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:40:36.768 INFO:teuthology.orchestra.run.smithi064.stderr:tar: /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:40:36.768 INFO:teuthology.orchestra.run.smithi064.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:40:36.770 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi132/crash 2024-08-31T04:40:36.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:40:36.812 INFO:teuthology.orchestra.run.smithi132.stderr:tar: /var/lib/ceph/4070480a-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:40:36.813 INFO:teuthology.orchestra.run.smithi132.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:40:36.814 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T04:40:36.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T04:40:36.853 INFO:tasks.cephadm:Compressing logs... 2024-08-31T04:40:36.853 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:40:36.896 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:40:36.899 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:40:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-31T04:40:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-08-31T04:40:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T04:40:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-31T04:40:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr: 84.0%/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log: -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:40:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T04:40:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log: No such file or directory 2024-08-31T04:40:36.929 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-08-31T04:40:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:40:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose --/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log: /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T04:40:36.930 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T04:40:36.930 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:40:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T04:40:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log: 81.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log: 90.2% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:40:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log: 86.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr: 95.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log: /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T04:40:36.935 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:40:36.936 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log: 95.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T04:40:36.937 INFO:teuthology.orchestra.run.smithi064.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T04:40:36.937 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T04:40:36.937 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T04:40:36.938 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T04:40:36.938 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log: /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T04:40:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T04:40:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:40:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T04:40:36.941 INFO:teuthology.orchestra.run.smithi002.stderr: 95.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T04:40:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T04:40:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:40:36.943 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:40:36.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T04:40:36.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T04:40:36.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T04:40:36.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:40:36.945 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T04:40:36.946 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:40:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T04:40:36.947 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:40:36.954 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log: 94.9% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T04:40:36.961 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:40:37.166 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 81.2% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:40:37.172 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:40:37.245 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T04:40:37.283 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:40:37.318 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:40:37.318 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T04:40:37.354 INFO:teuthology.orchestra.run.smithi064.stderr: 86.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:40:37.367 INFO:teuthology.orchestra.run.smithi132.stderr: 91.7% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T04:40:37.665 INFO:teuthology.orchestra.run.smithi132.stderr: 94.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T04:40:37.840 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T04:40:39.147 INFO:teuthology.orchestra.run.smithi064.stderr: 94.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T04:40:50.941 INFO:teuthology.orchestra.run.smithi132.stderr: 91.9% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T04:40:54.153 INFO:teuthology.orchestra.run.smithi002.stderr: 92.0% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T04:40:55.699 INFO:teuthology.orchestra.run.smithi132.stderr: 94.8% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T04:40:56.081 INFO:teuthology.orchestra.run.smithi132.stderr: 91.7% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T04:40:57.205 INFO:teuthology.orchestra.run.smithi002.stderr: 91.7% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T04:40:58.514 INFO:teuthology.orchestra.run.smithi002.stderr: 91.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T04:40:59.340 INFO:teuthology.orchestra.run.smithi002.stderr: 91.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T04:40:59.342 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-31T04:40:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m22.432s 2024-08-31T04:40:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:user 1m20.325s 2024-08-31T04:40:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m2.363s 2024-08-31T04:41:00.559 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T04:41:03.843 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T04:41:03.845 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-08-31T04:41:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m26.932s 2024-08-31T04:41:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:user 1m40.439s 2024-08-31T04:41:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m3.089s 2024-08-31T04:41:09.194 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T04:41:18.725 INFO:teuthology.orchestra.run.smithi064.stderr: 95.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T04:41:42.951 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T04:42:20.690 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T04:42:47.548 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T04:42:55.970 INFO:teuthology.orchestra.run.smithi064.stderr: 91.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T04:43:15.233 INFO:teuthology.orchestra.run.smithi064.stderr: 91.4% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T04:47:14.590 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/4070480a-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T04:47:14.592 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-08-31T04:47:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:real 6m37.677s 2024-08-31T04:47:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:user 5m37.862s 2024-08-31T04:47:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m12.159s 2024-08-31T04:47:14.594 INFO:tasks.cephadm:Archiving logs... 2024-08-31T04:47:14.595 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi002/log 2024-08-31T04:47:14.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:47:28.172 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi064/log 2024-08-31T04:47:28.173 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:48:18.115 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi132/log 2024-08-31T04:48:18.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:48:32.936 INFO:tasks.cephadm:Removing cluster... 2024-08-31T04:48:32.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:33.147 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:33.537 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:33.866 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:34.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4070480a-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:Deleting cluster with fsid: 4070480a-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:35.060 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T04:48:35.060 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:35.081 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:35.099 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:35.117 INFO:tasks.cephadm:Teardown complete 2024-08-31T04:48:35.117 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T04:48:35.880 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T04:48:35.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:35.885 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:35.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:36.009 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T04:48:36.189 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T04:48:36.189 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:36.193 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:36.198 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:36.212 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:36.212 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:36.212 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-31T04:48:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +220us[ +231us] +/- 56ms 2024-08-31T04:48:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +8123ns[ +19us] +/- 58ms 2024-08-31T04:48:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -257us[ -251us] +/- 77ms 2024-08-31T04:48:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:36.215 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:36.220 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:36.220 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-08-31T04:48:36.220 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +203us[ +220us] +/- 56ms 2024-08-31T04:48:36.221 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +3405ns[ +13us] +/- 57ms 2024-08-31T04:48:36.221 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 -256us[ -256us] +/- 77ms 2024-08-31T04:48:36.221 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:36.259 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:36.259 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-08-31T04:48:36.259 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +190us[ +186us] +/- 56ms 2024-08-31T04:48:36.259 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -28us[ -28us] +/- 58ms 2024-08-31T04:48:36.260 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -279us[ -283us] +/- 77ms 2024-08-31T04:48:36.260 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:36.261 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T04:48:36.390 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T04:48:36.390 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T04:48:36.439 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:36.516 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:36.587 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:36.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:36.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:36.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:36.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:36.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:36.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:36.736 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T04:48:36.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T04:48:36.758 INFO:teuthology.task.internal:Duration was 2397.809566 seconds 2024-08-31T04:48:36.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T04:48:36.767 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T04:48:36.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:36.770 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:36.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:36.816 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:36.857 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:37.185 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T04:48:37.186 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-08-31T04:48:37.186 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:37.247 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-08-31T04:48:37.248 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:37.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-08-31T04:48:37.287 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:37.338 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T04:48:37.338 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:37.341 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:37.343 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:37.373 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T04:48:37.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:37.412 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:37.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:38.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T04:48:38.509 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T04:48:38.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:38.535 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:38.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:38.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T04:48:38.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.633 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-08-31T04:48:38.653 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-08-31T04:48:38.662 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-08-31T04:48:38.740 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:38.755 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:38.771 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:38.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:38.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T04:48:38.811 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T04:48:38.813 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi002 2024-08-31T04:48:38.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:38.869 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi064 2024-08-31T04:48:38.869 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:38.902 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881276/remote/smithi132 2024-08-31T04:48:38.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:38.937 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T04:48:38.938 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:38.940 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:38.942 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:38.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T04:48:38.998 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T04:48:38.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T04:48:39.011 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T04:48:39.012 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:39.014 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:39.017 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:39.029 INFO:teuthology.orchestra.run.smithi064.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:39.041 INFO:teuthology.orchestra.run.smithi132.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:39.042 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T04:48:39.053 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T04:48:39.081 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} duration: 2397.809566259384 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fae87f6759af473b9a33c5346455ff1f status: fail success: false 2024-08-31T04:48:39.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T04:48:39.168 INFO:teuthology.run:FAIL